Simon Pearson - minor9th.com

A new project: making light of music

Wednesday, May 11, 2011

7 Comments »


This May I’ve decided to embark upon a project to create a piano which makes light out of situations. And I might need your help / expertise!

My parents are moving house and my piano which was in North Wales is now sitting in my front room in London, having been bumbled across some cobbles and hauled up the stairs by some very triangular muscled men from Kent. It’s very exciting. But it got me to thinking that I’d like to do more than learn new music, brush up on pieces I haven’t touched for years and give the odd lesson here and there.

I’d like to make a piano which spews light, cleverly, depending on what keys are pressed. It should be fairly seamless and not overt, so the workings need to hide inside, but the basic premise is:

Someone plays the keys -> Some magic processing happens -> The music is interpreted, tastefully, in light form and slips out from above the keybed, over the top of the piano and beyond. Here’s a crap drawing of what it might look like:

Not only would it be a fun project but it would also be a great thing to contribute to Burning Man festival in Nevada, which I’m hoping to attend for the third time either this August or next. We camp with Illumination Village, a group of talented like-minded souls who bring joy to the festival through incredible fire art, beautiful photography and unicorn stampedes, among other things.

Back to the piano. There are some major logistic challenges ahead, and I think the key things are:

How to sense what keys are being pressed?

My early research shows there are a number of ways to do this. Using either pressure sensors or vibration sensors. I’m not sure if the latter would be suitable due to string cross-vibrations but the latter would certainly be cheaper. Then there’s the issue of there being 88 inputs and ideally it’d be great to be able to sense them individually so these would need to be processed in some way.

There are systems such as PNOScan and TFT midi record which can be fitted to a piano – they are an array of sensors and a strip which sits in the keybed. it takes a little time to do but it’s by no means impossible. They also provide a controller box which spews midi out, and my music geek education means I’m on safe ground when it comes to midi data and how to process it, which is a good thing. The downside is cost: the PNOScan system is available in the UK for a whopping £750 which feels a bit steep. Especially when there are other bits to consider…

How will the processing work?

I already have an arduino and have just got an midi shield for it which will allow me to process midi in, however it’s a little board with none of the pots or connectors soldered on. I’m also getting my electronics foo back on early in the process :) The first step will be to plug my midi keyboard into this module, attach it to my arduino and laptop and start doing some basic processing with a simple LED array, which brings me on to…

How will the lights work?

This is the bit I’m least sure about. There are plenty of LED rope lights and multi-colour LED ribbons but I don’t yet know exactly how to control them or whether they are individually controllable. Ideally there would be a way to address the lights individually via a controller to allow some funky processing, eg if someone plays an F# then that one light would come on, then the next in the series, then the next, so the effect would be of the note emanating from the top of the chain through to the bottom. This will be the biggest challenge for me. At the moment I’m thinking of building a string of say 20 of multi-coloured LEDs wrapped in ping pong balls, attached to a controller, and repeating that a number of times (possibly 88, possibly only one per octave)

How much will this thing cost?! And what are the other constraints?

I’m beginning to realise how much art projects on the playa can set people back. It’s going to cost a pretty penny. I think I’m setting my budget at about £2k but that will have to cover:

  • Electronics to provide note on / off information from each key
  • Arduino kit & midi shield
  • Array of multi-colour LEDs
  • LED controllers (DMX?)
  • A second-hand upright piano to be located in San Francisco
  • Hire of van with tail lift and ropes for securing
  • Paint and decoration
  • Tools to make modifications to piano
  • Potential post-festival storage of equipment and/or piano

There’s also the small matter of being able to get the electronics from London to a little north of Gerlach which means the eletronics and piano fittings need to be robust and fit into something no larger than a suitcase (and I’ll probably have some ‘splainin to do at customs), and it will need to be able to withstand getting somewhat dusty. OK, very dusty.

What should it be called?

This project needs a name. That’s one of the first things to sort.

What’s happening this week?

  1. With the midi shield here and my soldering kit on the way I’m going to create a little prototype which goes all the way from receiving midi. This will give me a good idea of:

    • Whether I should be trusted with a soldering iron
    • Whether arduino is good enough to be able to process the midi and do simple and more complex light manipulation
  2. Come up with some names

Are you still reading this?

If so you might have some useful knowledge which I’ll definitely need to get this thing going! Get in touch in the comments or email simon at this domain name.


Share this


7 comments

  1. All interesting – I’m sure there are some light pianos from the 60s but can’t remember any particular references.

    Even with a budget, the key here is that you’ve got lots of inputs and outputs, so you’re going to need a tricked out Arduino if you don’t want to be multiplexing everything everywhere. Also, for the input, why not just microswitches? It depends how much expressiveness you want fro the input. Another possibility, if you go for a beefier processor than the Arduino, is sound/pitch recognition.

    I have a little knowledge of all this, but someone like Andy / extraversion.co.uk would be best placed to judge requirements.

  2. I actually don’t think I need any expressiveness – just want on and off for each key, really, so microswitches may well work. Pitch recognition feels like a world of pain and requires loads more FFT style processing but might work.

    Simon
    on May 11th, 2011

  3. You should go talk to someone at the Hackspace!

    http://london.hackspace.org.uk/

    A post to the list, or come to pub standards tomorrow and if you don’t already know anyone who goes (unlikely?) then I will introduce you.

    Hope you are well xx

    nicky
    on May 11th, 2011

  4. Sounds like a fun project, I look forward to seeing it take shape!

    Robin
    on May 11th, 2011

  5. To produce the midi stream, how about dismantling an old casio keyboard and interfacing the existing microswitches onto external connectors which you can then run to new microswitches fitted to the piano keys – sure free cycle could come up with something suitable! Happy to help with this- my workshop and soldering skills are at your disposal!

    As for the light display, the main problem I foresee is scale- to get anything which chases out of the piano you’d need at least ten LEDs per trigger, which for 88 keys comes down to a relay matrix of 880 switches. It may be more realistic to tune the display to the desired musical piece- so don’t aim for fully chromatic all octaves etc. Alternatively incorporate a TFT screen in place of the piano music stand or against the soundboard to augment the display then run less light strings out from there?

    Other thought was to do light patterns/colours based on chord or key rather than individual notes?

    Good luck!

    M.

    Martyn
    on May 17th, 2011

  6. I’m betting you’re familiar with the work of Toshio Iwai…

    https://secure.wikimedia.org/wikipedia/en/wiki/Toshio_Iwai

    … particularly, his “Piano as Image Media” stuff?

  7. Hello there, I am about to try to do a similar thing to this – how did your experiment go?

Leave a Reply

Spam protection by WP Captcha-Free

Flicktures

My weekend ritual: eggs benedict. Always boil the eggs for about 12 seconds before cracking them into the waterPlaying with the new android lens blur ting.HeinousPhotoPhotoJames' dinnerLunchtime roofin'Bayleaf then cheese then pasta then meat then bechamel then pasta then meat then bechamel then pasta then meatThe ShiningThrowback SaturdayFriday afternoon = demos time!Ah London. Grey, colourful London.Excellent.Springtime doggit walkin'Erlend Øye at Islington Assembly HallA tiny birthday cake for an old person, on top of a bus shelter.Afternoon briefly interrupted by napping DaschundPrune and Armagnac millefeuilleKid consommé with wild garlic leavesRicotta and blood orange panzanella with mint and olives