Module Task 4 – Project Proposal

MD5357 Audio Interaction and Code, Semester 1, Year 2

1.The Proposed Project: My plan is to develop a series of sensors which act as triggers in an escape room environment. I will be using real world experience for this and basing it off one of the escape rooms which is offered at an escape room I work in myself called Hacked. I want these sensors to be used to trigger both light, sound and pressure and react in different ways depending on how they need to be triggered. This means puzzles which are currently being triggered manually can be done so automatically.

The Rationale: My idea is aimed at escape rooms and immersive attractions who want to add sensors and switches in their attractions to make their room more immersive and technological with a lesser budget than larger attractions. This would add a bit more character to their attraction at a smaller cost. The sensors I will be looking at using include light sensors, sound sensors, capacitive touch and motion sensors.

4. The Risks:
Risk 1 – Ensure all sensors work with Teensy and that they will work and trigger in the way they are supposed to.
Risk 2 – Some sensors may work differently in various situations. I am working with a room I know personally called Hacked. I need to be sure that the sensors will work for that room.
Risk 3 – Some sensors won’t work in this environment so I need to ensure the sensors I choose will be compatible, such as pressure pads and light sensors.
Risk 4 – This set up may behave differently in the actual environment or when encased so I will need to be mindful of any issues that may rise in the future.
Risk 5 – I am aiming to keep this to a low budget so need to make sure that I do

The value of my project on completion will allow me to offer this service to escape rooms in the future and allow me to put this in to play at my current place of work which is also an escape room. It would be amazing to offer smaller companies the ability to trigger sensors to release certain aspects such as light and sound in the work place on a lower budget.

5. The Legacy: The value of my project on completion will allow me to offer this service to escape rooms in the future and allow me to put this in to play at my current place of work which is also an escape room. It would be amazing to offer smaller companies the ability to trigger sensors to release certain aspects such as light and sound in the work place on a lower budget. To make an escape room with automated puzzles with sensors and triggers would range from roughly £3000 up including all software and hardware, with the way I am hoping to achieve this would bring the price down to around £100 for materials.

Interactive – Buttons in Immersive Attractions

MD5357 Audio Interaction and Code, Semester 1, Year 2

There are thousands of interactive attractions worldwide whether it be from haunted houses to escape rooms to attractions in the middle of nowhere that become well known. Despite however many attractions you’ve been to you’ll always be able to find a different and completely unique experience elsewhere.

I’m going to start by looking at an attraction called Forbidden Corner in North Yorkshire. This attraction is full of old buildings and different types of areas you can interactive, some family friendly and some not so family friendly scarier aspects. This attraction allows you to interact with different rooms and different items throughout the whole place and it’s definitely one of a kind.

A similar attraction to this in America is an attraction called Meow Wolf: House of Eternal Return, whilst there is a story to follow through this house, it is a mind bending experience and almost everything is interactive, fridges that open and lead to other rooms, sand, a retro arcade. You’re able to interact with mostly everything in this attraction.

On the other end of the scale, every Halloween both Hollywood and Orlando put on some of the world’s biggest haunted houses with houses including both IP and original alike you’ll never be bored. One of their more recent houses Killer Klowns from outer space focused on putting interactive buttons in the maze which allows you to them and make animatronics and sounds pop out. This has been done across other houses however this was unique as it was in such a colourful and vibrant way.

There are many ways you can engage with immersive attractions and there are definitely thousands which I have not covered here. But There’s always a love of interaction in attractions and something about wanting to push something you’re not supposed to.

Module task 3 – Max controller

MD5357 Audio Interaction and Code, Semester 1, Year 2

For module task 3 we were tasked with making a controller that works in Max. To document this, I set up a sinewave with adjustable parameters in order to amend the sign wave with both the LDR and the Potentiometer so when each were activated the changed the reaction of the sinewave. If I were turning this in to a project, I would use a couple of other sensors and set up audio files to be triggered when activating specific sensors on the Teensy.

Laravel Music Library

MD5357 Audio Interaction and Code, Semester 1, Year 2

Laravel is an open source web framework built in the PHP scripting language which allows for standardised and rapid development of web applications and systems. Due to its open source nature and the use of the PHP language that it is built on, it is able to be used to build projects of a wide range of use cases.

One such is the Laravel music library which allows you to store personal music collections online and manipulate information specific to the user, for example uploading music files, creating playlists and retrieving various details about the stored music files, such as artist and track information.

The Laravel music library could be considered the equivalent of a private Spotify, where you are able to control your own music collection as opposed to this being done for you. A similar system to this one is Plex, which is a private streaming server which allows you to consume various forms of media, such as music, TV shows and Films, all of which are held in your own hardware.

The benefit to using a system such as the Laravel music library over a service such as Spotify is that because you control the data, your privacy and personal information is shielded from third parties such as advertising and marketing corporations which may use your media preferences in targeted ad campaigns.

Another benefit to this is that you do not have to pay a subscription fee as you control the service.


MD5357 Audio Interaction and Code, Semester 1, Year 2

Rocksmith is a game for multiple platforms developed originally in 2011 by Ubisoft before being remastered in 2014. Rocksmith matches gameplay to Guitar Hero in the sense you have notes that appear on screen and you have to hit them in real time, the main difference with this game is that it requires you to use either a real guitar or bass and plug in to your platform with a Real Tone cable which is a s USB cable attached to a standard ​1⁄4 in (6.35 mm) output jack. While playing the game your level will increase and decrease automatically depending on how you’re doing on each individual song with each instrument.

 As with a lot of software and games that are released there is optional DLC you can purchase an add on, these packs include artist specific packs as well as packs based on year or even variety packs.

Due to the availability of being able to download DLC people then realised you must be able to mod Rocksmith and add your own custom songs in and people began to do so as well as starting to play via audio interfaces in order to record tracks.

Rocksmith is a unique game that allowed people to play real life instruments in a game style and it’s done extremely well in the past years and continues to release new updates and DLC regularly. I own it and it definitely made me a more confident guitarist whilst making it fun.

Module Task 2 – MIDI Controller

MD5357 Audio Interaction and Code, Semester 1, Year 2

For Module task 2 we had to create a MIDI controller that works with Ableton and functions as a useable controller. In order to achieve this, I completed the wiring up of the Teensy correctly and downloaded the Arduino patch on to the Teensy after checking all of the information was correct. From here I loaded up Ableton and changed the parameters so the controller was ready to be used. I then added a sound sample and some effects to adjust the sound of the sample as well as mapping the controller selections such as the potentiometer and the LDR to the correct regions on the software. The controller works straight away and made adjustments to the sample I was using. If I were to use another sensor with this, I would use a motion sensor to move over and adjust a different section of the effects in order to make it easier to control without needing to move too much.

Raspberry Pi and Arduino Sound and Light Sensors

MD5357 Audio Interaction and Code, Semester 1, Year 2

There’s are multiple types of sensors that work with both Arduino and Raspberry Pi from PIR motion sensors, sound sensors to light and proximity sensors. These have multiple uses and have been used on a majority of different projects from creating automation in haunted houses to creating full-on automated light shows at Christmas such as the video below.

Arduino controlled Christmas light show

The creator behind this Christmas lightshow uploaded a blog post and explained how he created this step by step and even uploaded the Arduino lightshow code in order to copy this in to your own session.

Whilst this project was created by programming MIDI music on to an Arduino and pushing this through relay boards there are other projects sensors can be used for, another example of this is for sound triggered and motion sensors.

Seeed are a company who offer a selection of different sensors which word in conjunction with Arduino and Raspberry Pi, In the following video there has been lights created to run off of both motion and sound/loudness.

Seeed motion sensor and loudness sensor control

Within this video, the set-up has been designed to run in two ways one is by setting of the PIR sensor which adjusts the brightness of the lights whenever a motion of someone walking past is detected. The loudness sensor works by determining how loud the audio is and adjusting the lights dependent on the volume of the noise.

These have multiple uses not just when it comes to light but also adjusting sound, colours and much more. There is undoubtedly a use for these across many industries and I think you’d be surprised to see how much control you have over these sensors.

JavaScript Scribbletune

MD5357 Audio Interaction and Code, Semester 1, Year 2

Scribbletune is a free open source JavaScript node which is designed to help and construct musical ideas with JavaScript and export them as MIDI files. Scribbletune can also be used with Ableton and Max for Live.

Here is some sample code as an idea of what Scribbletune does

Scribbletune can be used to create random chords, generate riffs, breakbeats and even drum and bass riffs. It can also be used in conjunction with online software such as Johann which is a web application used for generating charts for guitars, piano and computer keyboards to practice scales and chords.

Scribbletune is demoed and presented at JavaScript meetups (and recently Electronic Music meetups) across the US and is a game changer for creating music.

Their website is here and as well as explaining its use also gives a link to GitHub where it can easily be downloaded.

Piece of Pokemon music created in Scribbletune

Mario guitar made from 10,000 lollipop sticks

MD5357 Audio Interaction and Code, Semester 1, Year 2

All over the internet you will be able to find all different kind of instruments that have been made out of everyday objects such as skateboards, crayons and even iPhones, all of these are impressive in their own right, however, one YouTube channel sticks out to me when thinking about object made instruments and that channel is Cranmer Guitars. Cranmer Guitars is ran by a Glaswegian man who builds guitars out from his workshop in Glasgow and has made some incredible pieces so far.

My favourite piece to date is the Mario guitar. The Mario guitar was a one off build and was made by 10,000 lollipop sticks and took around 800 hours to make. The entire guitar was made from the lollipop sticks from the body to the head of the guitar as oppose to just the body as usually seen on other videos.

Cranmer Guitars spent around 7 months working on the full build and documented the whole process which is a very interesting watch to see how these sticks gradually evolved in to the guitar whilst using a reference image to match the colours to the proper image.

Cranmer Guitars has a lot of different videos as well as a website where you can put in custom requests and see his other work. It’s truly remarkable some of the things which have been created and I have attached his website and videos below for you to view how amazing this truly is.

Full front view of the Mario guitar
Fret board of the Mario guitar
Headstock of the Mario guitar
Back view of the Mario guitar
Full build video filmed over several months.
Demo of the complete Mario guitar being played.