Control by

* Google Chrome is recommended.

Please read the QR code on your smartphone




Dentsu Hand Bell Christmas

  • DEC. 2015
  • openFrameworks



Sounds person-by-person into one melody

In the 2015 Christmas season Dentsu Hand Bell Christmas was exhibited at the Dentsu 1F entrance from December 21st.

At a special booth a recorded hand bell musical performance was woven together, and two Christmas songs, “Silent Night” and “White Christmas” were played in the entrance.

Within the booth hand bells, a microphone for recording, camera, and digital signage for operation was established. Following the directions of the operator and playing a sound from the designated hand bell, a melody is played on the setup LED monitor, which includes a shot of the person taken a few seconds prior.

Challenges and future possibilities.

The recording uses FFmpeg, and video data is sent through a PC for displaying images within a LAN via FTP, and a single melody is composed with randomly selected musical notes from a previously shot video archive.

As it is necessary to process a large number of videos on the system in real time, this was a big challenge.
The number of notes used for one melody was around 60. The rectangular shots taken within the booth were displayed in the shape of notes through Alpha Masking. This large amount of video processing became a bottleneck, and there were occasions in which the melody was delayed.

The melody was constructed with MIDI data and note videos, and this time was made into two songs, however it is possible through usage of note videos to perform a melody with just the quantity of MIDI data.

This was established at the entrance of the office, and it was very difficult to adjust the volume of the recording due to things such as environmental noise. Due to the interference of environmental noise it was difficult to detect the bell sounds, and as a result the bell sound chimed in a way which didn’t match the MIDI data, so an emergency was staved off through editing of part of the recorded data, and it was seen that a further improved plan would be required.

However, through raising the accuracy of the hardware and the program, this could be seen as a project which showed the possibility of being able to be implemented anywhere without needing to select a situation.