To define synchronized actions from different motors, color LEDs, and sound producers, a dedicated editor is needed, able to show on a panel similar to an orchestra musical score the actions to be done by the different actuators. We expect to have a table where different lines correspond to actuators (like different instruments on the musical score), and on each line a set of discretized segments can be put to state when the corresponding action should start and stop, and with which intensity. The editor should save a file (a “score”) in a defined format that could be used by a an actuation control system to control a robot, an environment, or any object able to show autonomous actions. A system of this type, from which is possible to get inspiration, was used to program Sony Rolly. A basic, text-based system is used to program the Pololu Maestro multi-servo boards, which could be taken as further inspiration.

The system should run in Ubuntu Linux or via web. It is possible  to test it by uploading its output to Arduino to control simple sequences of actions.