Interaction controller

From Buzztard

Live interaction with sound generators and effects is one very important goal for the future. We like to allow configuring all sort of HID devices to be used as controller.

1 Control Sources
2 Abstraction
3 User Interface
4 Control targets

[edit] Control Sources

[edit] Open Sound Control

Open Sound Control is a communication protocol for network connected controllers. On idea is to use a Nokia 770, N800, N810 as a remote control. There is lightweight osc implementation available which we could use. There are also efforts to make OSC devices discoverable and introspectable using zeroconv.

We could just assign OSC path to all parameters. The one can design a control applications (or use e.g. khagan to build one) that provides a ui to change them remotely.

[edit] Determining HID Devices

Under linux we can probably use HAL to find out about mice/keyboard/touchpad/joystick/midi-devices/lirc.

Tip - use hal-device-manager to explore :

midi:
- linux.sysfx_path=/sys/class/sound/midi*
- resmgr.class=sound

[edit] ALSA Sequencer client

http://www.alsa-project.org/~tiwai/alsa-subs.html

[edit] Getting events

GSource for alsa sequencer
reading from input devices part 1, part 2
joystick setup

[edit] Abstraction

What about having a src/lib/libbtic (buzztard interaction controller) It could provide:

ICRegistry - manages a list of ICDevices
- get list of names
- create ICDevice by name
ICDevices - provides several ICController
- get list of controller names and types (button, switch, range)
- create ICController by name
ICController - provides the actual control
- provide a value-changed signal

[edit] User Interface

We need a list of found devices/controllers. Once a device is selected one sees some info and can choose to use it or not. Next we preset a list of named controllers for the selected device. Some deviced will have fixed/know controllers. For others maybe we can ship some controller maps. For not-yet-known devices we need a learn function, where the user tweak the controls and then enter a name for the detected controller.

If we use a controller app on N800 we have the problem that the appliation needs to export the interfaces and the controller device will find the control targets. For the other controller we would use e.g. HAL to detect a list of available controllers.

Maybe we need to have always available controllers and then its up to the user to actived the controller and select the target.

There are also different strategies regarding Midi Controller Assignment.

[edit] Control targets

There are two kind of controll sources and targets: triggers and continous parameters. Trigger sources are e.g. push buttons and can be used to play notes and trigger percussion.

[edit] Song Transport

See playback controller for this.

play, stop, pause, record
navigation (timeline label as playlist).

This is a bit like media-player iface in upnp. From the controller (e.g. N800) we like to select the controll-target (which application: e.g. buzztard, rythmbox, ...).