[M4IF Technotes] InputSensor

[Christian Weigel]

Cyril Concolato [mailto:Cyril.Concolato   enst.fr] wrote:
> Hi Christian,
> 
> > Did someone tried or managed it to create a scene using an 
> > InputSensor 
> > (e.g. a KeySensor or MouseSensor)?
> > Yes, we did.
> >
> > I would be interested in the Syntax (in textual description) of the 
> > ineraction > elementary stream.
> You do not need to specify the syntax of the interaction 
> stream. But you need to specify which kind of device you will 
> use in conjunction with the InputSensor node. There are 
> currently three types of devices defined in MPEG: a KeySensor 
> device, a StringSensor device and a Mouse device. Theses 
> devices produce some data that the BIFS decoder will 
> interpret and forward to the scene so that your scene 
> changes. To have some interaction with the scene, you need to 
> do two things: 
> * First specify the type of device that you will use. You do 
> it by setting the right device name in the 
> DecoderConfigDescriptor that describes the device stream. 
> * Second, specify in the scene what you want to do with the 
> device data. This is done through an InputSensor node linked 
> to that device stream. As usua, the device stream is 
> represented by an ObjectDescriptor. This latter is referenced 
> in the url field of the InputSensor node. Then the buffer of 
> the node contains as many commands as there are units of data 
> in the device data. For instance, a mouse will produce X, Y 
> and a boolean. So there are 3 units of data, hence three 
> replace commands in the InputSensor. These replace commands 
> mean: replace some value in the scene with X, replace some 
> other with Y and finally some other again with the boolean.
> 
> > Does anyone know if the envivoTV plugin is able to play such scene?
> Not that I know of. But I do know they are willing to.
> 
> > Any hints are welcome.
> Here is a BT file.

First of all thank you for the detailed information about this topic. I
quoted your complete answer because until now the CC didn't find it's
way to the Technotes list.
Unfortunately I wasn't able to create a mp4 from your bt file with the
current version of mp4tool (it doesn't know the field deviceName in the
UIConfig). Is the new version of mp4tool able to convert it? Or did I
understand something wrong and you gave this bt just as a "it should be
something like this" example?
Regards
Christian Weigel