[Mp4-tech] Creation of MPEG4 content with Objects

[Stefan A. Goor]

Please note that the links given in the below email are incorrect, they
should be:
http://delboy.ucd.ie/M4IF_Technotes/IM1-Player_error.jpg
and
http://delboy.ucd.ie/M4IF_Technotes/IM1-Player.jpg
Sorry for the mistake,
Thanks,
Stefan
-----Original Message-----
From: mp4-tech-bounces lists.mpegif.org
[mailto:mp4-tech-bounces lists.mpegif.org]On Behalf Of Stefan A. Goor
Sent: 16 September 2023 15:56
To: Mp4-Tech
Subject: [Mp4-tech] Creation of MPEG4 content with Objects
Hey All,
I have had a number of issues and questions that I would like resolve.  Most
of the problems that I am having are in relation  to creation and
manipulation of MPEG-4 content and the reference software.
At the moment I am trying to develop/examine a system that will support
video streaming composed of arbitrariily shaped video objects.  After doing
a lot of research into MPEG-4 and the standard, I understood that this
should involve the following steps:
1.	Creation of the arbitrarily shaped video objects by using an MPEG-4 codec
that supports VO object coding (core profile)
2.	Transport of these video objects in stream to the client where they are
to played out, possibly using DMIF
3.	Composition of the objects in the scene to be played out by using BIFS
and MPEG-J
4.	Playing the file / video composited in the last step by using a player
such as IM1-Player.
So, my first questions is, is my understanding of how to stream and play the
objects correct?
Next, from what I understand the MoMuSys and Microsoft MPEG-4 codec are
supposed to produce valid MPEG-4 video objects that can be arbitrarily
shaped.  After attempting to use both, I found MoMuSys to be the easiest to
use and understand so I decided to use this as my encoder.  When I use
MoMuSys encoder it produces .cmp or .bts file and I can use the decoder to
get the segmented video back in YUV format again.  Can someone tell me what
exactly is the .cmp or .bits file is?
>From what I have read it seems both the MS and MoMuSys decoders are meant
to
normative, while the encoders are informative, but in my experience neither
codec can decode files encoded by the other.  This leads me to believe that
neither tool produces a valid ISO encoded video.  If this is the case, does
this mean that any content created by these codecs will not be any use when
trying to create .mp4 files or similar?
I wanted to try and create a video scene from a number of arbitrarily shaped
video objects so I compiled the MPEG-J software as this seemed to provide
support for creating content using BIFS etc.  Once I got the software
working, I tried the samples supplied with it, and it produced .trif files.
Looking on the internet, I found that this is a trivial file format that was
initially used to store MPEG-4 files, but it has now been superseeded by the
.mp4 format.  Is this true?  If so, is there any way to get MPEG-J software
to produce these files?
Also, the documentation supplied with the reference software explained the
IM1-Player included would play .trif files, however I could not get this
piece of software to work.  I did manage to get a later version of the
IM1-player (version 4.0 alpha 2) to work but this seemed to give an error
when I tried to play the .trif files (see
http://delboy/M4IF_Technotes/IM1-Player_error.jpg for the exact error)
although the video seemed to be opened in the background (see
http://delboy/M4IF_Technotes/IM1-Player.jpg).
I wonder would anyone be able to help me create a video that is a valid
MPEG-4 format and was created by composition of a number of arbitrarily
shaped video objects (preferably created using the MoMuSys or Microsoft
codec)?
Once I can get this step done, I will focus on the task of streaming the the
video,
Many thanks for you time and attention,
Stefan
_______________________________________________
Mp4-tech mailing list
Mp4-tech lists.mpegif.org
http://lists.mpegif.org/mailman/listinfo/mp4-tech