[M4IF Technotes] Re: Codec testing methodology

[Rob Koenen]

The same applies to Video. Using info obtained from the chair 
of the Video Group:
  Yes, there are conformance bitstreams for video too.
  ftp://ftp.tnt.uni-hannover.de/pub/MPEG/video/conformance
  has the MPEG-4 confrmance bitstreams. 
  The spirit for pass/fail criteria is essentially the same 
  as for audio.
  I think the only distinction is that IDCT allows some
  rounding error tolerance.  But that tolerance is well specified.
Rob
> -----Original Message-----
> From: Ralph Sperschneider [mailto:sps   iis.fhg.de]
> Sent: Thursday, January 17, 2024 11:26
> To: the_ether
> Cc: technotes   lists.m4if.org
> Subject: [M4IF Technotes] Re: Codec testing methodology
> 
> 
> Dear Garham, all,
> 
> I cannot tell you the details for video, but for audio there 
> are a bunch of sequences of compressed audio coming along 
> with reference waveforms. For most of these sequences there 
> is a test procedure described that compares the output of 
> your decoder with the reference waveform. You may call your 
> decoder conform with MPEG-4 only, if the decoder passes the 
> appropriate tests. Details can be found in the conformance 
> part of the standard (ISO/IEC 14496-4:2000, Amd1 seems not 
> yet been published).
> 
> Best regards,
> 
> Ralph
> 
> 
> the_ether wrote:
> > 
> > Hi
> > 
> > Is there any standard testing regime for MPEG-4 codec? I am 
> aware of the
> > video files used for conformance testing but I was 
> wondering whether there
> > were any other guidelines such as for the intermediary 
> steps such as ME or
> > comparisons of signal to noise ratios for a given input 
> image and a given
> > target bit rate?
> > 
> > As far as I know there are only conformance tests and 
> subjective tests of
> > the quality of the end, decompressed images.
> > 
> > Regards
> > 
> > garham
> > 
> > _______________________________________________
> > Technotes mailing list
> > Technotes   lists.m4if.org
> > http://lists.m4if.org/mailman/listinfo/technotes
> 
> -- 
> Dipl.-Ing. Ralph Sperschneider  | Phone: +49 9131 776 344
> FhG IIS-A                       | Fax:   +49 9131 776 398
> Am Weichselgarten 3             | mailto:sps   iis.fhg.de 
> D 91058 Erlangen                | http://www.iis.fhg.de/amm/
>