[Mp4-tech] [H.264] Use of SPS/PPS in H.264

[Gary Sullivan]

Response in-line below.
Best Regards,
Gary Sullivan 
+> -----Original Message-----
+> From: mp4-tech-bounces lists.mpegif.org 
+> [mailto:mp4-tech-bounces lists.mpegif.org] On Behalf Of 
+> Steinberg Erez-RM96322
+> Sent: Wednesday, June 21, 2023 2:23 AM
+> To: mp4-tech lists.mpegif.org
+> Subject: [Mp4-tech] [H.264] Use of SPS/PPS in H.264
+> 
+> Hi,
+> 
+> H.264 allows up to 32 sequence parameter sets (SPS) and 256 picture
+> parameter sets (PPS) in a stream.
This is not exactly true.  Those are not limits on the number of SPSs
and PPSs that are allowed in a bitstream.  Those are limits on the
number of SPSs and PPSs that a decoder must be capable of storing at the
same time.
There are no limits on the number of SPSs and PPSs allowed in a
bitstream.
+> 
+> An SPS includes information on the picture resolution, number of
+> reference frame, profile and level. These are cardinal for decoder
+> initialization and setup.
+> 
+> My questions:
+> 
+> (1) Is a decoder expected to handle spontaneous changes in these
+> parameters? I.e., if an IDR picture is received with a different
+> PPS/SPS, is it supposed to reallocate all its memory 
+> buffers? (This is
+> effectively resetting the decoder)
Yes.  There are some special exceptions made about how a decoder may
behave when that happens, but it can happen.
+> 
+> (2) For practical implementations -- are there any known applications
+> that use different SPSs in the same stream? Or, can a decoder assume
+> only one SPS?
Yes there are practical applications.  A decoder cannot assume only one
SPS will be in a bitstream.  Also, even if only one SPS index is used in
a bitstream, the SPS content associated with that index can change.
+> 
+> 
+> Thanks for your help!
+> 
+> Regards,
+> Erez
+> 
+> _______________________________________________
+> NOTE: Please use clear subject lines for your posts. Include 
+> [audio, [video], [systems], [general] or another 
+> apppropriate identifier to indicate the type of question you have.
+> 
+> Note: Conduct on the mailing list is subject to the 
+> Antitrust guidelines found at 
+> http://www.mpegif.org/public/documents/vault/mp-out-30042-Ant
+> itrust.php
+>