[Mp4-tech] question ME algorithm

[Wang Hui]

Dear sirs:
Thank you for your very detail and good advices.
In the experiments, certainly I have considerd about the impact of the bit rate. but I did not do enough expriments for different bit rate. The algorithms I concerned are at the low bit rate, i.e. under wireless environment. The complex algorithm is not suitable to my implement.
At the beginning, I mainly focus on the search algorithms, the novel ideas of different ME search methods are very attractive. But in fact, in the final implementation, the search method is minor, more important ones are memory organization, the partition between software and hardware, etc. The search method is just a tradeoff among these limitations.
Thank you for render me the help, you both present me with very good sugestions,and I shall do accordingly, thank you very much.
best regards
Yours sincerely
Michael
----- Original Message ----- 
From: "Tourapis Alexandros" <alexandros.tourapis thomson.net>
To: "Wang Hui" <wangh china.com>; "Allen H.-Y. Chin" <hychin swallow.ee.nctu.edu.tw>
Cc: "MP4-Tech" <MP4-Tech lists.mpegif.org>
Sent: Wednesday, December 10, 2023 12:26 AM
Subject: RE: [Mp4-tech] question ME algorithm
Dear Michael,
The main reason why this is happening is because your implementation does not consider any Rate Distortion Optimization techniques during the motion estimation phase. It is well known that a joint consideration of not only the distortion (SAD or MSE) but also the bits required to code the motion vectors (and if possible the bits required to code the residual although this is much harder to do within motion estimation and is mainly done in some implementations only for mode decision) can considerably improve your performance. In addition this consideration helps FS and other algorithms in achieving a more reliable and smooth motion field leading to better results. If you do not use this concept then FS can find the minimum at very odd positions and the penalty for coding motion vectors could end up being too high. Other algorithms that are more center biased could in such cases lead to better results than FS, but of course these algorithms would fail if you use high motion sequences and high bitrates (you never mentioned btw your bitrate and it is also true that this effect would be stronger at very low bitrates). There are of course new more advanced algorithms that can perform similar to FS no matter what (you may check the paper I mentioned or newer papers on the same topic).  I would recommend you though to read the following paper :
G. Sullivan and T. Wiegand, "Rate-distortion optimization for video compression," IEEE Signal Processing Magazine, vol. 15, no. 6, November 1998, pp. 74-90.
About the SAD instead of the MSE, although this could of course imply a difference in PSNR, its impact is more subtle compared to the above reason (no consideration of mv correlation). 
In any case my suggestion is, if you cannot implement any RD criteria in your encoder, also try different sequences (my recommendations is to use stefan, foreman, bus, kayak, coastguard etc from the mpeg sequences instead of low activity ones), different frame rates (do not always stick with 30 fps (if you are) but also try lower frame rates, and different (higher) bitrates. Just for reference, FSS and 2D-Log are in general very poor algorithms especially under such conditions.
Alexis
_______________________________________________
Mp4-tech mailing list
Mp4-tech lists.mpegif.org
http://lists.mpegif.org/mailman/listinfo/mp4-tech
Note: Conduct on the mailing list is subject to the Antitrust guidelines found at http://www.mpegif.org/public/documents/vault/mp-out-30042-Antitrust.php