Results 1 to 27 of 27

Thread: New butteraugli version

  1. #1
    Member
    Join Date
    Jun 2015
    Location
    Switzerland
    Posts
    667
    Thanks
    204
    Thanked 241 Times in 146 Posts

    New butteraugli version

    Substantially improved butteraugli version available at https://github.com/google/butteraugli/

  2. The Following 4 Users Say Thank You to Jyrki Alakuijala For This Useful Post:

    Bilawal (18th October 2016),load (20th October 2016),lorents17 (18th October 2016),SolidComp (18th October 2016)

  3. #2
    Member
    Join Date
    Apr 2011
    Location
    Russia
    Posts
    168
    Thanks
    163
    Thanked 9 Times in 8 Posts
    Please, compile butteraugli under Windows. Thanks!

  4. #3
    Member
    Join Date
    Jul 2014
    Location
    Mars
    Posts
    164
    Thanks
    115
    Thanked 10 Times in 9 Posts
    +1

  5. #4
    Member
    Join Date
    Apr 2009
    Location
    here
    Posts
    202
    Thanks
    165
    Thanked 109 Times in 65 Posts
    no idea if it works... don't know what it is supposed to do.

    hm... tells me always about invalid or malformed input files.

    /edit: removed.
    Last edited by load; 18th October 2016 at 09:11.

  6. The Following User Says Thank You to load For This Useful Post:

    Jyrki Alakuijala (23rd October 2016)

  7. #5
    Member
    Join Date
    Mar 2016
    Location
    USA
    Posts
    47
    Thanks
    5
    Thanked 22 Times in 14 Posts
    @Jyrki, does this metric obviate the need to convert to Y'CbCr 4:2:0 as in the following benchmark since it already takes into account color perception? https://web.archive.org/web/20160604...udy_july_2014/ https://github.com/bdaehlie/lossy-compression-test

  8. #6
    Member
    Join Date
    Jun 2015
    Location
    Switzerland
    Posts
    667
    Thanks
    204
    Thanked 241 Times in 146 Posts
    Quote Originally Posted by MegaByte View Post
    @Jyrki, does this metric obviate the need to convert to Y'CbCr 4:2:0 as in the following benchmark since it already takes into account color perception? https://web.archive.org/web/20160604...udy_july_2014/ https://github.com/bdaehlie/lossy-compression-test
    Yes, butteraugli does not benefit from nor need Y'CbCr 4:2:0. YUV 420 is typically a harmful representation according to butteraugli. YUV 420 modeling introduces artefacts that are visually clearly detectable, and butteraugli is sensitive to these artefacts. It is easy to create a YUV444 images that passes the butteraugli tests, and often impossible to do the same in YUV 420.

    Butteraugli does not use any of the previously known colorspaces, but introduces its own XYB color space. It is relatively complicated, and I never tried to describe it in a single sentence yet. Gamma correction happens together with imperfect color filtering and eye jitter modeling in a complex and non-linear fashion, and the non-existence of the blue receptors in fovea is taken into account. XYB refers to a space where:

    X = reddish yellow - greenish yellow
    Y = greenish yellow
    B = blue

    I will soon write something that is more complete than this email and easier to read than the code.

  9. #7
    Member
    Join Date
    Jun 2015
    Location
    Switzerland
    Posts
    667
    Thanks
    204
    Thanked 241 Times in 146 Posts
    Quote Originally Posted by load View Post
    hm... tells me always about invalid or malformed input files.
    Which operating system are you using? Were you able to use any of your files?

  10. #8
    Member
    Join Date
    Apr 2009
    Location
    here
    Posts
    202
    Thanks
    165
    Thanked 109 Times in 65 Posts
    i'm using windows 7. and no, no matter what files i try, none work.

    if i use PNG, i get the following error:
    libpng error: Read Error
    File test.png is neither a valid JPEG nor a valid PNG.
    for JPG, another one:
    Premature end of JPEG file
    JPEG datastream contains no image
    File test.jpg is a malformed JPEG.
    i used mingw to compile it, without any errors.
    $ make
    x86_64-w64-mingw32-g++ -std=c++11 -I. -c -o butteraugli.o butteraugli.cc
    x86_64-w64-mingw32-g++ -std=c++11 -I. -c -o butteraugli_main.o butteraugli_main.cc
    x86_64-w64-mingw32-g++ -std=c++11 -I. butteraugli.o butteraugli_main.o -lpng -ljpeg -lz -o butteraugli
    libs are up to date, libpng-1.6.25 and libjpeg-turbo-1.5.1

  11. The Following User Says Thank You to load For This Useful Post:

    Jyrki Alakuijala (23rd October 2016)

  12. #9
    Member
    Join Date
    Jun 2015
    Location
    Switzerland
    Posts
    667
    Thanks
    204
    Thanked 241 Times in 146 Posts
    Quote Originally Posted by load View Post
    i'm using windows 7. and no, no matter what files i try, none work.
    It is because Windows open files in a strange text mode by default. Please, try if it works after changing fopen in butteraugli_main.cc from "r" to "rb". I'll fix it tomorrow in the repository.

  13. The Following User Says Thank You to Jyrki Alakuijala For This Useful Post:

    load (20th October 2016)

  14. #10
    Member
    Join Date
    Apr 2009
    Location
    here
    Posts
    202
    Thanks
    165
    Thanked 109 Times in 65 Posts
    ah, that did the trick. thanks a lot.

  15. The Following User Says Thank You to load For This Useful Post:

    Jyrki Alakuijala (23rd October 2016)

  16. #11
    Member
    Join Date
    Jun 2015
    Location
    Switzerland
    Posts
    667
    Thanks
    204
    Thanked 241 Times in 146 Posts
    Now I have fixed it in github.com/google/butteraugli/ (Windows file I/O compatibility).

  17. #12
    Member
    Join Date
    Dec 2014
    Location
    Berlin
    Posts
    29
    Thanks
    35
    Thanked 26 Times in 12 Posts
    Is this also useful for the development of AV1 or not does the advantage not really apply there?

  18. #13
    Member
    Join Date
    Jun 2015
    Location
    Switzerland
    Posts
    667
    Thanks
    204
    Thanked 241 Times in 146 Posts
    Quote Originally Posted by pothos2 View Post
    Is this also useful for the development of AV1 or not does the advantage not really apply there?
    It is an interesting question.

    I think many butteraugli concepts could be used in all image and video codecs, but difficult to say if it is always worth the additional calculation and complexity. Butteraugli hasn't been validated with many eyes, and we are still actively changing it, including fundamentals like the integral transform, visual masking and separation of frequencies.

    If you get some results with butteraugli/guetzli please share the experiences. User experiences could matter when the av1 engineers decide where to put their time.

  19. #14
    Member
    Join Date
    Jun 2015
    Location
    Switzerland
    Posts
    667
    Thanks
    204
    Thanked 241 Times in 146 Posts
    Again, a new more accurate version. Similarities with the previous version: LMS color space with the gamma correction done in LMS, and many parts of visual masking are similar to the previous version. What is different: the FFT has been abandoned and a Difference-of-Gaussians scale space with ridge and edge detectors replaces it.

    It is slightly worse on detecting metablock boundary artefacts being introduced than the previous version. This is likely coming from the symmetry requirement that we have imposed on butteraugli: butteraugli(image1, image2) == butteraugli(image2, image1), so a tiny sharp edge disappearing gets the same penalty as a tiny sharp edge emerging, even when the latter is quite a lot more annoying.

    In our tests butteraugli (including the new version) is the only method (of psnr, psnrhvs-m, ssim, ssimulacra) in addition to humans that can detect that guetzli is actually better than libjpeg.

    New version is available at: http://github.com/google/butteraugli/

  20. The Following 3 Users Say Thank You to Jyrki Alakuijala For This Useful Post:

    khavish (19th August 2017),load (14th August 2017),pothos2 (15th August 2017)

  21. #15
    Member
    Join Date
    Jun 2015
    Location
    Switzerland
    Posts
    667
    Thanks
    204
    Thanked 241 Times in 146 Posts
    Again, a new butteraugli version is available at: http://github.com/google/butteraugli/

    We plan to release new versions of guetzli and PIK soon -- to match this version of butteraugli.

    On the coming new guetzli: we found a few tricks to get better results at guetzli at lower qualities (particularly less block artefacts on slow gradients), but still not sure if it is useful and competitive at lower qualities. The hard limit of quality 84 is still there. Bad news that it is twice as slow as the previous version of guetzli. Probably previous version is a better fit for practical use and this a better fit for extreme use and research. With new guetzli, at 1.0 butteraugli score I get 7 % less bytes, some artefacts are gone, but the images tend to look just slightly more blurry (it's subtle, you will probably not notice it).

  22. The Following User Says Thank You to Jyrki Alakuijala For This Useful Post:

    SerGen (29th August 2017)

  23. #16
    Member
    Join Date
    Aug 2017
    Location
    Russia
    Posts
    6
    Thanks
    6
    Thanked 3 Times in 3 Posts
    Most of the time I found that results of old version of butteraugli are reliable.
    On last weekends I have some fun with av1, compared it with guetzli and got unexpected result.

    Some preparations.

    > identify -format '%Q' input.jpg
    99
    Note small difference between guetzli and av1.

    > butteraugli input.jpg guetzli-q92.jpg
    1.651097
    > butteraugli input.jpg av1-ec50d6b-cq5.png
    1.602598
    Latest version performs much better and in accordance with my eyes :)

    > butteraugli input.jpg guetzli-q92.jpg
    1.995533
    > butteraugli input.jpg av1-ec50d6b-cq5.png
    1.376524
    Attached Files Attached Files

  24. The Following User Says Thank You to SerGen For This Useful Post:

    Jyrki Alakuijala (31st August 2017)

  25. #17
    Member
    Join Date
    Jun 2015
    Location
    Switzerland
    Posts
    667
    Thanks
    204
    Thanked 241 Times in 146 Posts
    Heatmap with the latest butteraugli between av1 and input:
    Click image for larger version. 

Name:	av1-input-heatmap.jpg 
Views:	63 
Size:	100.0 KB 
ID:	5179

  26. #18
    Member
    Join Date
    Jun 2015
    Location
    Switzerland
    Posts
    667
    Thanks
    204
    Thanked 241 Times in 146 Posts
    original guetzli

    Click image for larger version. 

Name:	guetzli-q92.jpg 
Views:	103 
Size:	56.6 KB 
ID:	5180

    latest guetzli (will appear on github this week)

    Click image for larger version. 

Name:	input-q92-g2.jpg 
Views:	106 
Size:	53.0 KB 
ID:	5181

    and pik at butteraugli score 1.0 (about quality 95 on jpeg scale, 44797 bytes, here as much larger png):

    Click image for larger version. 

Name:	pik-1.0.png 
Views:	98 
Size:	268.4 KB 
ID:	5182
    Last edited by Jyrki Alakuijala; 29th August 2017 at 21:29.

  27. The Following User Says Thank You to Jyrki Alakuijala For This Useful Post:

    SerGen (30th August 2017)

  28. #19
    Member
    Join Date
    Aug 2017
    Location
    Russia
    Posts
    6
    Thanks
    6
    Thanked 3 Times in 3 Posts
    AV1: 96251 B, 1.376524 BA
    Click image for larger version. 

Name:	map-av1.png 
Views:	51 
Size:	272.2 KB 
ID:	5184

    Guetzli current: 57936 B, 1.995533 BA
    Click image for larger version. 

Name:	map-guetzli-current.png 
Views:	53 
Size:	339.0 KB 
ID:	5185

    Guetzli latest: 54303 B, 1.294250 BA
    Click image for larger version. 

Name:	map-guetzli-latest.png 
Views:	58 
Size:	338.1 KB 
ID:	5186

    PIK: 44797 B, 0.958885 BA
    Click image for larger version. 

Name:	map-pik.png 
Views:	69 
Size:	334.3 KB 
ID:	5187

    Guetzli: distribution of errors more flat now, color errors of current version will gone in new, great!
    PIK is really impressive!

    One thing is bother me.
    I can see artefacts on red button on the right of PIK result.
    And can't say that color change of AV1 on chalkboard is worse than PIK artefacts on the button. For me they are at least the same.

  29. The Following User Says Thank You to SerGen For This Useful Post:

    Jyrki Alakuijala (31st August 2017)

  30. #20
    Member
    Join Date
    Jun 2015
    Location
    Switzerland
    Posts
    667
    Thanks
    204
    Thanked 241 Times in 146 Posts
    Quote Originally Posted by SerGen View Post
    Guetzli: distribution of errors more flat now, color errors of current version will gone in new, great!
    Good to hear!

    Quote Originally Posted by SerGen View Post
    PIK is really impressive!
    Thanks!! We are working hard on it...

    Quote Originally Posted by SerGen View Post
    One thing is bother me.
    I can see artefacts on red button on the right of PIK result.
    And can't say that color change of AV1 on chalkboard is worse than PIK artefacts on the button. For me they are at least the same.
    Do you mean the DCT artefacts from the white "kupit" text projected on the surrounding red pixels?

  31. #21
    Member
    Join Date
    Aug 2017
    Location
    Russia
    Posts
    6
    Thanks
    6
    Thanked 3 Times in 3 Posts
    I mean long horizontal line surrounded by lighter pixels on the bottom of button (ringing?).
    DCT artefacts around text are less noticeable for me.

    Just for illustration, button on 4x

    Click image for larger version. 

Name:	pik-btn.png 
Views:	73 
Size:	12.5 KB 
ID:	5191

  32. The Following User Says Thank You to SerGen For This Useful Post:

    Jyrki Alakuijala (31st August 2017)

  33. #22
    Member
    Join Date
    Jun 2015
    Location
    Switzerland
    Posts
    667
    Thanks
    204
    Thanked 241 Times in 146 Posts
    Quote Originally Posted by SerGen View Post
    I mean long horizontal line surrounded by lighter pixels on the bottom of button (ringing?).
    DCT artefacts around text are less noticeable for me.

    Just for illustration, button on 4x

    Click image for larger version. 

Name:	pik-btn.png 
Views:	73 
Size:	12.5 KB 
ID:	5191
    Cool! I didn't even notice it before you showed it. I'll try to improve on it in the next butteraugli version.

  34. The Following User Says Thank You to Jyrki Alakuijala For This Useful Post:

    SerGen (30th August 2017)

  35. #23
    Member
    Join Date
    Mar 2010
    Location
    Germany
    Posts
    116
    Thanks
    18
    Thanked 32 Times in 11 Posts
    Can anyone please provide Windows binaries, from the latest butteraugli version?
    Thanks in advance.

  36. #24
    Member
    Join Date
    Aug 2017
    Location
    Russia
    Posts
    6
    Thanks
    6
    Thanked 3 Times in 3 Posts
    I have try mingw to build, but have no luck.
    Already answered in the Download area: https://encode.ru/threads/2499-butte...ll=1#post54019

    Maybe someone more skilled in building can help us.

  37. #25
    Member
    Join Date
    Aug 2017
    Location
    Barcelona
    Posts
    3
    Thanks
    1
    Thanked 0 Times in 0 Posts
    Quote Originally Posted by Biozynotiker View Post
    Can anyone please provide Windows binaries, from the latest butteraugli version?
    Thanks in advance.
    +1

  38. #26
    Member
    Join Date
    Aug 2017
    Location
    Russia
    Posts
    6
    Thanks
    6
    Thanked 3 Times in 3 Posts
    I have find interesting image, other metrics are rate it noticeable different.
    First one was compressed by mozjpeg, second — guetzli.

    butteraugli
    2.897616 src_part.mj.png
    1.644465 src_part.g.png

    dssim
    0.00242834 src_part.mj.png
    0.00262183 src_part.g.png

    ssimulacra
    0.02160381 src_part.mj.png
    0.02244841 src_part.g.png
    Why butteraugli rates an image like this? Because of blur detection?
    Attached Images Attached Images      

  39. #27
    Member
    Join Date
    Jun 2015
    Location
    Switzerland
    Posts
    667
    Thanks
    204
    Thanked 241 Times in 146 Posts
    Quote Originally Posted by SerGen View Post
    Why butteraugli rates an image like this?
    Thank you for asking. Ringing noise around the letters seems to be the most visible artefact on these two images. I will take a deeper look next week into these images.

Similar Threads

  1. butteraugli
    By lorents17 in forum Download Area
    Replies: 9
    Last Post: 23rd February 2019, 13:59
  2. Offline version of forum
    By FatBit in forum The Off-Topic Lounge
    Replies: 16
    Last Post: 19th June 2014, 18:37
  3. Old Version of CCM
    By comp1 in forum Download Area
    Replies: 2
    Last Post: 13th April 2014, 18:13
  4. Old version of RAR
    By d33j4y in forum Data Compression
    Replies: 7
    Last Post: 17th August 2010, 13:52
  5. New lpaq1 version
    By Matt Mahoney in forum Forum Archive
    Replies: 21
    Last Post: 29th October 2007, 00:35

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •