Results 1 to 26 of 26

Thread: FLIC - a new fast lossless image compressor

  1. #1
    Member Alexander Rhatushnyak's Avatar
    Join Date
    Oct 2007
    Location
    Canada
    Posts
    232
    Thanks
    38
    Thanked 80 Times in 43 Posts

    Thumbs up FLIC - a new fast lossless image compressor

    Demo version is here:
    http://www.imagecompression.info/gralic/flic1d.zip - command-line executable for 32-bit Windows. It can handle only 24-bit color images in PPM format, with both width and height less than 8160. It always applies the algorithm designed for photographic images.

    Here's some comparison with JPEG2000 (Kakadu), BMF2 and BCIF.

    Compressed sizes:
    FLIC: 100.0% - 358268079 bytes
    BMF2: 106.9% - 383042492
    BCIF: 110.2% - 394725429
    Jpg2K: 116.0% - 415503871
    Uncompressed: 265.17% - 950008194 bytes

    Compression time:
    FLIC: 100 seconds
    BMF2: 114
    BCIF: 229
    Jpg2K: 107

    Decompression time:
    FLIC: 102 seconds
    BMF2: 80
    BCIF: 44
    Jpg2K: 90

    Tests were run on an Intel Core i7 CPU 930 (2.8 GHz) with 3 GB RAM running Windows XP.
    Data used:
    all 14 images from http://www.imagecompression.info/tes...es/rgb8bit.zip ,
    plus all 11 images from http://cdb.paradice-insight.us/corpo...verse/?C=S;O=D ,
    plus all 7 images from http://cdb.paradice-insight.us/corpo...08bit/?C=S;O=D .


    MORE UPDATES AND DISCUSSION:
    http://www.linkedin.com/groups/Image...ession-3363256

    Last edited by Alexander Rhatushnyak; 7th March 2011 at 23:44.

  2. #2
    Member
    Join Date
    Jun 2008
    Location
    G
    Posts
    372
    Thanks
    26
    Thanked 22 Times in 15 Posts
    Flic sound like Flac do you have the same intention, but for Images?
    A PNG comparision would maybe usefull too.

    But anyway the results look impressive.

  3. #3
    Member Alexander Rhatushnyak's Avatar
    Join Date
    Oct 2007
    Location
    Canada
    Posts
    232
    Thanks
    38
    Thanked 80 Times in 43 Posts
    No such intention yet.
    Some comparison with PNG and JPEG-LS is here:
    http://www.researchandtechnology.net...benchmarks.php -> Imagecompression.info image set.
    PNG is almost 25% worse than BCIF.
    14 of 32 images used in FLIC comparison are from www.imagecompression.info, and that's 470.6 of 950 Mb.
    PNG is good for artificial images but not for big photographic images.

  4. #4
    Member
    Join Date
    May 2007
    Location
    Poland
    Posts
    85
    Thanks
    8
    Thanked 3 Times in 3 Posts
    I like GRALIC compression balance more because as I see it for not-widespread compressors the main benefit is the compressed size not speed. In my small test set FLIC lost to BCIF (9.43MB to 9.12MB), being slightly smaller on photographic images and much worse (precentage-wise) on artificial images and screenshots. To make matters worse BMF2 comes at 8,64MB while being really quick. I guess the caveat would be to use FLIC only on natural photographs but that means it cannot be used universally to bmp-like images.
    On topic of lossless image compression have you considered digital RAW format(s) re-compression?
    Last edited by jethro; 20th February 2011 at 19:57.

  5. #5
    Member Alexander Rhatushnyak's Avatar
    Join Date
    Oct 2007
    Location
    Canada
    Posts
    232
    Thanks
    38
    Thanked 80 Times in 43 Posts
    An improved version is here:
    http://www.imagecompression.info/gralic/flic1d.zip
    Speed is higher, compression quality is slightly better on average.

    Compression time:
    FLIC: 93 seconds
    BMF2: 114
    BCIF: 229
    Jpg2K: 107

    Decompression time:
    FLIC: 96 seconds
    BMF2: 80
    BCIF: 44
    Jpg2K: 90

    Compressed sizes:
    FLIC: 100.0% - 357749193 bytes
    BMF2: 107.1% - 383042492
    BCIF: 110.3% - 394725429
    Jpg2K: 116.1% - 415503871
    Uncompressed: 265.55% - 950008194 bytes

    Obsolete package: http://www.imagecompression.info/gralic/flic11d.zip

  6. #6
    Member
    Join Date
    Jun 2009
    Location
    Kraków, Poland
    Posts
    1,471
    Thanks
    26
    Thanked 120 Times in 94 Posts
    Still BCIF wins by far when it comes to decompression speed

  7. #7
    Member Alexander Rhatushnyak's Avatar
    Join Date
    Oct 2007
    Location
    Canada
    Posts
    232
    Thanks
    38
    Thanked 80 Times in 43 Posts
    Quote Originally Posted by Piotr Tarsa View Post
    Still BCIF wins by far when it comes to decompression speed
    No, COPY wins if speed is so important. Also, RAR has better decompression speed, but it stops compressing at 133.1% (476213620 bytes). PNG is pretty similar, I guess.

    Quote Originally Posted by thometal View Post
    A PNG comparision would maybe usefull too.
    Which PNG implementation would you recommend? Preferably command-line, and accepting PPM as input.

    Quote Originally Posted by jethro View Post
    On topic of lossless image compression have you considered digital RAW format(s) re-compression?
    Not now, maybe later




    MORE UPDATES AND DISCUSSION:
    http://www.linkedin.com/groups/Image...ession-3363256

    Last edited by Alexander Rhatushnyak; 7th March 2011 at 23:44.

  8. #8
    Member Alexander Rhatushnyak's Avatar
    Join Date
    Oct 2007
    Location
    Canada
    Posts
    232
    Thanks
    38
    Thanked 80 Times in 43 Posts
    Quote Originally Posted by Alexander Rhatushnyak View Post
    No, COPY wins if speed is so important.
    Actually, CharLS wins, if you care not only about speed. See http://www.imagecompression.info/gralic/LPCB.html

    This newsgroup is dedicated to image compression:
    http://linkedin.com/groups/Image-Compression-3363256

  9. #9
    Member m^2's Avatar
    Join Date
    Sep 2008
    Location
    Ślůnsk, PL
    Posts
    1,612
    Thanks
    30
    Thanked 65 Times in 47 Posts
    Alex, could you try the following:

    FreeArc -mmm:3*8+grzip:m4:l
    FreeArc -mmm:3*8+1xb

  10. #10
    Member Alexander Rhatushnyak's Avatar
    Join Date
    Oct 2007
    Location
    Canada
    Posts
    232
    Thanks
    38
    Thanked 80 Times in 43 Posts
    Yes and yes. Decompressed files were bit-exact, speed will be tested later.

    This newsgroup is dedicated to image compression:
    http://linkedin.com/groups/Image-Compression-3363256

  11. #11
    Member m^2's Avatar
    Join Date
    Sep 2008
    Location
    Ślůnsk, PL
    Posts
    1,612
    Thanks
    30
    Thanked 65 Times in 47 Posts
    Thanks.

  12. #12
    Member
    Join Date
    Jun 2008
    Location
    G
    Posts
    372
    Thanks
    26
    Thanked 22 Times in 15 Posts
    could you also test packpnm and webp ?

  13. #13
    Member Alexander Rhatushnyak's Avatar
    Join Date
    Oct 2007
    Location
    Canada
    Posts
    232
    Thanks
    38
    Thanked 80 Times in 43 Posts
    PackPNM 1.0e is on the to-do list,
    WebP-lossless: compression is very slow even with "-c 0", and it crashes when there's not enough memory (i.e. on 100+ Mb files with -c 0, on 30+ Mb files with -c 10), at least the 32-bit Windows executable.

    This newsgroup is dedicated to image compression:
    http://linkedin.com/groups/Image-Compression-3363256

  14. #14
    Member Alexander Rhatushnyak's Avatar
    Join Date
    Oct 2007
    Location
    Canada
    Posts
    232
    Thanks
    38
    Thanked 80 Times in 43 Posts
    PackPNM 1.0e was added today,
    WebP-lossless -c 0 on 103 LPCB images, i.e. all but the four that are bigger than 100 Mb:

    1'220'278'081 bytes in PNG format => 1'100'509'276 in Webpll format, that's 90.18%
    Compression time: 17561 seconds (almost 5 hours)
    Decompression time: 1286 seconds (21.5 minutes)

    This newsgroup is dedicated to image compression:
    http://linkedin.com/groups/Image-Compression-3363256

  15. #15
    Member m^2's Avatar
    Join Date
    Sep 2008
    Location
    Ślůnsk, PL
    Posts
    1,612
    Thanks
    30
    Thanked 65 Times in 47 Posts
    Thanks for testing. Could you clarify how did you measure decompression time?
    I mean, did you use the switch that allows to increase number of iterations or was it just 1 iteration?

    ADDED: Do you intend to test it in stronger modes?
    ADDED: Also, what is PNG size? Is it the best out of the box implementation or something heavily optimized?
    Last edited by m^2; 21st November 2011 at 09:42.

  16. #16
    Member Alexander Rhatushnyak's Avatar
    Join Date
    Oct 2007
    Location
    Canada
    Posts
    232
    Thanks
    38
    Thanked 80 Times in 43 Posts
    Quote Originally Posted by m^2 View Post
    Thanks for testing. Could you clarify how did you measure decompression time?
    I mean, did you use the switch that allows to increase number of iterations or was it just 1 iteration?
    Normally it's three iterations for the complete set, and then I pick the smallest of three numbers, but for webp-lossless, because it's experimental and very slow, only two iterations.

    Do you intend to test it in stronger modes?
    Thirty LPCB files on which webp-lossless with -c 30 does not crash:
    38,357,519 bytes - GraLIC 1.11.demo
    38,957,996 - BMF -s -q9
    51,763,457 - webp -c 30
    51,859,030 - webp -c 10
    53,720,988 - webp -c 0
    64,611,485 - PNG
    More details here: http://www.imagecompression.info/gralic/lpcb30.rar

    ADDED: Also, what is PNG size? Is it the best out of the box implementation or something heavily optimized?
    PNG files were created with NConvert -out png *.ppm
    Last edited by Alexander Rhatushnyak; 22nd November 2011 at 18:57.

    This newsgroup is dedicated to image compression:
    http://linkedin.com/groups/Image-Compression-3363256

  17. #17
    Member m^2's Avatar
    Join Date
    Sep 2008
    Location
    Ślůnsk, PL
    Posts
    1,612
    Thanks
    30
    Thanked 65 Times in 47 Posts
    Thanks for the answers.

  18. #18
    Member
    Join Date
    Sep 2010
    Location
    US
    Posts
    126
    Thanks
    4
    Thanked 69 Times in 29 Posts
    Is there a description of the FLIC algorithm anywhere?
    Last edited by cbloom; 3rd August 2016 at 20:43.

  19. #19
    Member Alexander Rhatushnyak's Avatar
    Join Date
    Oct 2007
    Location
    Canada
    Posts
    232
    Thanks
    38
    Thanked 80 Times in 43 Posts
    Quote Originally Posted by cbloom View Post
    Is there a description of the FLIC algorithm anywhere?
    Sorry, not yet. The main principle is model mixing. http://www.linkedin.com/groups/FLIC-...256.S.42748372

    This newsgroup is dedicated to image compression:
    http://linkedin.com/groups/Image-Compression-3363256

  20. #20
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    872
    Thanks
    457
    Thanked 175 Times in 85 Posts
    I really would be happy if there was a plugin for Photoshop or XnView. What is planned for FLIC in future?
    The best that could happen form my point of view is if it would become standard in a new image format or in older such as Tiff.

  21. #21
    Member
    Join Date
    Jun 2008
    Location
    G
    Posts
    372
    Thanks
    26
    Thanked 22 Times in 15 Posts

    Thumbs up

    Quote Originally Posted by Stephan Busch View Post
    I really would be happy if there was a plugin for Photoshop or XnView. What is planned for FLIC in future?
    The best that could happen form my point of view is if it would become standard in a new image format or in older such as Tiff.
    +1

    and opensource =P)

  22. #22
    Member Alexander Rhatushnyak's Avatar
    Join Date
    Oct 2007
    Location
    Canada
    Posts
    232
    Thanks
    38
    Thanked 80 Times in 43 Posts
    > What is planned for FLIC in future?

    Nothing special for the nearest future (this year, next year) unless something unexpected happens, e.g. a bug in FLIC or GraLIC is found,
    Ocarina Compression Prize is launched...

    Quote Originally Posted by thometal View Post
    +1 and opensource =P)
    I am very sorry to disappoint you, but there will be no opensource.

    This newsgroup is dedicated to image compression:
    http://linkedin.com/groups/Image-Compression-3363256

  23. #23
    Member toi007's Avatar
    Join Date
    Jun 2011
    Location
    Lisbon
    Posts
    35
    Thanks
    0
    Thanked 0 Times in 0 Posts

    its pretty good flic

    Quote Originally Posted by Alexander Rhatushnyak View Post
    > What is planned for FLIC in future?

    Nothing special for the nearest future (this year, next year) unless something unexpected happens, e.g. a bug in FLIC or GraLIC is found,
    Ocarina Compression Prize is launched...

    I am very sorry to disappoint you, but there will be no opensource.
    very similar in size like zpaq -bmp_J4 but much faster

    I could use a version of bmp2flic eheehe for my tests

  24. #24
    Member Alexander Rhatushnyak's Avatar
    Join Date
    Oct 2007
    Location
    Canada
    Posts
    232
    Thanks
    38
    Thanked 80 Times in 43 Posts
    Actually, CharLS wins, if you care not only about speed. See http://www.imagecompression.info/gralic/LPCB.html
    CharLS is not a winner any more. QLIC works better and faster.

    This newsgroup is dedicated to image compression:
    http://linkedin.com/groups/Image-Compression-3363256

  25. #25
    Member
    Join Date
    May 2007
    Location
    Poland
    Posts
    85
    Thanks
    8
    Thanked 3 Times in 3 Posts
    Quote Originally Posted by Alexander Rhatushnyak View Post
    CharLS is not a winner any more. QLIC works better and faster.
    Awesome speed . But can we please get BMP support, it is more convenient?

  26. #26
    Member Alexander Rhatushnyak's Avatar
    Join Date
    Oct 2007
    Location
    Canada
    Posts
    232
    Thanks
    38
    Thanked 80 Times in 43 Posts
    Quote Originally Posted by jethro View Post
    can we please get BMP support, it is more convenient?
    Sorry, this is one of the features of the demo version:
    only PPM support, comments are stripped, must be 1<=height<=32768 and 4<=width<=32768, output may be bigger than input.
    Hopefully there are no bugs though, and the output image is always bit-exact.

    By the way, if I want lossy jpeg compressor faster and/or better than NConvert -out jpeg -q 100 -subsampling 2 -opthuff %1.ppm - what program/option should I try?

    This newsgroup is dedicated to image compression:
    http://linkedin.com/groups/Image-Compression-3363256

Similar Threads

  1. another (too) fast compressor
    By Cyan in forum Data Compression
    Replies: 139
    Last Post: 6th February 2016, 21:41
  2. Lossless image coders
    By Madgeniy in forum Data Compression
    Replies: 26
    Last Post: 11th July 2011, 09:06
  3. GraLIC - new lossless image compressor
    By Alexander Rhatushnyak in forum Data Compression
    Replies: 17
    Last Post: 29th November 2010, 21:27
  4. New lossless compressor for 24-bit images (3 channels, 8 bits per channel)
    By Alexander Rhatushnyak in forum Data Compression
    Replies: 28
    Last Post: 23rd September 2010, 01:43
  5. PACKET v.0.01 new fast compressor !
    By Nania Francesco in forum Data Compression
    Replies: 45
    Last Post: 19th June 2008, 01:44

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •