Results 1 to 12 of 12

Thread: Data Compression Book with LZMA description [!]

  1. #1
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,954
    Thanks
    359
    Thanked 332 Times in 131 Posts
    Check out David Solomon's Data Compression The Complete Reference - Fourth Edition book which contains the LZMA description!

    datacompression.rar (~7 MB)

    Note: For evaluation purposes only. If you like this book - purchase it.

  2. #2
    Programmer Bulat Ziganshin's Avatar
    Join Date
    Mar 2007
    Location
    Uzbekistan
    Posts
    4,497
    Thanks
    733
    Thanked 659 Times in 354 Posts
    Ilya, can you please stop advertizing your program in such way?

  3. #3
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,954
    Thanks
    359
    Thanked 332 Times in 131 Posts
    Why not?

    EDIT:
    It reminds me that Malcolm Taylor sends all files in RK format. OK, actually I'll repack the book! Anyway, I'm using PIM archiver myself!

  4. #4
    Programmer Bulat Ziganshin's Avatar
    Join Date
    Mar 2007
    Location
    Uzbekistan
    Posts
    4,497
    Thanks
    733
    Thanked 659 Times in 354 Posts
    big thanks for book!

  5. #5
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Thanks Ilia!

  6. #6
    Member
    Join Date
    May 2008
    Location
    Earth
    Posts
    115
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Quote Originally Posted by Bulat Ziganshin
    Ilya, can you please stop advertizing your program in such way?
    Bulat, dont you use such method?

  7. #7
    Programmer Bulat Ziganshin's Avatar
    Join Date
    Mar 2007
    Location
    Uzbekistan
    Posts
    4,497
    Thanks
    733
    Thanked 659 Times in 354 Posts
    afair, the only case when i've published file compressed by my programs is *update* to freearc which was pretty useless without freearc already installed

    Ilya, the book says almost nothing about rar&lzma. it only contains desciption of binary tree - hope that this will help us to understand it

  8. #8
    Programmer toffer's Avatar
    Join Date
    May 2008
    Location
    Erfurt, Germany
    Posts
    587
    Thanks
    0
    Thanked 0 Times in 0 Posts
    I've bought the 3rd edition, which is a very easy to understand reference. I already knew about the 7zip describtion in the 4th edition. But the information is poor, these string search mechanisms aren't anything new. It doesn't contain information about lzma's "offset reduction by markov chains", or am i wrong here? Only the "last few references as special indices"-trick. I've only quickly overflown the chapter about lzma.
    M1, CMM and other resources - http://sites.google.com/site/toffer86/ or toffer.tk

  9. #9
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,954
    Thanks
    359
    Thanked 332 Times in 131 Posts
    Quote Originally Posted by toffer
    It doesnt contain information about lzmas "offset reduction by markov chains", or am i wrong here?
    Yep, youre wrong. Nothing special with LZMAs offset encoding. LZMA can be regarded as a extended LZX - LZARI with Optimal Parsing and some tricks. For example LZMA can encode literals with matched byte - we use the byte at the rep0 (recent offset) as a context for literal coding, if we got wrong bit (unmatched) we stop coding bits with such context, and decode/encode literal as usual.

    Quote Originally Posted by Bulat Ziganshin
    Ilya, the book says almost nothing about rar&lzma.
    Better than nothing!

  10. #10
    Programmer Bulat Ziganshin's Avatar
    Join Date
    Mar 2007
    Location
    Uzbekistan
    Posts
    4,497
    Thanks
    733
    Thanked 659 Times in 354 Posts
    author is pretty ignorant in lz77 area (compared to me ). he just included markeing info from programs. there is no any info on rar/lzma except that lzma uses rep codes (invented by Roshal) and half-described bin. trees (rebalancing algorithm isnt described). lzma!=lzari, otherwise tornado/lzpm will have the same compression ratio as lzma on binary data. he erroneously wrote that lzma uses lzrw4-like hash while actually its exactly the same as in deflate/rar

    Quote Originally Posted by encode
    Better than nothing!
    nothing new for me. i know much more and you too

  11. #11
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,954
    Thanks
    359
    Thanked 332 Times in 131 Posts
    Quote Originally Posted by Bulat Ziganshin
    lzma!=lzari, otherwise tornado/lzpm will have the same compression ratio as lzma on binary data.
    Test the LZMA at Fast modes.

    The LZMAs parsing makes the difference. LZPM is just an experimental ROLZ implementation. I position BALZ as the extended Deflate (at least with Lazy Matching it is, I hope soon youll see BALZ with two modes).


    Dont forget that LZPM/Tornado/BALZ are too young compared to the LZMA!

  12. #12
    Programmer Bulat Ziganshin's Avatar
    Join Date
    Mar 2007
    Location
    Uzbekistan
    Posts
    4,497
    Thanks
    733
    Thanked 659 Times in 354 Posts
    Quote Originally Posted by encode
    Test the LZMA at Fast modes.
    ive made a lot of tests. unfortunately for me, lzma still outperform tornado at binary files. and you know a lot of ideas which helps lzma to do it

Similar Threads

  1. Data compression explained
    By Matt Mahoney in forum Data Compression
    Replies: 92
    Last Post: 7th May 2012, 18:26
  2. Advice in data compression
    By Chuckie in forum Data Compression
    Replies: 29
    Last Post: 26th March 2010, 15:09
  3. Best compression book references
    By GerryB in forum Data Compression
    Replies: 3
    Last Post: 9th September 2009, 10:24
  4. Data Compression Crisis
    By encode in forum The Off-Topic Lounge
    Replies: 15
    Last Post: 24th May 2009, 19:30
  5. Data Compression Evolution
    By encode in forum Forum Archive
    Replies: 3
    Last Post: 11th February 2007, 15:33

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •