Results 1 to 2 of 2

Thread: Need some ideas to implement in a compressor

  1. #1
    Member
    Join Date
    May 2017
    Location
    Sealand
    Posts
    15
    Thanks
    7
    Thanked 2 Times in 2 Posts

    Talking Need some ideas to implement in a compressor

    I've been a long time lurker in this forum,learned a lot from this forum.

    I guess its time i work on a compressor of some sort. The compressor would mostly be used on binary data so I guess LZ would be the right choice.

    There are 2 ideas i have right now:

    1. LZMA with TPAQ entropy coder if its possible or any ways to improve LZMA ratio.

    2. Add optimal parsing to BALZ and maybe add the entropy coder here too.

    I'm open to any ideas or implementations

  2. #2
    Member
    Join Date
    Feb 2015
    Location
    United Kingdom
    Posts
    154
    Thanks
    20
    Thanked 66 Times in 37 Posts
    If you're going to use a basic CM I'd recommend pairing it ROLZ as it's more context oriented than lz77 (lzma) and can achieve similar or greater ratios. That way the context mixing only has to be done on the low orders (order-0 to order-2 at most) which should help with speed. Furthermore you can sneak in an lzma-style state-map (http://mattmahoney.net/dc/dce.html#Section_523) for handling different transition states in the ROLZ model and have it influence the context mixer.

    If you're set on lzma modifications the only thing I can think of to improve that would be to use a kind of dictionary preprocessor to cluster matches closer and reduce the offset size, and possibly PAQ mixing.

    Good luck on your project!

  3. The Following User Says Thank You to Lucas For This Useful Post:

    Chirantan (19th December 2017)

Similar Threads

  1. Kitty file compressor (Super small compressor)
    By snowcat in forum Data Compression
    Replies: 7
    Last Post: 26th April 2015, 16:46
  2. Ultimate one-click compressor ideas
    By SoraK05 in forum Data Compression
    Replies: 45
    Last Post: 23rd November 2014, 19:03
  3. CM on GPU - I need ideas for parallelization
    By namibj in forum Data Compression
    Replies: 5
    Last Post: 16th August 2013, 17:22
  4. More ideas for LZ matchfinding
    By Shelwien in forum Data Compression
    Replies: 1
    Last Post: 2nd October 2011, 23:39
  5. Ideas for PIM
    By Mapi in forum Forum Archive
    Replies: 1
    Last Post: 18th June 2007, 22:24

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •