Results 1 to 2 of 2

Thread: Compressing two (or more) large but similar files

  1. #1
    Member
    Join Date
    Aug 2008
    Location
    Saint Petersburg, Russia
    Posts
    215
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Compressing two (or more) large but similar files

    What is the best solution for compressing several large files that are similar to each other?
    A real-life example could be the daily backup of database files or mailboxes. Their sizes may be up to several GBs, but day-to-day they would contain just a couple of hundred megabytes of different data.
    Is there a way to use this to save space on the archive storage if I want to have multiple copies?

  2. #2
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 778 Times in 485 Posts
    Use long range LZ77 like srep or dedupe like zpaq. If you are making regular backups (not one-time compression) then use dedupe. srep gives better compression but can't be updated without decompressing first.

Similar Threads

  1. Compressing 129GB of MKV Files
    By Phoenix in forum Data Compression
    Replies: 7
    Last Post: 26th October 2016, 17:35
  2. Replies: 7
    Last Post: 24th September 2015, 06:03
  3. Strategy for large but similar files
    By taurus in forum Data Compression
    Replies: 22
    Last Post: 19th April 2014, 03:26
  4. Snappy Compression for large number of small files
    By Selvaraj in forum Data Compression
    Replies: 1
    Last Post: 30th March 2013, 23:43
  5. Compressing mp3 Files
    By zhuda in forum Data Compression
    Replies: 12
    Last Post: 7th March 2011, 19:26

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •