+ Reply to Thread
Results 1 to 2 of 2

Thread: ENWIK13 Download

  1. 29th December 2010, 04:57 #1
    BetaTester
    BetaTester is offline
    Member BetaTester's Avatar
    Join Date
    Dec 2010
    Location
    Brazil
    Posts
    26

    Lightbulb ENWIK13 Download

    ENWIK13 is 5TB text archive - 10^(12,7) bytes

    31GB in 7z compression
    http://download.wikimedia.org/enwiki...history.xml.7z

    update to "Large Text Compression Benchmark" ...
    Reply With Quote Reply With Quote
  2. 29th December 2010, 06:59 #2
    Matt Mahoney
    Matt Mahoney is offline
    Expert
     Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    1,289
    And 280 GB with bzip2. So now we have 2 numbers for the benchmark. I suppose the huge compression ratio for 7zip (160 to 1) is because the set has every version of every page with only minor differences between versions. 7zip has a much bigger buffer than bzip2 (900 KB max).

    But I think I'll stick with 1 GB. Testing takes long enough as it is.
    Reply With Quote Reply With Quote
+ Reply to Thread
« Previous Thread | Next Thread »

Similar Threads

  1. PAQ8 - Download Page
    By Jan Ondrus in forum Data Compression
    Replies: 7
    Last Post: 7th October 2010, 22:14
  2. A lot of Compress Algorith to download , here
    By Yuri Grille. in forum Data Compression
    Replies: 2
    Last Post: 20th April 2009, 21:56
  3. Redline: Gang Warfare 2066 download - re-up!
    By encode in forum Forum Archive
    Replies: 3
    Last Post: 15th December 2007, 16:17

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Forum Rules