Page 1 of 7 123 ... LastLast
Results 1 to 30 of 192

Thread: WCC - World Compressor Challenge - Incoming

  1. #1
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts

    Cool WCC - World Compressor Challenge - Incoming

    WCC - World Compressor Challenge

    World Compression Challenge is a file compression benchmark. It is a reference for the latest information about the performance of lossless data compression software. The test takes place on many file types so as not to benefit a specific compressor and to verify the actual ability to adapt to any type of data.

    link:
    http://heartofcomp.altervista.org/MOC/MOCA.htm

    Cpu for test is Intel Core i5 7400, 3.0 GHz, 4 Cores, 16 GB, Windows
    Last edited by Nania Francesco; 27th November 2018 at 01:46.

  2. #2
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 778 Times in 485 Posts
    Nice. Is there a description of the test data or a place to download?

  3. #3
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    I have lost much time to create the program in order to make all the tests and to create the pages Web in way automatic rifle. As soon as I can I modernize the Home Page and I add the link of the file that I have taken from Internet!
    P.S.
    I am releasing always new modernizations as with my system I can modernize the site in little second ones after little tests!
    Last edited by Nania Francesco; 26th April 2012 at 01:04.

  4. #4
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts

    News

    Note:
    Nanozip v.0.09 is in testing.... detected errors in configuration -> -p4 (multi compressor)!
    No errors in option -> -t4 -p1 !

  5. #5
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts

    HI!

    WCC last update: 26/04/2012 time 21:54:33

    Added more Archiver and Compressor!

  6. #6
    Member
    Join Date
    Sep 2008
    Location
    France
    Posts
    856
    Thanks
    447
    Thanked 254 Times in 103 Posts
    Wow, great job you achieved today Nania !

    Btw, maybe you did not notice, i sent you a PM to inform you of a few useful updates.


    Best Rgds

  7. #7
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Hi!
    WCC Last update: 27/04/2012 time 09:13:52

    Best Regards!

  8. #8
    Member
    Join Date
    Mar 2010
    Location
    Germany
    Posts
    116
    Thanks
    18
    Thanked 32 Times in 11 Posts
    Very interesting to see, how good rar performs in this challenge (pos 20 currently)

  9. #9
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    WCC Last update: 27/04/2012 at 13:54:02

    added .. CMM4 , UHARC 0.6b, LPAQ8 , Hook ... etc.

    Best Regars!

  10. #10
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    News:
    Freearc 0.67 retested !
    before I have tested the program alone without all the package bin that of ago part!
    I ask excuse for error to Bulat!
    Regards

  11. #11
    Member
    Join Date
    Sep 2008
    Location
    France
    Posts
    856
    Thanks
    447
    Thanked 254 Times in 103 Posts
    Maybe Etincelle could benefit from an updated to latest version RC2 :
    http://phantasie.tonempire.net/t102-...06-105mb-s#160

    I believe it should run faster than alpha3

    Regards

  12. #12
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    WCC Last update: 28/04/2012 11:37:06
    FP8 v2 is new WCC leader (Size) !
    link:
    http://heartofcomp.altervista.org/MOC/MOCA.htm

  13. #13
    Member m^2's Avatar
    Join Date
    Sep 2008
    Location
    Ślůnsk, PL
    Posts
    1,612
    Thanks
    30
    Thanked 65 Times in 47 Posts
    What is C./D. Rate ?
    Also, now I see many quiestion mark characters, probably characters that are missing in my font. I think that I've visited the site on this computer before and if I did, there weren't there, so this is likely to be caused by some fairly recent change.

  14. #14
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    C/D Rate= (Compression Rate+Decompression Rate)/2
    Regards!

  15. #15
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts

    Talking New update is online

    WCC Last update: 29/04/2012 time 14:17:26 is Online!

    Regards!

  16. #16
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    I would appreciate a your opinion for modification of the system of calculation of the efficiency. The rule puts into effect them is much similar one to that of Maximum compression but it is not to my precise warning above all with compressor (BWT, CM, PPM). The result in fact is not adaptive but linear.

    Which the solution?

  17. #17
    Member
    Join Date
    Dec 2011
    Location
    Cambridge, UK
    Posts
    437
    Thanks
    137
    Thanked 152 Times in 100 Posts
    Efficiency is a tricky one to pin down. I think perhaps one useful metric of overall efficiency is to answer a question like: If I had to send this data to the cloud, how much more efficient is it to compress, transfer, decompress than to just transfer the original uncompressed version? That's a real world example that people have to decide on every day.

    The answer obviously depends on relative speeds of CPU and bandwidth, but you could pick some realistic expectations (maybe estimating for 1 year in the future for CPU as it grows so fast) and run with it. It also has the advantage that "size_top" isn't used and so the efficiency doesn't change for all entries if a new best entry appears.

    An example, a 10MBit/sec link would take 820sec to transfer the raw uncompressed corpus. The BSC64 top entry would be 446sec to transfer, +178, +121 for compression making 745ish; or 1.1x faster overall. Slug would end up at approx 1.5x and fpaq8 at 0.26x.

    Some caveats though. Firstly it's highly variable based on bandwidth. 10MB/s maybe too high for the typical upload to cloud storage, but it's too low for a most local network traffic.

    Secondly it assumes a linear process: compress, then transfer, then decompress. In reality you'll probably be doing these in parallel and waiting on the slowest bit (bandwidth for fast compressors, cpu for slow ones). I'm not sure how best to accommodate that, but clearly if you can keep up with the data flow then a little more cpu usage shouldn't be considered harmful if it's decreasing the size.

  18. #18
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts

    Talking

    Quote Originally Posted by JamesB View Post
    Efficiency is a tricky one to pin down. I think perhaps one useful metric of overall efficiency is to answer a question like: If I had to send this data to the cloud, how much more efficient is it to compress, transfer, decompress than to just transfer the original uncompressed version? That's a real world example that people have to decide on every day.

    The answer obviously depends on relative speeds of CPU and bandwidth, but you could pick some realistic expectations (maybe estimating for 1 year in the future for CPU as it grows so fast) and run with it. It also has the advantage that "size_top" isn't used and so the efficiency doesn't change for all entries if a new best entry appears.

    An example, a 10MBit/sec link would take 820sec to transfer the raw uncompressed corpus. The BSC64 top entry would be 446sec to transfer, +178, +121 for compression making 745ish; or 1.1x faster overall. Slug would end up at approx 1.5x and fpaq8 at 0.26x.

    Some caveats though. Firstly it's highly variable based on bandwidth. 10MB/s maybe too high for the typical upload to cloud storage, but it's too low for a most local network traffic.

    Secondly it assumes a linear process: compress, then transfer, then decompress. In reality you'll probably be doing these in parallel and waiting on the slowest bit (bandwidth for fast compressors, cpu for slow ones). I'm not sure how best to accommodate that, but clearly if you can keep up with the data flow then a little more cpu usage shouldn't be considered harmful if it's decreasing the size.
    A lot interesting the made appraisal!
    Actual rule is :
    score_X = POWER(2; ((size_X / size_TOP) - 1)*5) * time_X

    with score_X efficiency score for a certain compressor X
    time_X time elapsed by compressor X (comp or decomp time)
    size_X archive size achieved with compressor X
    size_TOP archive size by top archiver (smallest benchmark result)
    size_TEST size of all tests

    Mine puts into effect them idea is this:
    K=( % size_X -> size TEST )/10
    score_X = POWER(2; ((size_X / size_TOP) - 1)*K) * time_X
    ----------------------------------------------------------------------

    New Release of WCC is Online!
    Last edited by Nania Francesco; 30th April 2012 at 19:52.

  19. #19
    Member
    Join Date
    Sep 2008
    Location
    France
    Posts
    856
    Thanks
    447
    Thanked 254 Times in 103 Posts
    Maybe it could be useful to provide some external links too ?
    for example the home pages of some compressors ?

  20. #20
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Added Home page!
    Updated all 96 pages of WCC!
    Applied new equation for Compression Efficiency - Decompression Efficiency - C/D Rate (Efficiency)!
    Regards!

  21. #21
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Last update: 02/05/2012 15:09:57
    New Release of WCC is Online!
    Added ZCM v.030!

  22. #22
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    New WCC update: 03/05/2012 time 10:38:13

    Added BMA Archiver and WinRAR 4.20 beta 1

  23. #23
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    New update is online
    added:
    - RAR 4.20 beta 2 64 bit
    - bzp v 0.3

  24. #24
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    New WCC update: 17/05/2012 time 18:08:21

    added: ZCM 0.40

  25. #25
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    New update of WCC Challenge

    added:

    - MCOMP v. 2.0
    - IMP v.1.12

  26. #26
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    New update of WCC Challenge

    added:

    - ZCM 0.50a

  27. #27
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    New update of WCC Challenge

    added:
    - Durilca v. 0.50
    - ZCM 0.60d

    only from:
    http://heartofcomp.altervista.org/MOC/MOC.htm

  28. #28
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    New update of WCC Challenge

    added:
    - Nanozip 0.09 x86 version

    only from:
    http://heartofcomp.altervista.org/MOC/MOC.htm

  29. #29
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    New update of WCC Challenge

    added:
    - Comprox rev. 0.8 (by Zhang Li)

    only from:
    http://heartofcomp.altervista.org/MOC/MOC.htm

  30. #30
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    New update of WCC Challenge

    added:
    - LZHam version 0x1007

    only from:
    http://heartofcomp.altervista.org/MOC/MOC.htm

Page 1 of 7 123 ... LastLast

Similar Threads

  1. a challenge for C experts
    By Alexander Rhatushnyak in forum The Off-Topic Lounge
    Replies: 10
    Last Post: 25th January 2012, 05:29
  2. Calgary challenge
    By Matt Mahoney in forum Data Compression
    Replies: 6
    Last Post: 12th September 2010, 01:45
  3. The lie of "The world is a globe"
    By Vacon in forum The Off-Topic Lounge
    Replies: 2
    Last Post: 14th December 2009, 16:58
  4. WinTURTLE 1.0.0 Beta incoming!
    By Nania Francesco in forum Forum Archive
    Replies: 70
    Last Post: 27th January 2008, 01:57
  5. TURTLE incoming... Fast PPM file compressor.
    By Nania Francesco in forum Forum Archive
    Replies: 104
    Last Post: 8th August 2007, 20:40

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •