Page 55 of 55 FirstFirst ... 545535455
Results 1,621 to 1,638 of 1638

Thread: paq8px

  1. #1621
    Member
    Join Date
    Dec 2008
    Location
    Poland, Warsaw
    Posts
    909
    Thanks
    531
    Thanked 359 Times in 267 Posts
    Scores for my testset for paq8px v179fix5. Slightly improvements across most of files -> in total 274 bytes = 0.003%.
    Small but always something, especially paq8px have still the best score in total for my testset
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	paq8px_v179fix5.jpg 
Views:	31 
Size:	638.8 KB 
ID:	6665  

  2. The Following User Says Thank You to Darek For This Useful Post:

    Gotty (24th June 2019)

  3. #1622
    Member
    Join Date
    Dec 2008
    Location
    Poland, Warsaw
    Posts
    909
    Thanks
    531
    Thanked 359 Times in 267 Posts
    And 4 Corpuses scores for paq8px v179fix5.
    As similar for previous versions - slightly worse compression for bigger files, but better for smaller.
    Silesia loses in Mozilla and Webster files mostly. Calgary and Canterbury corpuses got small but nice improvements.
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	paq8px_v179fix5_4_Corpuses.jpg 
Views:	34 
Size:	4.48 MB 
ID:	6667  

  4. The Following User Says Thank You to Darek For This Useful Post:

    Gotty (24th June 2019)

  5. #1623
    Member Gotty's Avatar
    Join Date
    Oct 2017
    Location
    Hungary
    Posts
    343
    Thanks
    235
    Thanked 226 Times in 123 Posts
    Quote Originally Posted by Shelwien View Post
    Some ideas for development:

    1. Create API for simple (de)compression of given data.
    a) My current preferred codec API looks like this:
    Code:
    const int obj_size = 13369344; // object size for external alloc
    unsigned Init( void* p, void* Args ); // construct object in given memory
    void Quit( void* p ); // deallocate stuff
    unsigned Process( void* p ); // start/resume processing a stream
    void Addbuf( void* p, unsigned stream_id, void* buf, unsigned bufsize );
    b) More common version would be something similar with callback functions for i/o
    instead of Process() as coroutine.
    c) Another option is to use a template for compressor class, with i/o class as
    template parameter, but its not portable or compatible with anything.

    2. Create a test frontend which would (de)compress multiple files with multiple codec instances. MT, if possible.
    But switching after processing a buffer works for encapsulation testing just as well.
    Noted. You read my mind.
    It's not yet possible, but with the fixes we are (slowly) heading to that direction.

  6. #1624
    Member Gotty's Avatar
    Join Date
    Oct 2017
    Location
    Hungary
    Posts
    343
    Thanks
    235
    Thanked 226 Times in 123 Posts

    paq8px_v180

    Code:
    - Minor code changes with unchanged functionality according to VS2019 suggestions with C++11 guidelines in mind
    - Minor fixes in probabilistic increment in StateMap
    - Introduced probabilistic increment in StateMaps (IndirectMap, ContextMap2, Image4bitModel, Image1bitModel, JpegModel, DMCModel)
    - Improvements in ContextMap, ContextMap2
    - Introduced state group in StateMap (used by ContextMap2)
    - More global scope (now ExeModel-related) cleanup 
    - Other minor/cosmetic changes
    Attached Files Attached Files

  7. The Following 4 Users Say Thank You to Gotty For This Useful Post:

    Darek (5th July 2019),Mike (5th July 2019),moisesmcardona (5th July 2019),xinix (5th July 2019)

  8. #1625
    Member
    Join Date
    Dec 2008
    Location
    Poland, Warsaw
    Posts
    909
    Thanks
    531
    Thanked 359 Times in 267 Posts
    Scores of my testset for paq8px v180. Generally small improvements on most files, especially the biggest and Q.WK3 (0.28% of improvement).
    In total there is 1.5KB of gain (0.02%).

    It's worth to mention that paq8px is still holding 5 records for my testset (for 0.WAV, D.TGA, E.TIF, J,EXE and L.PAK) and the best Total score!
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	paq8px_v180.jpg 
Views:	33 
Size:	639.1 KB 
ID:	6700  

  9. The Following 2 Users Say Thank You to Darek For This Useful Post:

    Gotty (5th July 2019),Stephan Busch (6th July 2019)

  10. #1626
    Member
    Join Date
    Dec 2008
    Location
    Poland, Warsaw
    Posts
    909
    Thanks
    531
    Thanked 359 Times in 267 Posts
    Scores of 4 Corpuses for paq8px v180.
    Small improves for Clagary, Canterbury and MaximumCompression corpuses - 0.02%, 0.03% and 0.03% respectively.
    The biggest gain comes for Silesia corpus = -20KB. Mozilla file got 12KB of gain!
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	paq8px_v180_4_Corpuses.jpg 
Views:	15 
Size:	3.64 MB 
ID:	6708  

  11. The Following User Says Thank You to Darek For This Useful Post:

    Gotty (8th July 2019)

  12. #1627
    Member
    Join Date
    Sep 2014
    Location
    Italy
    Posts
    21
    Thanks
    33
    Thanked 18 Times in 11 Posts
    My Big test Case results - V179 vs. V180

    Click image for larger version. 

Name:	paq180_1.png 
Views:	15 
Size:	80.4 KB 
ID:	6710

    Globallywe loose 3239 bytes.
    We have a gain of 5935 bytes in ISO file.
    But we loose 10966 bytes in JPEG file. (Why?)
    Click image for larger version. 

Name:	paq180_2.png 
Views:	14 
Size:	110.6 KB 
ID:	6711
    We achieve new record for MP4 files, BAK files and EXE files.

    Thanks Gotty!!!!1
    Luca

  13. The Following 2 Users Say Thank You to LucaBiondi For This Useful Post:

    Darek (10th July 2019),Gotty (10th July 2019)

  14. #1628
    Member Gotty's Avatar
    Join Date
    Oct 2017
    Location
    Hungary
    Posts
    343
    Thanks
    235
    Thanked 226 Times in 123 Posts
    Thank you, Luca!
    Quote Originally Posted by LucaBiondi View Post
    But we loose 10966 bytes in JPEG file. (Why?)
    There was a small shange in jpegmodel. Could you upload your jpeg testset somewhere, so I can download (or just some files, that degraded the most)? My testset didn't show a degradation, but it is not a very large testset.
    Last edited by Gotty; 10th July 2019 at 11:52.

  15. The Following User Says Thank You to Gotty For This Useful Post:

    LucaBiondi (11th July 2019)

  16. #1629
    Member
    Join Date
    Sep 2014
    Location
    Italy
    Posts
    21
    Thanks
    33
    Thanked 18 Times in 11 Posts
    Hi Gotty!

    Thank you. This is an example

    paq8px_v179

    2/10 - Filename: ..\Varie\Jpeg_sub_testset\WP_20170821_19_14_04_Ric h.jpg (6593924 bytes)
    Block segmentation:
    0 | jpeg | 6593924 bytes [0 - 6593923]
    File size to encode : 4
    File input size : 6593924
    File compressed size : 4844853

    paq8px_v180

    2/10 - Filename: ..\Varie\Jpeg_sub_testset\WP_20170821_19_14_04_Ric h.jpg (6593924 bytes)
    Block segmentation:
    0 | jpeg | 6593924 bytes [0 - 6593923]
    File size to encode : 4
    File input size : 6593924
    File compressed size : 4845256

    --------------

    paq8px_v179

    4/10 - Filename: ..\Varie\Jpeg_sub_testset\WP_20170822_11_30_10_Ric h.jpg (4723897 bytes)
    Block segmentation:
    0 | jpeg | 4723897 bytes [0 - 4723896]
    File size to encode : 4
    File input size : 4723897
    File compressed size : 3482817

    paq8px_v180

    4/10 - Filename: ..\Varie\Jpeg_sub_testset\WP_20170822_11_30_10_Ric h.jpg (4723897 bytes)
    Block segmentation:
    0 | jpeg | 4723897 bytes [0 - 4723896]
    File size to encode : 4
    File input size : 4723897
    File compressed size : 3483114

    -------------

    paq8px_v179

    10/10 - Filename: ..\Varie\Jpeg_sub_testset\WP_20170824_12_48_24_Ric h.jpg (6017677 bytes)
    Block segmentation:
    0 | jpeg | 6017677 bytes [0 - 6017676]
    File size to encode : 4
    File input size : 6017677
    File compressed size : 4389287

    paq8px_v180

    10/10 - Filename: ..\Varie\Jpeg_sub_testset\WP_20170824_12_48_24_Ric h.jpg (6017677 bytes)
    Block segmentation:
    0 | jpeg | 6017677 bytes [0 - 6017676]
    File size to encode : 4
    File input size : 6017677
    File compressed size : 4389813

    Where i can send this 3 jpeg files? can you provide me an email address?

    Thanks,
    Luca

  17. The Following User Says Thank You to LucaBiondi For This Useful Post:

    Gotty (11th July 2019)

  18. #1630
    Member
    Join Date
    Sep 2014
    Location
    Italy
    Posts
    21
    Thanks
    33
    Thanked 18 Times in 11 Posts
    Just to tell, also from v169 to v170 and from v170 to v171 we loose some KB...

    PROG_NAME PROG_VERSION COMMAND_LINE LEVEL INPUT_FILENAME ORIGINAL_SIZE_BYTES COMPRESSED_SIZE_BYTES RUNTIME_MS
    paq8px 166 @subjpglist.txt -9 -v -log paq8px_subjpeg.txt 9 subjpglist.txt 52691326 38661991 1113189
    paq8px 167 @subjpglist.txt -9 -v -log paq8px_subjpeg.txt 9 subjpglist.txt 52691326 38661995 1126918
    paq8px 168 @subjpglist.txt -9 -v -log paq8px_subjpeg.txt 9 subjpglist.txt 52691326 38661401 1119212
    paq8px 169 @subjpglist.txt -9 -v -log paq8px_subjpeg.txt 9 subjpglist.txt 52691326 38651612 1122916 (this is Best result)
    paq8px 170 @subjpglist.txt -9 -v -log paq8px_subjpeg.txt 9 subjpglist.txt 52691326 38653113 1145139
    paq8px 171 @subjpglist.txt -9 -v -log paq8px_subjpeg.txt 9 subjpglist.txt 52691326 38655247 1153830
    paq8px 172 @subjpglist.txt -9 -v -log paq8px_subjpeg.txt 9 subjpglist.txt 52691326 38655265 1153905
    paq8px 173 @subjpglist.txt -9 -v -log paq8px_subjpeg.txt 9 subjpglist.txt 52691326 38655240 1163446
    paq8px 174 @subjpglist.txt -9 -v -log paq8px_subjpeg.txt 9 subjpglist.txt 52691326 38655213 1177792
    paq8px 175 @subjpglist.txt -9 -v -log paq8px_subjpeg.txt 9 subjpglist.txt 52691326 38655274 1183936
    paq8px 176 @subjpglist.txt -9 -v -log paq8px_subjpeg.txt 9 subjpglist.txt 52691326 38655274 1168394
    paq8px 177 @subjpglist.txt -9 -v -log paq8px_subjpeg.txt 9 subjpglist.txt 52691326 38655274 1158436
    paq8px 178 @subjpglist.txt -9 -v -log paq8px_subjpeg.txt 9 subjpglist.txt 52691326 38655309 1200522
    paq8px 179 @subjpglist.txt -9 -v -log paq8px_subjpeg.txt 9 subjpglist.txt 52691326 38655305 1227193
    paq8px 180 @subjpglist.txt -9 -v -log paq8px_subjpeg.txt 9 subjpglist.txt 52691326 38658732 1188585

    Luca

  19. The Following User Says Thank You to LucaBiondi For This Useful Post:

    Darek (11th July 2019)

  20. #1631
    Member Gotty's Avatar
    Join Date
    Oct 2017
    Location
    Hungary
    Posts
    343
    Thanks
    235
    Thanked 226 Times in 123 Posts

    paq8px_v181

    Code:
    - Matchmodel changes:
     - fix: expectedByte could contain garbage
     - fix: delta mode turned on unnecessarily for the next byte (at bpos=0) when the last bit (bpos=7) of the previous
       byte did not match 
     - enhancement: a new recovery mode: when a 1-byte mismatch occurs but the match continues, the match
       is recovered (if no new match is found in the meantime)
     - enhancement: a StationaryMap and a SmallStationaryContextMap is converted to a ContextMap (less memory, 
       better prediction, except maybe for some images)
     - enhancement: number of mixer contexts: 8 instead of 256 (less memory, better mixing)
    - Removed experimental command line options: Fastmode (-f) (in favor of a new blocktype in a forthcoming version)
      and Force PNM detection in text (-p).
    - Reverted probabilistic increment to normal increment in JpegModel 
    - Other cosmetic changes
    Attached Files Attached Files

  21. The Following 5 Users Say Thank You to Gotty For This Useful Post:

    Darek (11th July 2019),kaitz (11th July 2019),LucaBiondi (12th July 2019),Mike (11th July 2019),moisesmcardona (11th July 2019)

  22. #1632
    Member
    Join Date
    Dec 2008
    Location
    Poland, Warsaw
    Posts
    909
    Thanks
    531
    Thanked 359 Times in 267 Posts
    Scores of paq8px v181 for mt testset.
    In total there is a some loss, however most of got gains. Quite fine for the biggest file K.WAD, for Q.WK3 and H.EXE but (what is a little strange) L.PAK got 3KB loss..
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	paq8px_v181.jpg 
Views:	24 
Size:	639.0 KB 
ID:	6716  

  23. The Following 2 Users Say Thank You to Darek For This Useful Post:

    Gotty (11th July 2019),LucaBiondi (12th July 2019)

  24. #1633
    Member Gotty's Avatar
    Join Date
    Oct 2017
    Location
    Hungary
    Posts
    343
    Thanks
    235
    Thanked 226 Times in 123 Posts
    Quote Originally Posted by Darek View Post
    but (what is a little strange) L.PAK got 3KB loss..
    That is strange indeed. How can I get a copy of L.PAK?

  25. The Following User Says Thank You to Gotty For This Useful Post:

    LucaBiondi (12th July 2019)

  26. #1634
    Member
    Join Date
    Sep 2015
    Location
    Italy
    Posts
    216
    Thanks
    97
    Thanked 128 Times in 92 Posts
    Quote Originally Posted by Gotty View Post
    How can I get a copy of L.PAK?
    https://encode.ru/threads/2823-simv2...ll=1#post54450

  27. The Following 3 Users Say Thank You to Mauro Vezzosi For This Useful Post:

    Darek (13th July 2019),Gotty (13th July 2019),LucaBiondi (14th July 2019)

  28. #1635
    Member Gotty's Avatar
    Join Date
    Oct 2017
    Location
    Hungary
    Posts
    343
    Thanks
    235
    Thanked 226 Times in 123 Posts
    Thank you, Mauro!
    Darek already sent me the file privately, but in the thread you provided, I found some extra files from the testset, so it was useful.

    Also got the 3 JPEG samples from Luca, and it turned out that the problem is not with introducing the probabilistic increment in the jpegmodel (which helps in case of Luca's files as well as in my testset).
    It is quite possible, that simply improving the normalmodel and (in case of L.PAK) the matchmodel is not in favor of multimedia files. It looks like multimedia content will need a specialized normalmodel/matchmodel.

  29. The Following User Says Thank You to Gotty For This Useful Post:

    LucaBiondi (15th July 2019)

  30. #1636
    Member Gotty's Avatar
    Join Date
    Oct 2017
    Location
    Hungary
    Posts
    343
    Thanks
    235
    Thanked 226 Times in 123 Posts
    Quote Originally Posted by LucaBiondi View Post
    Just to tell, also from v169 to v170 and from v170 to v171 we loose some KB...Luca
    From v169->v170 I have a strong suspect: In v169b I accidentally broke segmentation, which Darek detected: tarred files and mixed content files lost mostly. I promised to come back with a patch soon. The patch is in my unreleased v169c version. (It was at the time of the server failure.)
    So the patch for the segmentation problem, and some segmentation improvements is coming back as v182.

    About v170->v171 degradation: I don't know. I just know that v170 was an exceptionally good release (from Márcio). And v171 was a bit weaker (from compression point of view).

  31. The Following 2 Users Say Thank You to Gotty For This Useful Post:

    LucaBiondi (15th July 2019),xinix (14th July 2019)

  32. #1637
    Member
    Join Date
    Dec 2008
    Location
    Poland, Warsaw
    Posts
    909
    Thanks
    531
    Thanked 359 Times in 267 Posts
    Scores of 4 Corpuses for paq8px v181. I've hide some versions to make this table better to read.
    All corpuses got gains from 0.02%-0.05%. As previous mozilla file from Silesia corpus got about 10KB of gain!
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	paq8px_v181_4_Corpuses.jpg 
Views:	17 
Size:	1.97 MB 
ID:	6717  

  33. The Following 2 Users Say Thank You to Darek For This Useful Post:

    Gotty (14th July 2019),LucaBiondi (15th July 2019)

  34. #1638
    Member
    Join Date
    Sep 2014
    Location
    Italy
    Posts
    21
    Thanks
    33
    Thanked 18 Times in 11 Posts
    My Big Testcase paq8px v180 vs. v181

    Click image for larger version. 

Name:	Paq8px_180_vs_181.png 
Views:	18 
Size:	81.0 KB 
ID:	6718

    Globally we loose about 2 KB
    JPEG loose 9 KB
    ISO gain 7,5 KB

    Click image for larger version. 

Name:	Paq8px_180_vs_181_2.png 
Views:	15 
Size:	86.1 KB 
ID:	6719

    New record for MP4, TXT, EXE and ISO file formats

    bye bye,
    Luca
    https://sqlserverperformace.blogspot.com/
    Last edited by LucaBiondi; 20th July 2019 at 01:43.

  35. The Following 2 Users Say Thank You to LucaBiondi For This Useful Post:

    Darek (15th July 2019),Gotty (15th July 2019)

Page 55 of 55 FirstFirst ... 545535455

Similar Threads

  1. FrontPAQ - GUI frontend for PAQ8PF and PAQ8PX
    By LovePimple in forum Download Area
    Replies: 26
    Last Post: 17th January 2019, 14:36
  2. Alternative paq8px builds
    By M4ST3R in forum Download Area
    Replies: 20
    Last Post: 25th June 2010, 16:19
  3. Optimized paq7asm.asm code not compatible with paq8px?
    By M4ST3R in forum Data Compression
    Replies: 7
    Last Post: 3rd June 2009, 15:34

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •