Results 1 to 5 of 5

Thread: Precomp hard to batch multithread and doesn like big files

  1. #1
    Member
    Join Date
    Sep 2007
    Location
    Denmark
    Posts
    856
    Thanks
    45
    Thanked 104 Times in 82 Posts
    Found 2 issues with Precomp

    I'm running af lot of compression utilities through bat files. to gain a multithreading performance edge.
    However its not possible to run precomp multi instances in the same directory.
    Couldn't it be fxed by using random named temp files ?

    and also
    Precomp seem not to support big files (4gb+)
    its kinda S#X going through precomp -brute on a 5.53GB file an se the resulting file not works

  2. #2
    Member
    Join Date
    Dec 2006
    Posts
    611
    Thanks
    0
    Thanked 1 Time in 1 Post
    As a workaround, try splitting it before precomping

  3. #3
    Member
    Join Date
    Oct 2007
    Location
    Germany, Hamburg
    Posts
    408
    Thanks
    0
    Thanked 5 Times in 5 Posts
    But with splitting you may split important streams

  4. #4
    Programmer schnaader's Avatar
    Join Date
    May 2008
    Location
    Hessen, Germany
    Posts
    539
    Thanks
    192
    Thanked 174 Times in 81 Posts
    Quote Originally Posted by SvenBent
    Couldnt it be fxed by using random named temp files ?
    Hopefully, the next version will not use temp files anymore but do everything in memory, but if it still does, random names will be used.

    Quote Originally Posted by SvenBent
    Precomp seem not to support big files (4gb+)
    I think its even 2 GB. 2 GB+ file support will be in the next version.

    Quote Originally Posted by Simon Berger
    But with splitting you may split important streams
    Most streams are <1 MB in size and large streams of ZIP or PNG
    data that are >1 MB in size will fail to recompress most time, so there wont be much difference. And its still better than not precompressing at all...
    A major drawback on splitting is that you have to split so that not only the input files are <2 GB, but also the output PCF files whose size you cant know. Most times, splitting in 500 MB or 1 GB parts will be enough, but if there are many large image streams, even 100 MB can grow to over 2 GB.
    http://schnaader.info
    Damn kids. They're all alike.

  5. #5
    Member
    Join Date
    Sep 2007
    Location
    Denmark
    Posts
    856
    Thanks
    45
    Thanked 104 Times in 82 Posts
    i got some 700mb iso that grew to 1.3gb after Precomp.

    including Precomp shaved off 20mb of the end files

    So it earned its place in my bathc files.

    actually I'm brute forcing

    Org -> RZM
    Org -> rep -> rzm
    Org -> Precomp -> rzm
    Org -> Precomp -> rep -LZM
    Org -> delta -> RZM
    Org -> delta -> rep -> rzm
    Org -> Precomp ->delta -> rzm
    Org -> Precomp ->delta -> rep -LZM

Similar Threads

  1. convert swf files to avi files
    By Jabilo in forum The Off-Topic Lounge
    Replies: 13
    Last Post: 26th October 2016, 11:39
  2. Precomp (and Precomp Comfort) in 315 kb
    By Yuri Grille. in forum Data Compression
    Replies: 2
    Last Post: 1st April 2009, 19:40
  3. REP and Delta fails with big files
    By SvenBent in forum Data Compression
    Replies: 14
    Last Post: 23rd November 2008, 20:41
  4. RZM doesn't like to share cpu
    By SvenBent in forum Data Compression
    Replies: 2
    Last Post: 19th July 2008, 22:35
  5. Fast decompression of big files
    By SvenBent in forum Forum Archive
    Replies: 16
    Last Post: 8th March 2008, 20:17

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •