I have some several files that are quite similar with some minor differences in places.
I want to compress them all together, but, the size of each individual file is greater than i can make 7zip/gzip's sliding window.
So i thought, what if the binary files were interleaved (1MB of A, 1MB of B, ...) so that the sliding window can better find similar chunks.
I began to write an interleave tool but for the sake of future decompression it would be best if there was a pre-existing format that handled this. The interleave would be handled in isolation (zero compression) and then compressed separately by a later tool.
Is it possible to implement this kind of split-file binary interleave in e.g. the RAR, ACE, tar, or 7Zip bytestream formats?
Does anyone have any suggestions about packing multiple large similar files together?