This is my first post so be gentle if I'm talking nonsense, Note... when I say
nonsense I don't mean I'm about to tell you I can compress random data, that's
something else entirely.
I've been messing around with compression for a while and started with a PPM0
model and a 64 bit arithmetic encoder. This has sort of snowballed into a
threaded streaming API that could be used by most compressors. I expect that
someone has already written something in this area, if so I'd love some
pointers at previous work. I'm aware that zlib has a streaming api, the library
I'm working on (libdach) would be generalizing this for anyone to use.
I've started a web page on it here that lists some of the ideas for the
I'd like to know if this is an exercise in folly ie it's not needed, it's
done already, or unlikely to be used by anyone due to [insert reason here].