preflate-rs is a port of the C++ preflate library to split deflate streams into uncompressed data and reconstruction information, or reconstruct the original deflate stream from those two.
IMPORTANT: This library is still in initial development, so there are probably breaking changes being done fairly frequently.
The resulting uncompressed content can then be recompressed by a more modern compression technique such as Zstd, lzma, etc. This library is designed to be used as part of a cloud storage system that requires exact binary storage of content, so the libary needs to make sure that the DEFLATE content is recreated exactly as it was written. This is not trivial, since DEFLATE has a large degree of freedom in choosing both how the distance/length pairs are chose and how the Huffman trees are created.
The library tries to detect the following compressors to try to do a reasonable job:
The general approach is as follows:
The following differences are corrected:
Note that the data formats of the recompression information are different and incompatible to the original preflate implemenation, as this library uses a different arithmetic encoder (shared from the Lepton JPEG compression library).
git clone https://github.com/microsoft/preflate-rs
cargo build --release
There is an
preflate_util.exe wrapper that is built as part of the project that can be used to test out the library against Deflate compressed content.
Official Github: https://github.com/microsoft/preflate-rs
License: Apache-2.0 license