Data Compression for Improved Processing (DEAL 681)

Techniques are disclosed to encode input data by dividing it into multiple blocks and using multiple cores of a processor to compress the blocks simultaneously. It is also disclosed that each core encodes the assigned block independently to generate compressed blocks of varying sizes, each having a header and a payload. The system provides fast, parallel, and lossless data compression by optimizing space through tokenization. The technology may be implemented in cloud data storage systems, data compression tools, distributed computing systems, data centers, etc.