Hashing

Lightning fast serialization of data frames using the fst package

Jan 1, 2018

Version 0.8.0 of R’s fst package has been released to CRAN. The package is now multi-threaded allowing for even faster serialization of data frames to disk.

Multi-threaded LZ4 and ZSTD compression from R

Jan 1, 2018

The fst package uses LZ4 and ZSTD to compress columnar data. In the latest release, methods compress_fst and decompress_fst were added which allow for direct (multi-threaded) access to these excellent compressors.

Multi-threaded hashing with xxHash from R

Jan 1, 2018

The fst package uses the xxHash algorithm for internal hashing of (meta-)data. With method hash_fst the user now has direct access to this extremely fast hashing algorithm.

Multi-threaded hashing with xxHash from R

Mark Klik

Lightning fast serialization of data frames using the fst package

Multi-threaded LZ4 and ZSTD compression from R

Multi-threaded hashing with xxHash from R