Serialization

Lightning fast serialization of data frames using the fst package

Jan 1, 2018

Version 0.8.0 of R’s fst package has been released to CRAN. The package is now multi-threaded allowing for even faster serialization of data frames to disk.

Multi-threaded LZ4 and ZSTD compression from R

Jan 1, 2018

The fst package uses LZ4 and ZSTD to compress columnar data. In the latest release, methods compress_fst and decompress_fst were added which allow for direct (multi-threaded) access to these excellent compressors.

Multi-threaded hashing with xxHash from R

Jan 1, 2018

The fst package uses the xxHash algorithm for internal hashing of (meta-)data. With method hash_fst the user now has direct access to this extremely fast hashing algorithm.

Lightning fast serialization of data frames using the fst package

Mark Klik

Lightning fast serialization of data frames using the fst package

Multi-threaded LZ4 and ZSTD compression from R

Multi-threaded hashing with xxHash from R