Get the latest tech news
Show HN: ZSV (Zip Separated Values) columnar data format
ZSV Utility for converting csv/tsv to/from zip-separated-values - Hafthor/zsvutil
ZSV (ZIP Separated Values) is a columnar data storage format with features similar to Parquet, Orc or Avro, however, it is built upon the simple technologies of TSV (tab separated values) and ZIP, making it easy to understand, create and consume, but still provide the query performance characteristics of a modern columnar store format. Any escaping or encoding of these characters would make the format less human-readable, harder to parse and could introduce ambiguity and consistency problems. If you are currently using TSV files and want to improve query performance without changing your data format, ZSV is a good choice.
Or read this on Hacker News
