Get the latest tech news

Exploiting column chunks for faster ingestion and lower memory use


To enable working with more kinds of datasets in Rerun, the 0.18 release introduces a new column oriented API and performance improvements to help handle larger time-series.

To enable working with more kinds of datasets in Rerun, the 0.18 release introduces a new column oriented API and performance improvements to help handle larger time-series. To make it easier and more efficient to deal with pre-recorded data, we're introducing a new api, send_columns, for sending time-series columns to Rerun, as well as a cli tool for merging, pruning, and compacting.rrd files. If you can't wait to try out the new faster chunk ingestion in Rerun 0.18, you can load the 2.25M scalars dataset from the benchmark mentioned above directly in your browser here.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of Column

Column

Photo of faster ingestion

faster ingestion

Photo of lower memory use

lower memory use

Related news:

News photo

Column: Exxon Mobil is suing its shareholders to silence them about global warming

News photo

Column: A big victory for an Orange County entrepreneur in his legal fight against Apple

News photo

Column: The FCC's move to restore net neutrality is overdue, and possibly too late.