Get the latest tech news
DataFusion Comet: Apache Spark Accelerator
Apache DataFusion Comet Spark Accelerator. Contribute to apache/datafusion-comet development by creating an account on GitHub.
The following chart shows the time it takes to run the 22 TPC-H queries against 100 GB of data in Parquet format using a single executor with 8 cores. Comet tightly integrates with the core Apache DataFusion project, leveraging its powerful execution engine. Whether it's fixing bugs, adding new features, writing documentation, or optimizing performance, your contributions are invaluable in shaping the future of Comet.
Or read this on Hacker News