Get the latest tech news
Show HN: Execute SQL against Bluesky firehose
DuckDB for streaming data. Contribute to turbolytics/sql-flow development by creating an account on GitHub.
SQLFlow executes SQL against streaming data, such as Kafka or webhooks. High Throughput: Optimized to handle tens of thousands of messages per second using DuckDB, librdkafka, and confluent python Tumbling Window Aggregations: Perform aggregations over fixed intervals and output data once the interval is complete, enabling rollups like hourly or 10-minute summaries. This enables fast feedback local development before launching a SQLFlow consumer that reads from kafka.
Or read this on Hacker News