Get the latest tech news

Designing a Query Execution Engine

A push-based, morsel-driven execution engine for multi-tenancy

The majority of the technical ideas in this post were not invented at Chroma, and we reference research and systems from which we have generously borrowed techniques and architecture. This distinction results in an important property for our system - the control flow of the entire query in a push-based model is moved off of the stack. By moving the control flow off of the stack and into explicit code, as well as being able to push data into operators, the ability to dynamically parallelize, interrupt, and schedule a query becomes substantially easier.

Get the Android app