Get the latest tech news

A brief history of Notion's data catalog

From chaos to clarity: How Notion transformed its data catalog for better efficiency and insights with TypeScript, JSON Schema, and LLMs.

This disarray became a fundamental challenge that our engineering team needed to overcome in order to enhance data utility and governance as Notion grew and expanded our operations. Speed of implementation: Preexisting libraries (e.g., ts-json-schema-generator) for converting TypeScript definitions into JSON Schema accelerate development by leveraging familiar tools and minimizing the need for new infrastructure. With these large token windows we can provide our AI model with extensive metadata, thus ensuring that it has enough context to generate descriptions that rival those produced by the actual table owners.

Get the Android app