Get the latest tech news
Show HN: Pathway – Build Mission Critical ETL and RAG in Python (NATO, F1 Used)
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG. - pathwaycom/pathway
Pathway code is versatile and robust: you can use it in both development and production environments, handling both batch and streaming data effectively. Your Pathway code, despite being written in Python, is run by the Rust engine, enabling multithreading, multiprocessing, and distributed computations. Wrappers for most common LLM services and utilities are included, making working with LLMs and RAGs pipelines incredibly easy.
Or read this on Hacker News