Get the latest tech news
Databases for Data Scientist – And why you probably don't need one
And why you probably dont need one
Data scientists are coming to terms with the fact that they have to work with databases if they want their analytics to scale. With the ubiquity of parquet and tools like apache arrow and DuckDB, there’s a good chance that for what you want to accomplish in your analytical workflow, you don’t need a fully fledged database. Before you say you need Postgres for analytics, instead, try parquet (and with hive partitioning if your data are larger) with DuckDB and Apache Arrow.
Or read this on Hacker News
