Get the latest tech news
Fire-Flyer File System from DeepSeek
A high-performance distributed file system designed to address the challenges of AI training and inference workloads. - GitHub - deepseek-ai/3FS: A high-performance distributed file system design...
It leverages modern SSDs and RDMA networks to provide a shared storage layer that simplifies development of distributed applications. Dataloaders Eliminates the need for prefetching or shuffling datasets by enabling random access to training samples across compute nodes. KVCache for Inference Provides a cost-effective alternative to DRAM-based caching, offering high throughput and significantly larger capacity.
Or read this on Hacker News