Get the latest tech news
Dstack: An alternative to K8 for AI/ML tasks
dstack is an open-source alternative to Kubernetes, designed to simplify development, training, and deployment of AI across any cloud or on-prem. It supports NVIDIA, AMD, and TPU. - dstackai/dstack
Dev environments — for interactive development using a desktop IDE Tasks — for scheduling jobs (incl. distributed jobs) or running web apps Services — for deployment of models and web apps (with auto-scaling and authorization) Fleets — for managing cloud and on-prem clusters Volumes — for managing persisted volumes Gateways — for configuring the ingress traffic and public endpoints dstack automatically manages provisioning, job queuing, auto-scaling, networking, volumes, run failures, out-of-capacity errors, port-forwarding, and more — across clouds and on-prem clusters.
Or read this on Hacker News