Get the latest tech news

Dstack: An alternative to K8 for AI/ML tasks


dstack is an open-source alternative to Kubernetes, designed to simplify development, training, and deployment of AI across any cloud or on-prem. It supports NVIDIA, AMD, and TPU. - dstackai/dstack

Dev environments — for interactive development using a desktop IDE Tasks — for scheduling jobs (incl. distributed jobs) or running web apps Services — for deployment of models and web apps (with auto-scaling and authorization) Fleets — for managing cloud and on-prem clusters Volumes — for managing persisted volumes Gateways — for configuring the ingress traffic and public endpoints dstack automatically manages provisioning, job queuing, auto-scaling, networking, volumes, run failures, out-of-capacity errors, port-forwarding, and more — across clouds and on-prem clusters.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of alternative

alternative

Photo of AI/ML

AI/ML

Photo of Dstack

Dstack

Related news:

News photo

ModelKit: Transforming AI/ML artifact sharing and management across lifecycles

News photo

Open Source on its own is no alternative to Big Tech

News photo

An Alternative to Rewriting Memory-Unsafe Code in Rust: the 'Safe C++ Extensions' Proposal