Get the latest tech news
20x Faster Background Removal in the Browser Using ONNX Runtime with WebGPU
Achieve 20x Faster Background Removal in the Browser
Most state-of-the-art background removal solutions work by offloading the task to the server with a GPU as it was simply infeasible to run the NN on the client. WebGPU is a modern web API that enables developers to utilize GPU power for high-performance computations, offering a significant performance boost over CPU-based in-browser machine learning. Leveraging the fp16 model compression, we re-ran the benchmarks and got similar results as before, but with half the bandwidth required to download the network for the first time application.
Or read this on Hacker News
