Get the latest tech news
Depth Pro: Sharp monocular metric depth in less than a second
Depth Pro: Sharp Monocular Metric Depth in Less Than a Second. - apple/ml-depth-pro
We present a foundation model for zero-shot metric monocular depth estimation. The predictions are metric, with absolute scale, without relying on the availability of metadata such as camera intrinsics. These characteristics are enabled by a number of technical contributions, including an efficient multi-scale vision transformer for dense prediction, a training protocol that combines real and synthetic datasets to achieve high metric accuracy alongside fine boundary tracing, dedicated evaluation metrics for boundary accuracy in estimated depth maps, and state-of-the-art focal length estimation from a single image.
Or read this on Hacker News