Get the latest tech news
A return to hand-written notes by learning to read and write
& write October 28, 2024 Blagoj Mitrevski, Software Engineer, and Andrii Maksai, Staff Software Engineer, Google Research We present a model to convert photos of handwriting into a digital format that reproduces component pen strokes, without the need for specialized equipment. Digital note-taking is gaining popularity, offering a durable, editable, and easily indexable way of storing notes in a vectorized form.
To address the first problem while avoiding onerous data collection, we propose a multi-task training setup that combines recognition and derendering tasks. This approach thus differs from methods that rely on geometric constructs, where gradients, contours, and shapes in an image are utilized to extract writing strokes. We show that our method is robust to a variety of inputs, can work on full handwritten notes, and generalizes to out-of-domain sketches to some extent.
Or read this on Hacker News
