Get the latest tech news

Which one is more important: more parameters or more computation? (2021)


we talk about the power of a deep learning model, often the only metric we pay attention to is its size, which is measured by the number parameters in that model. However, the amount of computation to run that model is an important metric too, but it is often overlooked because it is usually tied to the model size.

None

Get the Android app

Or read this on Hacker News

Read more on:

Photo of parameters

parameters

Photo of computation

computation

Related news:

News photo

TinyLoRA – Learning to Reason in 13 Parameters

News photo

Cory Doctorow on seizing the means on computation

News photo

All about Parameters and Widgets in Databricks Workflows (2024)