Get the latest tech news
Transformer neural net learns to run Conway's Game of Life just from examples
The site of Sid
The following figure shows examples of the SingleAttentionNet model’s attention matrix, over the course of training: Life grids are generated randomly, to provide a limitless source of training pairs,(life_grid, next_life_grid). Life takes place on a 2D grid with cells that are either dead or alive, (represented by 0 or 1).
Or read this on Hacker News