I’ve tried reading this many times. But it’s sooooo long. Is it worth it? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		oofbey 13 days ago \| parent \| context \| favorite \| on: A Mathematical Framework for Transformer Circuits ... I’ve tried reading this many times. But it’s sooooo long. Is it worth it?
		help

robrenaud 13 days ago | [–]

Neal Nanda's walkthrough of it is pretty good.

https://youtu.be/KV5gbOmHbjU?is=GSiv0rSHBocNdU8l

Also long, but it's detailed and complicated, so there is no escaping that.

thesz 13 days ago | | [–]

  > no escaping

"There is no Royal road to ..."

https://en.wikipedia.org/wiki/Royal_Road#A_metaphorical_%22R...

Bluestein 13 days ago | | | [–]

This is a gem.-

Bluestein 13 days ago | [–]

Depending on your field, degree of interest, general curiosity, its a must. Its up there with word2vec.-

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact