Working Notes: a commonplace notebook for recording & exploring ideas.
Home. Site Map. Letters. More at expLog.
— Kunal
A public commonplace notebook to capture notes as I learn and explore. Links are unstable and will change as I refactor. All pages are published under the site map.
My current interests are mainly focused around learning more about building LLMs, the math around transformers and becoming deeply familiar with training dynamics.
To navigate this website: there are different kinds of pages: notes are meant for myself, taken while accumulating information; logs are a running commentary over time where I consolidate what I've been learning or working on; essays are (ideally) coherent pieces of writing meant for others to read.