Pinned
- One of the best articles I've read these days. A very practical guide for ML research. I should re-read it every now and then to improve my workflow. → joschu.net/blog/opinionat…
- One type of freedom worth striving for: Be so good people can no longer dictate your terms.
- 📝 Finetuning Foundation Models A week ago, I wrote about building the GPT foundation model from scratch [0] [1], and while writing it, I set one section apart for a separate article. This part is about finetuning the foundation model. The example is similar to what was shown𝗕𝘂𝗶𝗹𝗱𝗶𝗻𝗴 𝗮 𝗚𝗣𝗧 𝗠𝗼𝗱𝗲𝗹 For the past few weeks, I've been reading about Foundation Models [0] and decided to work on the implementation of the GPT architecture [1] to understand its building blocks and how it works under the hood. Here are the concepts I worked on
- This resonates a lot with my experience. My record was 60 books a year (not 80 in 6 months tho). Because I'm curious about a lot of things, many topics get my attention, so the "Parallelize" (books) tip is a really effective way to read more book. I read 3-4 at the same time, a
