Blogs
Blogs
Note: I love writing technical blogs. This is one of the new ways I’ve been learning, and honestly it is quite refreshing. I tackle most of the topics that I feel I can realte to other things I’ve learned, and draw parallels wherever necessary. They are done in breadth-first fashion, with room to go on rabbitholes as well. Enjoy!
- Flex Attention - How to Scale Attention Models for Billion Users?
- JAX - Why is everyone excited about this framework?
- Arrakis - A toolkit to conduct, track and visualize mechanistic interpretability experiments
- On High Agency and Work Ethic
- Leviathan - Let’s modify and improve the Transformer model(from scratch)
- Design for Generality