Blogs

Note: I love writing technical blogs. This is one of the new ways I’ve been learning, and honestly it is quite refreshing. I tackle most of the topics that I feel I can realte to other things I’ve learned, and draw parallels wherever necessary. They are done in breadth-first fashion, with room to go on rabbitholes as well. Enjoy!

Flex Attention - How to Scale Attention Models for Billion Users?
JAX - Why is everyone excited about this framework?
Arrakis - A toolkit to conduct, track and visualize mechanistic interpretability experiments
On High Agency and Work Ethic
Leviathan - Let’s modify and improve the Transformer model(from scratch)
Design for Generality