Blogs

Blogs

Note: I love writing technical blogs. This is one of the new ways I’ve been learning, and honestly it is quite refreshing. I tackle most of the topics that I feel I can realte to other things I’ve learned, and draw parallels wherever necessary. They are done in breadth-first fashion, with room to go on rabbitholes as well. Enjoy!

  1. Flex Attention - How to Scale Attention Models for Billion Users?
  2. JAX - Why is everyone excited about this framework?
  3. Arrakis - A toolkit to conduct, track and visualize mechanistic interpretability experiments
  4. On High Agency and Work Ethic
  5. Leviathan - Let’s modify and improve the Transformer model(from scratch)
  6. Design for Generality