Blogs

Blogs

Note: I love writing technical blogs. This is one of the new ways I’ve been learning, and honestly it is quite refreshing. I tackle most of the topics that I feel I can realte to other things I’ve learned, and draw parallels wherever necessary. They are done in breadth-first fashion, with room to go on rabbitholes as well. Enjoy!

  1. (Non-Technical) On my experience with hiring and making your career identity
  2. SDPA Optimization Case Study - Worklog
  3. Flex Attention - How to Scale Attention Models for Billion Users?
  4. JAX - Why is everyone excited about this framework?
  5. Arrakis - A toolkit to conduct, track and visualize mechanistic interpretability experiments
  6. On High Agency and Work Ethic
  7. Leviathan - Let’s modify and improve the Transformer model(from scratch)
  8. Design for Generality