Blogs

Note: I love writing technical blogs. This is one of the new ways I’ve been learning, and honestly it is quite refreshing. I tackle most of the topics that I feel I can relate to other things I’ve learned, and draw parallels wherever necessary. They are done in breadth-first fashion, with room to go on rabbitholes as well. Enjoy!

Elixr: What if PyTorch Used Complex Numbers?
Safe SQL: A Seatbelt for Your Database
grove: I built Obsidian for the terminal
Do LLMs Have a Secret Interlingua? Testing GPT-2’s Hinglish Comprehension with Sparse Autoencoders
What Happens When You Run BPE on Encrypted Text?
Using MCTS to Navigate Sparse Autoencoder Feature Space
Shoving NEAT into JAX: When Evolving Topologies Meet Static Computation Graphs
pairy: AI pair programming the way I like it
I built Git from scratch. Here’s what I learned.
(Non Technical) Building and Maintaining Software is an Art
(Non Technical) On the Ancient Sport of Hacking
Cadence: Program Evolution via Large Language Models
(Non-Technical) I’m a Tool Guy
REALBT - A Simple Backtesting Engine in Pure Python
(Non-Technical) On my experience with hiring and making your career identity
SDPA Optimization Case Study - Worklog
Flex Attention - How to Scale Attention Models for Billion Users?
JAX - Why is everyone excited about this framework?
Arrakis - A toolkit to conduct, track and visualize mechanistic interpretability experiments
On High Agency and Work Ethic
Leviathan - Let’s modify and improve the Transformer model(from scratch)
Design for Generality