Sujay Kapadnis
Essays · Notes · Research

Writing

Long-form notes on AI, machine learning, statistics, systems, and the ideas I am currently trying to understand.

GPU Racks and NV Switches

internal communication of a MoE model

May 24, 2026 4 min read Substack

Rethinking Real-Time AI Interactions

How continuous multimodal models can replace turn-based conversation systems

May 18, 2026 4 min read Substack

MoE Parallelism

how modern AI models split the work

May 14, 2026 5 min read Substack

How batch size affects token cost and speed

batch sizes, empty seats, and the economics of speed

May 13, 2026 4 min read Substack

KV Cache

Everything comes at a cost

May 12, 2026 4 min read Substack

Speculative Decoding

understanding how AIs learned to write faster

May 04, 2026 5 min read Substack

What's a Roofline Model?

notes on a visual performance model

May 03, 2026 5 min read Substack

Everyday Entropy

see how small rituals help us bring order to all the chaos around us

February 23, 2026 4 min read Substack

Ambuja Cement

They don't make ads like this anymore...

February 22, 2026 3 min read Substack

Thinkin Park

where ideas go for a walk

February 13, 2026 3 min read Substack

Minority Report : Special Edition

a small peek is all you need to see the whole picture

February 11, 2026 6 min read Substack

I Don't Want to Do Nothing

On productivity culture, information overload, and why our brains need space to just exist

February 09, 2026 5 min read Substack

A Mysterious Dream

The Mystery of Dreams and the Architecture of Time

January 18, 2026 5 min read Substack

A Literal Silver Lining

an explainer on recent surge of silver prices

January 06, 2026 5 min read Substack

Can You Just Walk Through Walls?

a nobel prize winners explanation

January 05, 2026 6 min read Substack

Discovered Focus, 69k pieces of paper

random late night draft

January 02, 2026 2 min read Substack

What if the Light wasn't the Problem?

a question that led to theory of relativity

January 01, 2026 5 min read Substack

2025 Wrapped

A recap of the movies, books, music, and ideas I loved in 2025

December 30, 2025 2 min read Substack

A Simple Idea behind World Models

we've never experienced reality, it was just what our brains thought would happen

December 29, 2025 5 min read Substack

Notes to Myself

some advices for future me

December 27, 2025 3 min read Substack

Behind Video Call Glitches #2

the technique that let's you facetime your partner

December 26, 2025 4 min read Substack

Behind Video Call Glitches

unraveling the technology behind Video Calls

December 24, 2025 8 min read Substack

1729

remembering maths on birth anniversary of Ramanujan

December 23, 2025 3 min read Substack

Notes on Coursera building learning tools

Goal Understanding the process of implementing AI Evals with the case of Coursera 1. Scaling Automation 1.1. Pre-Framework Challenges Fragmented offline jobs in spreadsheets Human Labeling…

July 21, 2025 3 min read

Attending Transformers.

I had the rough idea of transformers architecture from the famous Attention is all you need paper, which took everything by storm, because AI has existed for many decades now but until now…

June 10, 2025 3 min read

Blockchain Explained

The Basics: Blockchain Structure and Nodes Blockchain is a decentralized system where transaction records (in blocks) are stored across a distributed network of computers (nodes). The…

May 02, 2025 3 min read

Markov Chain Monte Carlo (MCMC) - No BS

Have been reading this article for a while now and it's a great read, thus taking my own notes to understand it better. What is Markov Chain Monte Carlo (MCMC)? To put it simply, it's a…

April 17, 2025 8 min read

MCP

This are my notes on Model Context Protocol (MCP) maintained by Apic. Models are as good as the context given to them. What is MCP? It's an open protocol that enables seamless integration…

March 30, 2025 2 min read

Decoding LLMs

LLMs are impressive of course, but their mysterious black box nature still remains unknown about how things are happening the way they are. We are just aware that this architecture is being…

March 28, 2025 9 min read

Quantum Computers

This is the second post of Quantum Computers Series, if you haven't already, please check out my first post on computers. Let's get started! Post 1 Enter the Quantum Computer! ✨ Quantum…

March 02, 2025 2 min read

What's a Computer, Anyway.

This is the first post in the series of Quantum Computer, to understand what Quantum computers are, we first need to understand what's a computer, actually? What Even Is a Computer? 🤔…

March 02, 2025 2 min read

Central Limit Theorem

Have you ever participated in a poll? or any process that may have collected data that represents you and also from other variety of people. Today’s topic will explain intution behind…

Feb 23, 2025 4 min read

Slowly Changing Dimensions

SCDs are dimensions that change over time, these changes are not very frequent. For example the price of the product, the change will usually happen because of the inflation. Types of SCDs…

Feb 21, 2025 5 min read