Kush Blogs
// The Library

Technical Deep Dives,
& systems logic.

Latest Updates

3. Maths4ML: Dot Product

Shadows, Angles, and the Geometry of Sameness

Dec 21, 2025 • 4 min read • #Maths for ML
›

2. Maths4ML: Distances & Norms

Measuring the gap - Rulers of ML

Dec 18, 2025 • 10 min read • #Maths for ML
›

1. Maths4ML: Vectors, Basis & Spans

The Building Blocks – Vectors, Basis & Spans

Dec 15, 2025 • 9 min read • #Maths for ML
›

11. NLP: Tokenizers

A detailed description about tokenizers in LLMs.

Dec 07, 2025 • 22 min read • #NLP
›

Inference Engine

Building an infernece engine for machine translation transformer model in C++.

Nov 24, 2025 • 32 min read • #Transformers
›

10. NLP: Mixture of Experts (MOE)

A guide on MoEs, their history and implementation in transformers along with the losses associated with it.

Sep 22, 2025 • 16 min read • #NLP #Transformers
›

9. NLP: Optimizing Attention

A guide on KV-Caching along with Sliding Window Attention. Ending with MQA and GQA.

Aug 05, 2025 • 34 min read • #NLP #Transformers
›

8. NLP: BERT

A guide on BERT models and how their architecture.

Jul 25, 2025 • 7 min read • #NLP #Transformers
›

7. NLP: Transformer Implementation

Implementation and trainig of Transformer for En-Hi machine translation task.

Jul 18, 2025 • 34 min read • #NLP #Transformers
›

6. NLP: Transformers

A complete guide to the transformer architecture, attention mechanisms, and positional encoding.

Jun 22, 2025 • 45 min read • #NLP #Transformers
›