Kush Blogs
// The Library

Technical Deep Dives,
& systems logic.

Latest Updates

3. Maths4ML: Dot Product

Shadows, Angles, and the Geometry of Sameness

Dec 21, 2025 • 4 min read • #Maths for ML
›

2. Maths4ML: Distances & Norms

Measuring the gap - Rulers of ML

Dec 18, 2025 • 10 min read • #Maths for ML
›

1. Maths4ML: Vectors, Basis & Spans

The Building Blocks – Vectors, Basis & Spans

Dec 15, 2025 • 9 min read • #Maths for ML
›

11. NLP: Tokenizers

A detailed description about tokenizers in LLMs.

Dec 07, 2025 • 22 min read • #NLP
›

10. NLP: Mixture of Experts (MOE)

A guide on MoEs, their history and implementation in transformers along with the losses associated with it.

Sep 22, 2025 • 16 min read • #NLP #Transformers
›

9. NLP: Optimizing Attention

A guide on KV-Caching along with Sliding Window Attention. Ending with MQA and GQA.

Aug 05, 2025 • 34 min read • #NLP #Transformers
›

8. NLP: BERT

A guide on BERT models and how their architecture.

Jul 25, 2025 • 7 min read • #NLP #Transformers
›

7. NLP: Transformer Implementation

Implementation and trainig of Transformer for En-Hi machine translation task.

Jul 18, 2025 • 34 min read • #NLP #Transformers
›

4. NLP: Seq2Seq

A guide on Seq2Seq models that changed machine translation task.

May 19, 2025 • 8 min read • #NLP
›

3. NLP: Pytorch for NLP

Some tips for working with PyTorch for NLP tasks

May 10, 2025 • 16 min read • #NLP
›