Kush Blogs

Exploration &
Engineering

I write about machine learning, deep learning and lately more about NLP.

Latest Updates
Dec 18 2025

2. Maths4ML: Distances & Norms

Measuring the gap - Rulers of ML

12 min read • #Maths for ML
›
Dec 15 2025

1. Maths4ML: Vectors, Basis & Spans

The Building Blocks – Vectors, Basis & Spans

11 min read • #Maths for ML
›
Dec 07 2025

11. NLP: Tokenizers

A detailed description about tokenizers in LLMs.

25 min read • #NLP
›
Sep 22 2025

10. NLP: Mixture of Experts (MOE)

A guide on MoEs, their history and implementation in transformers along with the losses associated with it.

21 min read • #NLP #Transformers
›
Aug 05 2025

9. NLP: Optimizing Attention

A guide on KV-Caching along with Sliding Window Attention. Ending with MQA and GQA.

42 min read • #NLP #Transformers
›
Jul 25 2025

8. NLP: BERT

A guide on BERT models and how their architecture.

8 min read • #NLP #Transformers
›
Jul 18 2025

7. NLP: Transformer Implementation

Implementation and trainig of Transformer for En-Hi machine translation task.

37 min read • #NLP #Transformers
›
May 19 2025

4. NLP: Seq2Seq

A guide on Seq2Seq models that changed machine translation task.

8 min read • #NLP
›
May 10 2025

3. NLP: Pytorch for NLP

Some tips for working with PyTorch for NLP tasks

18 min read • #NLP
›
May 08 2025

2. NLP: LSTM & GRU

A guide on LSTM and GRU models and how they overcome limitations of RNNs.

7 min read • #NLP
›