- Inference Engine
Nov 24, 2025
•
35 min read
Building an infernece engine for machine translation transformer model in C++.
#Transformers
- 10. NLP: Mixture of Experts (MOE)
Sep 22, 2025
•
21 min read
A guide on MoEs, their history and implementation in transformers along with the losses associated with it.
#NLP
#Transformers
- 9. NLP: Optimizing Attention
Aug 05, 2025
•
42 min read
A guide on KV-Caching along with Sliding Window Attention. Ending with MQA and GQA.
#NLP
#Transformers
- 8. NLP: BERT
Jul 25, 2025
•
8 min read
A guide on BERT models and how their architecture.
#NLP
#Transformers
- 7. NLP: Transformer Implementation
Jul 18, 2025
•
37 min read
Implementation and trainig of Transformer for En-Hi machine translation task.
#NLP
#Transformers
- 6. NLP: Transformers
Jun 22, 2025
•
58 min read
A complete guide to the transformer architecture, attention mechanisms, and positional encoding.
#NLP
#Transformers