transformers

• 13. NLP: Positional Encodings
  Feb 16, 2026 • 13 min read
  The transformer’s way of remembering who stood where, because attention without order is chaos with confidence.
  #NLP #Transformers
• Inference Engine
  Nov 24, 2025 • 32 min read
  Building an infernece engine for machine translation transformer model in C++.
  #Transformers
• 10. NLP: Mixture of Experts (MOE)
  Sep 22, 2025 • 16 min read
  A guide on MoEs, their history and implementation in transformers along with the losses associated with it.
  #NLP #Transformers
• 9. NLP: Optimizing Attention
  Aug 05, 2025 • 34 min read
  A guide on KV-Caching along with Sliding Window Attention. Ending with MQA and GQA.
  #NLP #Transformers
• 8. NLP: BERT
  Jul 25, 2025 • 7 min read
  A guide on BERT models and how their architecture.
  #NLP #Transformers
• 7. NLP: Transformer Implementation
  Jul 18, 2025 • 34 min read
  Implementation and trainig of Transformer for En-Hi machine translation task.
  #NLP #Transformers
• 6. NLP: Transformers
  Jun 22, 2025 • 45 min read
  A complete guide to the transformer architecture, attention mechanisms, and positional encoding.
  #NLP #Transformers