#transformers

• Inference Engine
  Nov 24, 2025 • 35 min read
  Building an infernece engine for machine translation transformer model in C++.
  #Transformers
• 10. NLP: Mixture of Experts (MOE)
  Sep 22, 2025 • 21 min read
  A guide on MoEs, their history and implementation in transformers along with the losses associated with it.
  #NLP #Transformers
• 9. NLP: Optimizing Attention
  Aug 05, 2025 • 42 min read
  A guide on KV-Caching along with Sliding Window Attention. Ending with MQA and GQA.
  #NLP #Transformers
• 8. NLP: BERT
  Jul 25, 2025 • 8 min read
  A guide on BERT models and how their architecture.
  #NLP #Transformers
• 7. NLP: Transformer Implementation
  Jul 18, 2025 • 37 min read
  Implementation and trainig of Transformer for En-Hi machine translation task.
  #NLP #Transformers
• 6. NLP: Transformers
  Jun 22, 2025 • 58 min read
  A complete guide to the transformer architecture, attention mechanisms, and positional encoding.
  #NLP #Transformers