Large Language Models

LLM Training & GPU Memory Requirements: Examples

As data scientists and MLOps Engineers, you must have come across the challenges related to managing GPU requirements for training…

2 years ago

Instruction Fine-tuning LLM Explained with Examples

A pre-trained or foundation model is further trained (or fine-tuned) with instructions datasets to help them learn about your specific…

2 years ago

Distributed LLM Training & DDP, FSDP Patterns: Examples

Training large language models (LLMs) like GPT-4 requires the use of distributed computing patterns as there is a need to…

2 years ago

Attention Mechanism Workflow & Transformer: Examples

The attention mechanism workflow in the context of transformers in NLP, is a process that enables the model to dynamically…

2 years ago

NLP: Different Types of Language Models – Examples

Have you ever wondered how your smartphone seems to know exactly what you're going to type next? Or how virtual…

2 years ago

Large Language Models (LLMs) & Semantic Search: Examples

Have you ever marveled at how typing a few words into a search engine yields exactly the information you're looking…

2 years ago