LLMs: Fine-tuning and Alignment

40 hoursAdvanced5 modules

3 of 5 modules with a published syllabus

0 of 5 modules recorded

Syllabus

Concentrates the advanced core of the shared trunk — the Transformer architecture with attention implemented from scratch, fine-tuning and transfer learning with LoRA/QLoRA, and training optimisation with mixed precision and schedulers — and adds the two level-300 modules of the NLP area: fine-tuning LLMs in practice, and alignment (RLHF/DPO).

Modules of this programme

The same objects as the full curriculum. A module opened from any programme that contains it is the same module, with the same syllabus and the same status.

Code	Module	Content	Hands-on	Status	Price
CORE-301	The Transformer architecture	Attention, embeddings, positional encoding, encoder/decoder	Implement attention from scratch and visualise it	Syllabus published	R$ 240US$ 80MX$ 1,000estimated price0 of 1 module published
CORE-302	Fine-tuning and transfer learning	LoRA/QLoRA, layer freezing, datasets	Fine-tune an open-source model	Syllabus published	R$ 240US$ 80MX$ 1,000estimated price0 of 1 module published
CORE-303	Training optimisation	Mixed precision, schedulers, distributed basics	Make a training run 3× faster	Syllabus published	R$ 240US$ 80MX$ 1,000estimated price0 of 1 module published
NLP-301	Fine-tuning LLMs in practice	Detailed syllabus not written yet	—	Syllabus published
NLP-302	Alignment (RLHF/DPO — fundamentals)	Detailed syllabus not written yet	—	Syllabus published

CORE-301Syllabus published
The Transformer architecture
Content
Attention, embeddings, positional encoding, encoder/decoder
Hands-on
Implement attention from scratch and visualise it
R$ 240US$ 80MX$ 1,000estimated price0 of 1 module published
CORE-302Syllabus published
Fine-tuning and transfer learning
Content
LoRA/QLoRA, layer freezing, datasets
Hands-on
Fine-tune an open-source model
R$ 240US$ 80MX$ 1,000estimated price0 of 1 module published
CORE-303Syllabus published
Training optimisation
Content
Mixed precision, schedulers, distributed basics
Hands-on
Make a training run 3× faster
R$ 240US$ 80MX$ 1,000estimated price0 of 1 module published
NLP-301Syllabus published
Fine-tuning LLMs in practice
Detailed syllabus not written yet
NLP-302Syllabus published
Alignment (RLHF/DPO — fundamentals)
Detailed syllabus not written yet

Not everything fits into 40 hours. State of the art, distributed training, interpretability, edge deployment and the five integrative projects exist only inside the complete tracks: Tracks