Interactive Notes on RLHF, Attention, LoRA and LLM Evals
Original title: Show HN: Interactive notes on RLHF, attention, LoRA and LLM evals
42AI Score
A developer released interactive technical notes covering core concepts like RLHF, attention mechanisms, LoRA, and LLM evaluations. The resource allows users to modify inputs to intuitively understand engineering principles, serving as a supplementary learning tool for AI practitioners.
Related Entities
Full Report
Contents3 sections
Engineering ideas you understand by changing the inputs.
Evals
The map of evalsStart here
- Is 82% better than 80%?
- Exact match and F1
- Precision, recall and reciprocal rank
- nDCG@k
- pass@k
- LLM as judge
- Pairwise preference and Elo
- Human agreement and kappa
- RAG evals
- Agent evals
- Online evals and A/B tests
- Contamination and Goodhart
Machine learning
Search and ranking
Notes I keep for myself, added as I learn. Found a mistake? · Source · Analytics choice
Allow Google Analytics to count page views? It sets cookies. Nothing else on this site tracks you.