Core concepts
LLMs, prompting, embeddings, RAG and agents.
253 pages
- A2Aprotocols · mid · conceptualTool protocols
- A2A tasks & artifactsprotocols · mid · conceptualTool protocols
- A2A vs MCPprotocols · mid · conceptualTool protocols
- ACL-aware RAGrag · mid · conceptualEmbeddings, search & RAG
- Adaptation decision treefine-tuning · mid · conceptualModel adaptation
- Adapter servingfine-tuning · mid · conceptualModel adaptation
- Adaptersfine-tuning · mid · conceptualModel adaptation
- Agentagents · mid · conceptualAgents & orchestration
- Agent cardsprotocols · mid · conceptualTool protocols
- Agent evaluationagents · mid · conceptualAgents & orchestration
- Agent handoffsagents · mid · conceptualAgents & orchestration
- Agent identityagents · mid · conceptualAgents & orchestration
- Agent loopagents · mid · conceptualAgents & orchestration
- Agent vs chatbot vs workflowagents · mid · conceptualAgents & orchestration
- Agentic RAGrag · mid · conceptualEmbeddings, search & RAG
- AI application lifecyclefundamentals · junior · conceptualOrientation
- AI quality attributesfundamentals · junior · conceptualOrientation
- AI vs ML vs data vs researchfundamentals · junior · conceptualOrientation
- ANNrag · mid · conceptualEmbeddings, search & RAG
- ASRmultimodal · mid · conceptualMultimodal, vision & voice
- Audio representationsmultimodal · mid · conceptualMultimodal, vision & voice
- Audio tokensmultimodal · mid · conceptualMultimodal, vision & voice
- Audio understandingmultimodal · mid · conceptualMultimodal, vision & voice
- Authorisation & securityprotocols · mid · conceptualTool protocols
- Autoregressive generationllm · mid · conceptualLLM applications
- Backpropagationllm · mid · conceptualDeep learning & transformers
- Batching & concurrencyllm · mid · conceptualLLM applications
- BM25rag · mid · conceptualEmbeddings, search & RAG
- Build vs buyfundamentals · junior · conceptualOrientation
- Catastrophic forgettingfine-tuning · mid · conceptualModel adaptation
- Causal maskingllm · mid · conceptualDeep learning & transformers
- Chain-of-thoughtprompting · mid · conceptualPrompting & context engineering
- Chat templatesllm · mid · conceptualLLM applications
- Choosing the right problemfundamentals · junior · conceptualOrientation
- Chunkingrag · mid · conceptualEmbeddings, search & RAG
- Chunking strategiesrag · mid · conceptualEmbeddings, search & RAG
- Citation validationrag · mid · conceptualEmbeddings, search & RAG
- Citationsrag · mid · conceptualEmbeddings, search & RAG
- Code retrievalrag · mid · conceptualEmbeddings, search & RAG
- Communication & shared stateagents · mid · conceptualAgents & orchestration
- Compressionprompting · mid · conceptualPrompting & context engineering
- Computer useagents · mid · conceptualAgents & orchestration
- Context assemblyrag · mid · conceptualEmbeddings, search & RAG
- Context budgetllm · mid · conceptualLLM applications
- Context engineeringprompting · mid · conceptualPrompting & context engineering
- Context orderingprompting · mid · conceptualPrompting & context engineering
- Context selectionprompting · mid · conceptualPrompting & context engineering
- Context windowllm · mid · conceptualDeep learning & transformers
- Contextual retrievalrag · mid · conceptualEmbeddings, search & RAG
- Conversation stateprompting · mid · conceptualPrompting & context engineering
- Cross-attentionllm · mid · conceptualDeep learning & transformers
- Cross-encodersrag · mid · conceptualEmbeddings, search & RAG
- Cross-modal retrievalmultimodal · mid · conceptualMultimodal, vision & voice
- Data qualityfine-tuning · mid · conceptualModel adaptation
- Dataset constructionfine-tuning · mid · conceptualModel adaptation
- Decodingllm · mid · conceptualLLM applications
- Decompositionprompting · mid · conceptualPrompting & context engineering
- Dense retrievalrag · mid · conceptualEmbeddings, search & RAG
- Deterministic vs probabilistic softwarefundamentals · junior · conceptualOrientation
- Distillationfine-tuning · mid · conceptualModel adaptation
- Document understandingmultimodal · mid · conceptualMultimodal, vision & voice
- Document versioningrag · mid · conceptualEmbeddings, search & RAG
- Durable executionagents · mid · conceptualAgents & orchestration
- Embedding modelsrag · mid · conceptualEmbeddings, search & RAG
- Embeddingsrag · mid · conceptualEmbeddings, search & RAG
- Encoder/decoderllm · mid · conceptualDeep learning & transformers
- Example selectionprompting · mid · conceptualPrompting & context engineering
- Feed-forward blockllm · mid · conceptualDeep learning & transformers
- Few-shotprompting · mid · conceptualPrompting & context engineering
- Fine-tuning evaluationfine-tuning · mid · conceptualModel adaptation
- Forward passllm · mid · conceptualDeep learning & transformers
- Foundation modelsllm · mid · conceptualLLM applications
- Full fine-tuningfine-tuning · mid · conceptualModel adaptation
- GQA & MQAllm · mid · conceptualDeep learning & transformers
- GraphRAGrag · mid · conceptualEmbeddings, search & RAG
- Greedy/beamllm · mid · conceptualLLM applications
- Grounded generationrag · mid · conceptualEmbeddings, search & RAG
- Guardrailsagents · mid · conceptualAgents & orchestration
- Hallucinationllm · mid · conceptualLLM applications
- Hardwarellm · mid · conceptualDeep learning & transformers
- HNSW/IVF/PQrag · mid · conceptualEmbeddings, search & RAG
- Host/client/serverprotocols · mid · conceptualTool protocols
- Human approvalagents · mid · conceptualAgents & orchestration
- Human-in-the-loop designfundamentals · junior · conceptualOrientation
- Hybrid searchrag · mid · conceptualEmbeddings, search & RAG
- HyDErag · mid · conceptualEmbeddings, search & RAG
- Idempotent toolsagents · mid · conceptualAgents & orchestration
- Image generationmultimodal · mid · conceptualMultimodal, vision & voice
- Image patchesmultimodal · mid · conceptualMultimodal, vision & voice
- Image understandingmultimodal · mid · conceptualMultimodal, vision & voice
- Incremental indexingrag · mid · conceptualEmbeddings, search & RAG
- Indexingrag · mid · conceptualEmbeddings, search & RAG
- Inferencellm · mid · conceptualLLM applications
- Ingestionrag · mid · conceptualEmbeddings, search & RAG
- Instruction hierarchyprompting · mid · conceptualPrompting & context engineering
- Instruction rolesllm · mid · conceptualLLM applications
- Instruction tuningfine-tuning · mid · conceptualModel adaptation
- Interrupts & resumeagents · mid · conceptualAgents & orchestration
- Inverted indexrag · mid · conceptualEmbeddings, search & RAG
- IRrag · mid · conceptualEmbeddings, search & RAG
- KV cachellm · mid · conceptualDeep learning & transformers
- Language modellingllm · mid · conceptualDeep learning & transformers
- Lexical searchrag · mid · conceptualEmbeddings, search & RAG
- Lifecycle & transportsprotocols · mid · conceptualTool protocols
- LLMllm · mid · conceptualLLM applications
- Loadersrag · mid · conceptualEmbeddings, search & RAG
- Logits & softmaxllm · mid · conceptualLLM applications
- Long-context attentionllm · mid · conceptualDeep learning & transformers
- Long-context trade-offsprompting · mid · conceptualPrompting & context engineering
- LoRAfine-tuning · mid · conceptualModel adaptation
- MCPprotocols · mid · conceptualTool protocols
- MCP vs function calling vs RESTprotocols · mid · conceptualTool protocols
- Memory typesagents · mid · conceptualAgents & orchestration
- Memory vs contextprompting · mid · conceptualPrompting & context engineering
- Messagesllm · mid · conceptualLLM applications
- Metadata enrichmentrag · mid · conceptualEmbeddings, search & RAG
- Metadata filteringrag · mid · conceptualEmbeddings, search & RAG
- MLPllm · mid · conceptualDeep learning & transformers
- MMRrag · mid · conceptualEmbeddings, search & RAG
- Model landscapellm · mid · conceptualLLM applications
- Model mergingfine-tuning · senior · conceptualModel adaptation
- Model selectionllm · mid · conceptualLLM applications
- MoEllm · mid · conceptualDeep learning & transformers
- Multi-agentagents · mid · conceptualAgents & orchestration
- Multi-agent patternsagents · mid · conceptualAgents & orchestration
- Multi-head attentionllm · mid · conceptualDeep learning & transformers
- Multi-hoprag · mid · conceptualEmbeddings, search & RAG
- Multi-queryrag · mid · conceptualEmbeddings, search & RAG
- Multimodal embeddingsmultimodal · mid · conceptualMultimodal, vision & voice
- Multimodal modelsmultimodal · mid · conceptualMultimodal, vision & voice
- Multimodal RAGrag · mid · conceptualEmbeddings, search & RAG
- Multimodal safetymultimodal · mid · conceptualMultimodal, vision & voice
- Neural networksllm · mid · conceptualDeep learning & transformers
- Observation designagents · mid · conceptualAgents & orchestration
- OCR/layoutrag · mid · conceptualEmbeddings, search & RAG
- Open vs closedllm · mid · conceptualLLM applications
- OpenAPI tool generationprotocols · mid · conceptualTool protocols
- Output contractsprompting · mid · conceptualPrompting & context engineering
- Overlaprag · mid · conceptualEmbeddings, search & RAG
- Parent-childrag · mid · conceptualEmbeddings, search & RAG
- Parsingrag · mid · conceptualEmbeddings, search & RAG
- PEFTfine-tuning · mid · conceptualModel adaptation
- Planningagents · mid · conceptualAgents & orchestration
- Positional encodingllm · mid · conceptualDeep learning & transformers
- PPO/DPO/GRPOfine-tuning · mid · conceptualModel adaptation
- Predictive vs generativefundamentals · junior · conceptualOrientation
- Preference datafine-tuning · mid · conceptualModel adaptation
- Prefill & decodellm · mid · conceptualDeep learning & transformers
- Pretraining objectivesllm · mid · conceptualDeep learning & transformers
- Progressive disclosureprompting · mid · conceptualPrompting & context engineering
- Prompt anatomyprompting · mid · conceptualPrompting & context engineering
- Prompt cachingllm · mid · conceptualLLM applications
- Prompt chainingprompting · mid · conceptualPrompting & context engineering
- Prompt engineeringprompting · mid · conceptualPrompting & context engineering
- Prompt optimisationprompting · mid · conceptualPrompting & context engineering
- Prompt testingprompting · mid · conceptualPrompting & context engineering
- Prompt versioningprompting · mid · conceptualPrompting & context engineering
- Prototype vs productionfundamentals · junior · conceptualOrientation
- Provider APIsllm · mid · conceptualLLM applications
- Provider reliabilityllm · mid · conceptualLLM applications
- Q/K/Vllm · mid · conceptualDeep learning & transformers
- QLoRAfine-tuning · mid · conceptualModel adaptation
- Query decompositionrag · mid · conceptualEmbeddings, search & RAG
- Query routingrag · mid · conceptualEmbeddings, search & RAG
- Query understandingrag · mid · conceptualEmbeddings, search & RAG
- RAGrag · mid · conceptualEmbeddings, search & RAG
- RAG evaluationrag · mid · conceptualEmbeddings, search & RAG
- RAG failuresrag · mid · conceptualEmbeddings, search & RAG
- RAG vs fine-tuningrag · mid · conceptualEmbeddings, search & RAG
- ReActagents · mid · conceptualAgents & orchestration
- Reasoning modelsllm · mid · conceptualLLM applications
- Reflectionagents · mid · conceptualAgents & orchestration
- Refusals & moderationllm · mid · conceptualLLM applications
- Rerankingrag · mid · conceptualEmbeddings, search & RAG
- Residuals & layer normllm · mid · conceptualDeep learning & transformers
- Retrieval as contextprompting · mid · conceptualPrompting & context engineering
- Retrieval fusion (RRF)rag · mid · conceptualEmbeddings, search & RAG
- Retrieval observabilityrag · mid · conceptualEmbeddings, search & RAG
- Reward modelsfine-tuning · mid · conceptualModel adaptation
- RLHFfine-tuning · mid · conceptualModel adaptation
- RMSNormllm · mid · conceptualDeep learning & transformers
- Rollback & compensationagents · mid · conceptualAgents & orchestration
- Routingagents · mid · conceptualAgents & orchestration
- Rules vs model decisionsfundamentals · junior · conceptualOrientation
- Sampling parametersllm · mid · conceptualLLM applications
- Sampling/elicitation/tasksprotocols · mid · conceptualTool protocols
- Sandboxingagents · mid · conceptualAgents & orchestration
- Scaled dot-product attentionllm · mid · conceptualDeep learning & transformers
- Scaling lawsllm · mid · conceptualDeep learning & transformers
- Schedulingagents · mid · conceptualAgents & orchestration
- Self-attentionllm · mid · conceptualDeep learning & transformers
- Self/corrective RAGrag · mid · conceptualEmbeddings, search & RAG
- Semantic cachingrag · mid · conceptualEmbeddings, search & RAG
- Semantic searchrag · mid · conceptualEmbeddings, search & RAG
- Server designprotocols · mid · conceptualTool protocols
- SFTfine-tuning · mid · conceptualModel adaptation
- Short/long-term memoryagents · mid · conceptualAgents & orchestration
- Similarity metricsrag · mid · conceptualEmbeddings, search & RAG
- Single-agentagents · mid · conceptualAgents & orchestration
- Sparse retrievalrag · mid · conceptualEmbeddings, search & RAG
- Spatial & motionmultimodal · senior · conceptualMultimodal, vision & voice
- Speech-to-speechmultimodal · mid · conceptualMultimodal, vision & voice
- State & checkpointsagents · mid · conceptualAgents & orchestration
- State machinesagents · mid · conceptualAgents & orchestration
- Stop conditionsagents · mid · conceptualAgents & orchestration
- Stop sequencesllm · mid · conceptualLLM applications
- Streamingllm · mid · conceptualLLM applications
- Streaming audiomultimodal · mid · conceptualMultimodal, vision & voice
- Structured outputsllm · mid · conceptualLLM applications
- Structured promptingprompting · mid · conceptualPrompting & context engineering
- Structured RAGrag · mid · conceptualEmbeddings, search & RAG
- Subagentsagents · mid · conceptualAgents & orchestration
- Subword tokenisationllm · mid · conceptualDeep learning & transformers
- Synthetic datafine-tuning · mid · conceptualModel adaptation
- System boundariesfundamentals · junior · conceptualOrientation
- Templatesprompting · mid · conceptualPrompting & context engineering
- Temporal retrievalrag · mid · conceptualEmbeddings, search & RAG
- Tensorsllm · mid · conceptualDeep learning & transformers
- Token economicsllm · mid · conceptualLLM applications
- Token prioritisationprompting · mid · conceptualPrompting & context engineering
- Tokenisationllm · mid · conceptualDeep learning & transformers
- Tokenizer algorithmsllm · mid · conceptualDeep learning & transformers
- Tokensllm · mid · conceptualLLM applications
- Tool callingllm · mid · conceptualLLM applications
- Tool contractsprotocols · mid · conceptualTool protocols
- Tool discoveryprotocols · mid · conceptualTool protocols
- Tool ergonomicsagents · mid · conceptualAgents & orchestration
- Tool errorsagents · mid · conceptualAgents & orchestration
- Tool schemasagents · mid · conceptualAgents & orchestration
- Tool useagents · mid · conceptualAgents & orchestration
- Tools/resources/promptsprotocols · mid · conceptualTool protocols
- Top-krag · mid · conceptualEmbeddings, search & RAG
- Tracesagents · mid · conceptualAgents & orchestration
- Training costfine-tuning · mid · conceptualModel adaptation
- Training loopllm · mid · conceptualDeep learning & transformers
- Trajectory evaluationagents · mid · conceptualAgents & orchestration
- Transformerllm · mid · conceptualDeep learning & transformers
- TTSmultimodal · mid · conceptualMultimodal, vision & voice
- Turn detectionmultimodal · mid · conceptualMultimodal, vision & voice
- Untrusted inputprompting · mid · conceptualPrompting & context engineering
- VADmultimodal · mid · conceptualMultimodal, vision & voice
- Vector databasesrag · mid · conceptualEmbeddings, search & RAG
- Video understandingmultimodal · mid · conceptualMultimodal, vision & voice
- VLMsmultimodal · mid · conceptualMultimodal, vision & voice
- Vocabularyllm · mid · conceptualDeep learning & transformers
- Voice agentsmultimodal · mid · conceptualMultimodal, vision & voice
- Voice UXmultimodal · senior · conceptualMultimodal, vision & voice
- Webhooksprotocols · mid · conceptualTool protocols
- Weights, biases, activationsllm · mid · conceptualDeep learning & transformers
- What is AI engineeringfundamentals · junior · conceptualOrientation
- When not to fine-tunefine-tuning · mid · conceptualModel adaptation
- When not to use an agentagents · mid · conceptualAgents & orchestration
- Zero-shotprompting · mid · conceptualPrompting & context engineering