AI Engineering
Building on models that are probabilistic by construction — embeddings, retrieval, agents, and the evaluation discipline that separates a demo from a system.
- How LLMs workThe mental model an engineer actually needs — next-token prediction, attention, context as the only state, and which observed behaviours follow from the architecture rather than from a bug.
- Tokens and samplingWhat temperature, top-p and top-k actually do to a probability distribution, why they interact, and why "set temperature to 0 for reproducibility" is only half true.
- PromptingWhat actually moves the needle — structure, examples, and output contracts — and how to tell a prompt problem from a retrieval problem before spending a week on the wrong one.
- Context engineeringThe context window is a budget, not a container. How to decide what goes in it, in what order, and what to do when the conversation outgrows it.
- HallucinationsWhy fabrication is a property of the training objective rather than a bug, what actually reduces it, and how to build a system that fails loudly instead of confidently.
- EvaluationHow to know whether a change made things better — building a golden set, choosing metrics that survive contact with production, and using an LLM judge without fooling yourself.
- EmbeddingsHow text becomes a vector, why similarity is an angle rather than a distance, and the failure modes that make a retrieval system quietly return the wrong documents.
- Vector searchApproximate nearest neighbour search — what HNSW actually trades away, why recall is a dial rather than a property, and the memory cliff that turns a fast index into a slow one.
- RAGRetrieval-augmented generation as a pipeline of separately-measurable stages — and why debugging it end-to-end is the most expensive mistake in the field.
- Chunking and retrievalWhy chunk size is not a knob you can reason about monotonically, what overlap actually buys, and how an answer that is provably in your corpus becomes unretrievable.
- Reranking and hybrid searchWhy embeddings are bad at identifiers, how to fuse two rankings whose scores are not comparable, and where a cross-encoder earns its latency.
- Tool useFunction calling as an interface design problem — why the schema is the prompt, what a tool should return, and the authorisation mistake that turns a helpful agent into a confused deputy.
- AgentsThe think-act-observe loop, the four ways it fails in production, and why the controls around the loop matter more than the model inside it.
- Agent orchestrationMulti-agent systems — when splitting genuinely helps, why context does not cross agent boundaries for free, and the coordination costs nobody budgets for.
- LLMOpsRunning LLM features in production — what to log when output is non-deterministic, where the cost actually goes, and how to ship a model upgrade without breaking things silently.
- GuardrailsPrompt injection has no clean fix, and understanding why tells you where the real controls go — output validation, capability limits, and authorisation that never trusts the model.
- Machine learning fundamentalsThe vocabulary an AI engineer needs — what training actually optimises, why accuracy is usually the wrong metric, and how to read a model someone else built.
- ML data preparationLeakage, splits, encoding and imbalance — the stage where most model quality is won or lost, and where the bugs are silent by construction.
- AI data readinessAssessing whether a corpus can support an AI feature at all — the audit to run before the project, and the findings that should stop it.
- Knowledge graphsWhen entities and relationships beat embeddings — multi-hop questions, aggregation, and the extraction cost that decides whether a graph is worth building.
- GPU serving — memory, batching, and the throughput you're leaving on the tableGPU memory and GPU utilisation are different numbers measuring different things, continuous batching is why vLLM serves several times the traffic of a naive loop, and CUDA OOM is almost never "just add more VRAM."
- LLM gateway — routing, fallback, and cost attribution across providersA gateway is the one place that knows every provider's health, every tenant's spend, and which request should fail over to what — pulling routing logic out of application code before the second provider makes it unavoidable.
- Prompt versioning — treating a prompt as a deployable artefactA prompt edit that quietly regresses quality is a deploy with no diff, no review, and no rollback unless prompts are versioned, tested, and released like code — not typed into a string constant and shipped.