Practicals

The labs and their data

Days 1–3 each have one main activity. Day 4 contains four short practical sessions on APIs, evidence-based analysis, and agent workflows.

To begin. Download the notebook and any adjacent data or project files, open the notebook in Jupyter, and run the cells in order.

The four labs

D1 Fashion-MNIST, a stratified classroom subset Monday10 classes28 × 28 greyscale

One row is one clothing photograph. The classroom subset is balanced by class and drawn with a fixed seed: 12,000 training images, 3,000 validation and 3,000 final test. Validation chooses the model and the stopping epoch; the final split is opened once.

D2 Ants and bees, the small transfer-learning set Tuesday2 classes96 × 96 colour

One row is one photograph of an ant or a bee: 194 training images (97 per class), 49 validation and 153 final test. The training set is deliberately small, because that is the setting in which the architecture, the augmentation and a borrowed representation decide the result. The lecture uses Oxford-IIIT Pet; the lab uses this collection because it downloads and trains inside one session.

D3 A retrieval corpus written for this course Wednesday20 documents20 + 20 questions

Twenty short policy documents, twenty development questions and twenty final questions. Both labelled sets are built to the same composition: 12 answerable, 3 unanswerable, 2 ambiguous and 3 containing an injected instruction. Retrieval is TF-IDF and the answer is the first sentence of an accepted document, so every step can be inspected; no language model is called.

D4 APIs, evidence, and agent workflows Thursday4 sessions4 notebooks

Begin with API requests, protected keys, measured cost, and model comparison. Then label central-bank speeches, build checked World Bank briefings, and compare two agent systems on one controlled mission.

The order every lab follows

All four notebooks run in the same sequence, because the sequence is part of what is being taught. A number that arrives in the wrong order is not evidence.

  1. state the question, and say what one example is;
  2. look at the data before modelling it;
  3. fix the role of each split: development, validation, final test;
  4. set a baseline that costs nothing to compute;
  5. work one mechanism by hand before calling the library version of it;
  6. compare models on validation evidence rather than on training fit;
  7. audit the errors, not only the average score;
  8. choose the procedure on validation, then use the final split once;
  9. record what the result means, and what it does not cover.

Days 1–3 use prepared course datasets. Day 4 retrieves public data through APIs when the notebooks run and uses controlled agent project files. Every Day 4 notebook states its question, method, saved outputs, and provenance.

PythonPyTorchscikit-learnJupyterAPIsAgents
Development comes before final evaluation. The solution datasets include final labels so the notebooks can report complete results, but those labels are used only after the procedure has been fixed on development or validation data.
Oxford · United Kingdom
University of Oxford