L-4

From LLMs to Chatbots

L3 Exit Ticket Results

What Does an LLM Know?

Qwen3.5-9B
DEMO 2 · What Does an LLM Know?

What Does an LLM Remember?

Qwen3.5-9B
DEMO 3 · What Does an LLM Remember?

Remember Bob

DEMO 4 · Remember Bob

Who Won the World Cup?

DEMO 5 · Who Won the World Cup?

Instructions Shape the Reply

DEMO 6 · Instructions Shape the Reply

A New Chat. Same Preferences

A Skill for Making Slides

Agentic AI

Agentic AI works towards a goal by using tools, checking results, and deciding what to do next

Different Context. Same Model

Context Has Limits

Compacting the Context Window

What Exactly Is This?

Qwen: model family developed by Alibaba
3.5: model generation or version
9B: about nine billion learned weights

Open and Closed Weights

Open weights: network with visible knob arrows; we can obtain the learned weights
Open and closed weights side by side: visible knob arrows versus question marks
Practical contrast: you control the computer versus the provider controls the computer
Four examples each of open-weight and closed-weight models, as of September 2026

Small or Large?

Fewer weights: green heading and familiar network with fewer learned-weight knobs
More weights: a larger red network appears beside the green smaller network
Less memory versus more memory, shown with RAM-module icons and fewer or more filled chips
Faster versus slower: a simplified comparison holding hardware and model design comparable
Less Capable in red on the left and More Capable in green on the right; memory and speed retain their existing colours

Models on Different Computers

First system: iPhone
Second system: Mac mini joins the iPhone
Third system: Mac Studio joins the comparison
Fourth system: the eight-B300 server completes the comparison

More Context, More Work

Quantization: Fewer Knob Positions

Quantization: Fewer Bits, Less Computer Memory

Who Runs the Model?

You run an open-weight model on your local server
Self-hosting can use your local server or a cloud server you rent and manage
A provider can operate open-weight or closed-weight models; who manages the deployment is the distinction
Your computer sends requests to and receives responses from either your self-hosted service or a provider's managed service
Who has access to your data? Green and red document icons mark the two data paths; the existing deployment labels remain

Activity