AI Terminology Course
AI Terminology
/
Intermediate

LLM Questions

Definition

Questions focusing specifically on Large Language Models, Prompt Engineering, and Tokenization mechanics.

Explain Like I'm New

Interviewers want to see if you actually know how the OpenAI API works under the hood, rather than just knowing how to type into ChatGPT.

Real World Example

Being asked: 'Why do LLMs sometimes struggle with math, even though computers are inherently good at math?'

Common Use Cases

  • •Prompt Engineer roles
  • •AI Developer interviews

Interview Questions

basic

  • What is a Context Window?

intermediate

  • Explain the concept of 'Temperature' in an LLM.

Flash Cards

Question

Context Window?

Click to reveal answer
Answer

The maximum amount of text (tokens) the model can hold in its short-term memory during a single interaction. Exceeding it causes the model to forget the earliest parts of the conversation.

Question

What is Temperature?

Click to reveal answer
Answer

A parameter that controls randomness. A temperature of 0 makes the model highly deterministic and repetitive (good for code). A higher temperature (e.g., 0.8) flattens the probability distribution, making the model take creative risks (good for brainstorming).