AI Terminology
/Intermediate
Batch Size
Definition
A hyperparameter that defines the number of training samples to work through before updating the internal model parameters.
Explain Like I'm New
If you have 10,000 math problems to solve. Do you solve 1, check the answer, and adjust your brain? (Batch Size 1). Or do you solve 32 problems, check all 32 answers, and adjust your brain based on the average? (Batch Size 32).
Real World Example
Most modern deep learning relies on GPUs. A GPU loves doing things in parallel. A batch size of 32 or 64 allows the GPU to process 64 images at the exact same millisecond, making training vastly faster.
Common Use Cases
- •Memory management
- •GPU optimization
Interview Questions
basic
- Does a larger Batch Size use more or less RAM/Memory on a graphics card?
intermediate
- What is the difference between an Epoch and a Batch?