Video RAM sits physically on the GPU board and provides the high-bandwidth data path that compute cores need. When a model is 'too large for a single GPU,' VRAM is usually the binding constraint: a 70B-parameter model in fp16 needs roughly 140 GB, exceeding any single consumer GPU. Techniques like quantization, offloading, and tensor parallelism exist primarily to work around VRAM limits.