Skip to content
vije.shVKG-04
VKG-04 · Personal Systems ProcessorLab · Rev 30.1

Section 8

Lab

How much memory does a model need? Fewer bits per weight, smaller model. Pick a size and a bit width.

8Memory sizing

Raw weights only
MGB = PB × b ÷ 8

Bits per weight (b)

5.3GB

Standard 16-bit would be 54 GB, about 10.1× larger.

Bits used per 16-bit word

Same model at every bit width

16-bit54 GB
8-bit27 GB
4-bit14 GB
2-bit6.8 GB
1.58-bit5.3 GB
1-bit3.4 GB

Fits in

  • ESP32-C3 (400 KB): too small
  • 8 GB laptop: fits
  • 12 GB GPU: fits
  • 16 GB GPU: fits
  • 24 GB GPU: fits
  • 32 GB GPU: fits
  • 64 GB workstation: fits
vije.sh · VKG-04 datasheetPage 3 of 7