Llama.cpp GPU Layer Assignment Tool
Generate
-ot
arguments for distributing model layers across multiple GPUs
Number of GPUs
↺
1
8
Starting Layer Number
Total Number of Layers
Model Size (GB)
Layer Pattern
ffn_.*
Distribution Mode
Automatic
Manual
GPU VRAM Configuration (Automatic Mode)
GPU 0 VRAM (GB)
GPU 1 VRAM (GB)
GPU 2 VRAM (GB)
GPU 3 VRAM (GB)
GPU 4 VRAM (GB)
GPU 5 VRAM (GB)
GPU 6 VRAM (GB)
Generated Command Arguments