hardware//compute-bound

A workload is compute-bound when arithmetic execution is the limiting resource. Supplying more memory bandwidth would not materially accelerate it because compute units are already the bottleneck.

A workload is compute-bound when arithmetic execution is the limiting resource. Supplying more memory bandwidth would not materially accelerate it because compute units are already the bottleneck.

Optimization should follow that diagnosis: reduce operations, use faster kernels, exploit specialized instructions or add appropriate compute capacity. The label is conditional on hardware, shapes, precision and batch size. The same model can be memory-bound at small batches and more compute-bound after batching improves reuse.

Bottlenecks are relationships between workload and machine, not permanent personality traits of algorithms.