sapphire rapids has amx support but it ends up having a negative performance impact. emerald rapids also has amx support with a positive performance impact however there's no reasonable way in ggml to differentiate between the two. the impact is small (~6%) so disable amx entirely for simplicity |
||
|---|---|---|
| .. | ||
| backend | ||
| nn | ||
| backend.go | ||