Huawei Zurich Lab’s New Open-Source Tech Lets LLMs Run on Consumer GPUs (technode.com)
from yogthos@lemmy.ml to technology@lemmy.ml on 06 Oct 17:47
https://lemmy.ml/post/37171353

#technology

threaded - newest

k_rol@lemmy.ca on 07 Oct 12:41 collapse

That’s rather odd they don’t share any source links. Anyway here they are

SINQ: Sinkhorn-Normalized Quantization for Calibration-Free Low-Precision LLM Weights

Github / huawei-csl / SINQ

HiddenLayer555@lemmy.ml on 07 Oct 17:17 collapse

I’ve never seen a mainstream tech news site link to the source code.

It’s like how mainstream science news sites never link to the actual paper.