☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 3 months agoBonsai 27B: The First 27B-Class Model to Run on a Phoneprismml.comexternal-linkmessage-square1linkfedilinkarrow-up112arrow-down12
arrow-up110arrow-down1external-linkBonsai 27B: The First 27B-Class Model to Run on a Phoneprismml.com☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 3 months agomessage-square1linkfedilink
minus-squareIrdial@lemmy.mllinkfedilinkEnglisharrow-up2·3 months agoI’m surprised that the model’s benchmark performance isn’t that much worse than the base given that it’s running with 1-bit quantization. Impressive.
I’m surprised that the model’s benchmark performance isn’t that much worse than the base given that it’s running with 1-bit quantization. Impressive.