thickertoofan@lemm.ee to LocalLLaMA@sh.itjust.worksEnglish · 8 days agoMicrosoft just released BitNet!github.comexternal-linkmessage-square6fedilinkarrow-up117arrow-down10file-text
arrow-up117arrow-down1external-linkMicrosoft just released BitNet!github.comthickertoofan@lemm.ee to LocalLLaMA@sh.itjust.worksEnglish · 8 days agomessage-square6fedilinkfile-text
minus-squareicecreamtaco@lemmy.worldlinkfedilinkEnglisharrow-up5·edit-28 days agoIt’s a massive performance upgrade, which would make current sized models better and tiny phone-sized models viable. Only problem is that models need to be retrained to use it and afaik, no one significant has done it yet.
It’s a massive performance upgrade, which would make current sized models better and tiny phone-sized models viable. Only problem is that models need to be retrained to use it and afaik, no one significant has done it yet.