lens0021@programming.dev to AI@lemmy.ml · 6 months agoDocker Model Runner is now Generally Availablewww.docker.comexternal-linkmessage-square1linkfedilinkarrow-up15arrow-down10file-text
arrow-up15arrow-down1external-linkDocker Model Runner is now Generally Availablewww.docker.comlens0021@programming.dev to AI@lemmy.ml · 6 months agomessage-square1linkfedilinkfile-text
minus-squarevermaterc@lemmy.mllinkfedilinkarrow-up3·6 months agoDo you guys successfully use small self hosted models somewhere? Although I can see a use case for LLMs, it’s always the biggest ones that can output any useful results (and by “biggest” I usually mean: the ones I can’t afford to run by myself)
Do you guys successfully use small self hosted models somewhere? Although I can see a use case for LLMs, it’s always the biggest ones that can output any useful results (and by “biggest” I usually mean: the ones I can’t afford to run by myself)