minnix@lemux.minnix.devM to The Linux Lugcast Podcast@lemux.minnix.devEnglish · 2 months agoExploring Llamafile: Mozilla's Attempt in the World of Open Source AIitsfoss.comexternal-linkmessage-square4fedilinkarrow-up111arrow-down10
arrow-up111arrow-down1external-linkExploring Llamafile: Mozilla's Attempt in the World of Open Source AIitsfoss.comminnix@lemux.minnix.devM to The Linux Lugcast Podcast@lemux.minnix.devEnglish · 2 months agomessage-square4fedilink
minus-square🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕕𝕚𝕝𝕖linkfedilinkEnglisharrow-up3·1 month agoI find the 7b models dont have the capabilities id like and i cant image the tokens per second would be very good.
minus-squareminnix@lemux.minnix.devOPMlinkfedilinkEnglisharrow-up2·1 month agoYeah running it and it actually being useful are two very different things.
I find the 7b models dont have the capabilities id like and i cant image the tokens per second would be very good.
Yeah running it and it actually being useful are two very different things.