minus-squareMatch!!@pawb.socialtoLinux@lemmy.ml•Simple local ai applinkfedilinkEnglisharrow-up13·6 months agomodel training is often exorbitantly high-energy and storage, but the model output is not: GPT3 cost $7 million dollars just in electricity costs to train, but the model is “only” 500 GB, and can be run locally on just CPU processing linkfedilink
minus-squareMatch!!@pawb.socialtoLinux@lemmy.ml•Simple local ai applinkfedilinkEnglisharrow-up13·6 months agoso like, turn your network connection off and try it linkfedilink
model training is often exorbitantly high-energy and storage, but the model output is not: GPT3 cost $7 million dollars just in electricity costs to train, but the model is “only” 500 GB, and can be run locally on just CPU processing