JensSpahnpasta@feddit.org to Technology@lemmy.worldEnglish · 4 days agoSilicon Valley is buzzing about this new idea: AI compute as compensationwww.businessinsider.comexternal-linkmessage-square98linkfedilinkarrow-up1234arrow-down113cross-posted to: technology@piefed.social
arrow-up1221arrow-down1external-linkSilicon Valley is buzzing about this new idea: AI compute as compensationwww.businessinsider.comJensSpahnpasta@feddit.org to Technology@lemmy.worldEnglish · 4 days agomessage-square98linkfedilinkcross-posted to: technology@piefed.social
minus-squareunnamed1@feddit.orglinkfedilinkEnglisharrow-up4·4 days agolol inference is already cheap af. Might as well pay money. Dipshits.
minus-squareXLE@piefed.sociallinkfedilinkEnglisharrow-up1·4 days agoPer-token costs are down, but you need more tokens; overall costs are up.
minus-squareJacob_Mandarin@lemmy.worldlinkfedilinkEnglisharrow-up2·4 days agoYeah they are trying to add more and more context and allow bigger and bigger requests. Cost per request is probably still going up. On top of there being more and more requests.
minus-squareunnamed1@feddit.orglinkfedilinkEnglisharrow-up1·4 days agoYou are probably right. This is basically what capitalism dictates. But considering API usage at least the context is in the developers control. Vibe coding is becoming pretty hungry though :D
lol inference is already cheap af. Might as well pay money. Dipshits.
Per-token costs are down, but you need more tokens; overall costs are up.
Yeah they are trying to add more and more context and allow bigger and bigger requests.
Cost per request is probably still going up. On top of there being more and more requests.
You are probably right. This is basically what capitalism dictates. But considering API usage at least the context is in the developers control. Vibe coding is becoming pretty hungry though :D