sanitation@lemmy.today to Programmer Humor@programming.dev · 1 month agoNew compression techniquelemmy.todayimagemessage-square162linkfedilinkarrow-up11.22Karrow-down116file-text
arrow-up11.21Karrow-down1imageNew compression techniquelemmy.todaysanitation@lemmy.today to Programmer Humor@programming.dev · 1 month agomessage-square162linkfedilinkfile-text
minus-squareSorryQuick@lemmy.calinkfedilinkarrow-up4·1 month agoSaves input tokens and uses more output because of OCR, and output is priced way higher.
minus-squareRooster326@programming.devlinkfedilinkarrow-up3·1 month agoIt’s an accounting trick. It uses a different budget…
minus-squareboonhet@sopuli.xyzlinkfedilinkarrow-up1·1 month agoAlso if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol
Saves input tokens and uses more output because of OCR, and output is priced way higher.
It’s an accounting trick. It uses a different budget…
Also if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol