Prompt Cache Write Cost: When Does the 1.25x Premium Pay?
A prompt-cache write pays for itself after a single re-read within the TTL: the write bills 1.25x the input rate, the read bills 0.1x, so one hit al…
Latest Open Source news from Tech News
A prompt-cache write pays for itself after a single re-read within the TTL: the write bills 1.25x the input rate, the read bills 0.1x, so one hit al…