avatar

Pacificsky's Blog

Cost of experimenting with tokens

· 99 words · 1 minutes ·

Recent discussion around costs of LLM tokens and whether it stifles experimentation in the context of “vibe coding”.

IMHO I think all token costs trend to zero and the answer is NO.

You might end up with “slow tokens” and “fast tokens” where the slow tokens are truly zero (like internet usage at night time being unmetered in many parts of the world) and fast tokens cost a tiny amount of money. But in the long term I think they both trend to the cost of electricity or even lower (because caching kicks in and the tokens are free)

Tags: Inference  Llm  Vibe Coding  Tokens  Cost