Episode 11.77: Why context length matters and why it can easily cost users a lot of money.

The cumulative cost of longer and longer context lengths can easily lead to very high user costs because we are charged by the number of tokens consumed.