LLM Is LLM's Context Window is a Vanity Metric We've been thinking about this for a while now. Every couple months some LLM provider puts out a press release — "Now supporting 1 million tokens!" Then 2 million. We're pretty sure we'll see 5 million token context windows by end of year.
