Sorry you are missing out. I use claude all day every day with max and what people are reporting here has not been my experience. My current usage is 16% and it resets Thursday.
I didn't experience that at all. I know there are lots of rumblings around here about that, but I'm posting this to show this wasn't a universal experience.
The evidence is that quotas exist, as seen here, and are low enough that people are hitting them regularly. When was the last time you hit your quota of Google searches? When was the last time you hit your quota of StackOverflow questions? When was the last time you hit your quota of YouTube videos? Any service will rate limit abuse, but if abuse is indistinguishable from regular use from the provider's perspective, that's not a good sign.
It's also kind of interesting that they don't think they can do what an economy would normally do in this situation, which is raise prices until supply matches. Shortages generally imply mispricing.
There's a lot of angles you take from that as a starting point and I'm not confident that I fully understand it, so I'll leave it to the reader.
The parent's argument is that the marginal cost of inference is minimal. However, the fundamental flaw is that he's separating inference from the high cost frontier models. It's a cross-subsidy that can't be ignored.
Without any insider knowledge on the economics of these companies, I suspect it's that the amount of infrastructure you have to build is determined by peak usage rather than average usage. If peak usage is much higher for a small part of one day a week (say on Monday morning as software developers across the US get back to work) the cost of fulfilling demand at all times can be insane. That's why companies are implementing batch/standard/priority pricing for the API.
It sounds like it's more of a profit maximization function (and not just demand) with GPU rental prices increasing 48% since Feb.
> Renting one of Nvidia’s most-advanced Blackwell generation of chips for one hour costs $4.08, up 48% from the $2.75 it cost two months ago, according to the Ornn Compute Price Index.
You're assuming they can just stop training. For the entirety of these companies' existence, they have done training. It is part of their price. They must keep pushing out better and better models. That's like saying Nvidia can just stop making new GPUs, they're obviously making so much money with their current models now.
I've seen sources like this before. It's all hearsay and promo. I was asking for any publicly available verifiable information regarding the cost of inference at scale. I haven't seen any such info personally which is why I asked.
I'm dying to see S-1 filing for Anthropic or OpenAI. I don't actually think inference is as cheap as people say if you consider the total cost (hardware, energy, capex, etc)
Well they're not public yet so you'll have to put up with rumors. But the numbers are available for companies like DeepSeek say they have an 80% profit margin, so it stands to reason OAI etc would do similar numbers considering they charge much more.
Why don't you do that? Instead of doing that you unfairly critisize the guy that gave away his time and effort on something which no-one is forcing you to use. Shame.
I wrote code. But, the whole point of this project for me was to experiment with how far I could take AI as an assistant to help me with coding. So far, I've been extremely impressed.
Jack booted thugs shot a women in the face for the crime of sitting in her car and the administration called her a terrorist. Nothing happened to the thug.
Jack booted thugs shot a man in the back for the crime of defending a woman and the administration called him a terrorist. Nothing happened to that thug either.
Absolutely. But what people don't realize is this sort of thing happens in China too, it's just never reported or heard about, other than some whispers here and there, because of such tight control over the media, the internet, and public discourse. In the US, as much as the fascists are trying to take over, at least you can still protest and make your voice heard.
Me. I lived and worked there for a number of years. When you talk to the local people in confidence you find out about this stuff, and you sometimes catch glimpses of it before it's scrubbed from local social media. There's a very high level of control.
Most people don't understand this about China, and most reporters who go there are like "I spent 2 weeks in China and here's what it's like", or "I spent a semester studying at Beida (Peking U)".
10+ years ago there were places where social media posts were archived by some brave individuals before they were scrubbed so you could see what words were being targeted by censors. But that's long shut down to my knowledge.
Anything I can read? So far to believe it, I either have to move to and live in China for several years or "trust me bro". Neither of those are epistemically viable. It should be clear why.
Why can I say? Sometimes the only way to really learn about a country esp one with such tight control over information is to live there a decent amount of time. And since not many investigative journalists are doing that in China any more (China’s not likely to let them stay if they’re reporting the truth), it’s tough. If you really want to know, you may have to go find out for yourself.
reply