Almost 100% agree, but there is no way they did this without Nvidia chips.
They've open sourced a ground breaking LLM scaling paradigm (RL on COT), which is no small thing believe me, but our closed source reasoning models are likely doing something similar (we just can't see it).
This newly open scaling paradigm is a game changer, but you still don't get this performance without massive compute.
They have illegal H100s, I'm nearly certain of it. Nvidia was probably due for a correction anyway. But it'll be funny to see what happens when we all find out they did this with Nvidia chips
Replies (3)
to expand on that a bit. They are using secret H100s, therefore their capex claims are complete BS, therefore their API price is complete BS. CCP smuggled in our chips and is bankrolling a loss to shake the market. Pretty freaking smart tbh
Sorry I didn’t mean to say they didn’t have Nvidia chips, but more that they likely are paying higher price and it’s slightly harder to get ahold of the same amount of compute. Or at least this was the goal of the govt actions.
So either:
• it did nothing and they have easy access. Or,
• access is slightly more difficult but it didn’t matter.
My bullet point was kinda vague and implied what your interpretation was but that’s not exactly what I meant.
Do you have a good write up on the scaling paradigm? I read that in another post but couldn’t confirm it yet and wasn’t sure what that meant.
Any explanation or breakdown link would be appreciatively zapped
