Chamath: Tokenmaxxing is a bridge to nowhere
44 segments
Over the last year, I looked at the
stats this morning, token spend among
ramp customers has grown by 21 times.
>> 21 times?
>> 21 times.
>> Not 21% we're talking about 21 times.
>> That's exactly right. So, many CFOs,
they're often very surprised by the
bill.
>> He's saying something so important there
because
if your engineers are going off randomly
in an unguided system and then just
ripping through million tokens at 56
bucks,
what he's talking about is the eventual
downstream impact to earnings. And that
eventually a bunch of these public
market CFOs are going to show up to Wall
Street and they will have missed
earnings because their OpEx at some
point if things are 21Xing every few
months, somebody's going to miss a
quarter. Eric would not have released
this ramp product unless CFOs were like,
"I can't control the spend."
>> Yes.
>> And then he's like, "Well, here, let me
build it for you." And then if enough
CFOs essentially turn that feature on
and start to rate limit how it's spent
because maybe they're not getting the
ROI and the engineer doesn't care about
ROI. The engineer is like, "I want to
use the latest greatest model."
>> Yeah. Make me better.
>> you don't need it. Maybe Mirror's right
and for 95% of the tasks you should be
at one level lower especially when it
costs 1/100 of the cost. Unless you get
a control of this and you can directly
say how much money you're making, this
is a bridge to nowhere. It is a money
burning furnace.
Ask follow-up questions or revisit key timestamps.
The video discusses the explosive 21x growth in AI token spending among Ramp customers and the resulting concerns for CFOs. The speakers highlight the risk of uncontrolled engineering expenditures impacting company earnings and the necessity for financial oversight and ROI-focused strategies in AI model selection.
Videos recently processed by our community