AMD CEO Lisa Su: We're seeing 30 times more performance with our Helios systems
155 segments
LOWS, BUT DRIFTING BACK TOWARDS
THERE. WE'RE BACK ON THE
CLOSING BELL. LET'S GET OUT TO
OUR OWN JOHN FORT, WHO JOINS US
WITH A VERY SPECIAL GUEST, JOHN
DOM.
>> THANKS. I AM.
>> HERE IN SAN FRANCISCO AT
AMD'S.
>> ADVANCING AI. EVENT WITH AMD
CEO.
>> LISA SU. LISA, THANKS FOR
HAVING US HERE, JOHN.
>> GREAT TO BE HERE. THANK YOU
FOR BEING HERE.
>> WELL, I GOT TO SET THE STAGE
A LITTLE BIT. INTEL'S GOT
EARNINGS THAT THEY'RE
ANNOUNCING IN JUST A FEW
MINUTES. WE'VE HAD MASSIVE
SIGNALS THIS WEEK ON AI
INFRASTRUCTURE DEMAND FROM
GOOGLE JUST LAST NIGHT. AND
THEN MASSIVE PANIC ATTACKS FROM
THE MARKET OVER KIMMY K THREE.
AND WHAT THAT MIGHT BE DOING TO
JUST DEMAND FOR PREMIUM ACROSS
THE BOARD IN AI, WHETHER IT'S
ON THE SOFTWARE OR THE HARDWARE
SIDE. SO WITH THAT AS A
BACKDROP, TELL ME ABOUT THE
SIGNIFICANCE OF THIS MOMENT FOR
HELIOS AND AMD.
>> YEAH. SO FIRST OF ALL, JOHN,
ALL OF THOSE THINGS ARE TRUE,
BUT WHAT WE SEE IS ACTUALLY
SOMETHING THAT'S MUCH, MUCH
BROADER. I MEAN, THIS IS LIKE
AN INCREDIBLE MOMENT FOR AI.
YOU KNOW, WE LOOK AT OUR
MARKETS, SPEND TIME WITH OUR
CUSTOMERS ALL THE TIME. AND,
YOU KNOW, FROM WHAT WE SEE
TODAY, THE MARKET FOR HIGH
PERFORMANCE IN AI COMPUTING
OVER THE NEXT 4 OR 5 YEARS IS
GOING TO REACH $2 TRILLION OF
TAM AND MARKET OPPORTUNITY. SO
IT'S REALLY HUGE AND TREMENDOUS.
AND I'M VERY HAPPY TO ANNOUNCE
THIS MORNING WE ANNOUNCED THAT
OUR HELIOS RACK SCALE SYSTEM IS
IN FULL PRODUCTION, AS WELL AS
OUR NEW VENICE PROCESSORS ARE
IN FULL PRODUCTION. AND THIS IS
LIKE A HUGE STEP UP IN TERMS OF
AI CAPABILITY. I MEAN, WE'RE
SEEING INCREDIBLE NUMBERS LIKE,
YOU KNOW, OVER 30 TIMES MORE
PERFORMANCE WITH OUR NEWEST
SYSTEMS, HELIOS SYSTEMS,
COMPARED TO OUR PREVIOUS
GENERATION. AND WE'RE TALKING
ABOUT, FROM A CUSTOMER
STANDPOINT, JUST TREMENDOUS
INTEREST AND EXCITEMENT. YOU
KNOW, WE HAD ANTHROPIC WITH US
OPEN AI, YOU KNOW, META, AT&T,
CISCO, JUST A NUMBER OF OUR
CUSTOMERS, YOU KNOW, COMING
TOGETHER.
>> YOU'VE LITERALLY BEEN
BUILDING TOWARD THIS PENSANDO.
I THINK ABOUT OUR CONVERSATIONS,
AUSTIN, SAN JOSE, ETC. YOU
ANNOUNCED THESE MAJOR CUSTOMERS
FOR HELIOS OUT OF THE GATE. HOW
MUCH OF THAT IS DEDICATED
VOLUME? HOW MUCH OF IT IS PILOT
TESTS?
>> WELL, I THINK WHAT YOU CAN
SAY IS WITH A SYSTEM AS COMPLEX
AS HELIOS, YOU KNOW, PEOPLE
DON'T DO THIS TYPE OF WORK FOR
QUOTE UNQUOTE PILOTS BECAUSE
IT'S A LOT OF WORK WHEN YOU
HAVE, YOU KNOW, MAJOR
FOUNDATIONAL MODEL COMPANIES
NEEDING TO PUT THEIR RESOURCES,
OPTIMIZE THEIR LATEST MODELS TO
OUR HARDWARE. SO CERTAINLY, YOU
KNOW, OPENAI AND META, WE'VE
TALKED ABOUT MULTI GIGAWATT
SCALE FOR MI 450 DEPLOYMENTS.
AND THEN JUST THIS WEEK WE
ANNOUNCED ANTHROPIC, WHICH WILL
DO UP TO TWO GIGAWATTS OF MI
450 IN HELIOS STARTING IN THE
FIRST HALF OF 27. SO THESE ARE
LARGE SCALE DEPLOYMENTS. AND
YOU KNOW, WE'RE WORKING HAND IN
HAND WITH THE ENGINEERING TEAMS
OF OUR CUSTOMERS, BOTH HARDWARE,
SOFTWARE, DATA CENTER. I CAN
SAY IT'S A TON OF WORK, BUT
IT'S GOING EXTREMELY WELL. SO
IT'S A, IT'S A HAPPY DAY FOR US.
>> I DON'T KNOW THAT YOU'VE
ANNOUNCED PRICING, BUT I'VE
SEEN SOME ESTIMATES, GUESSES
OUT THERE. THIS IS GOING TO BE
5 MILLION PLUS FOR HELIOS RACK
THAT YOU'RE PRICING ON THE
PREMIUM END. HOW MUCH OF THAT
IS BECAUSE TSMC IS CHARGING
MORE TO JUST DELIVER CHIPS? HOW
MUCH OF THAT WOULD JUST BE
BECAUSE OF THE CONSTRAINED
ENVIRONMENT AND SUPPLY IN
GENERAL?
>> WELL, THE MOST IMPORTANT
THING THAT I WOULD SAY, JOHN,
IS TO FOCUS ON TOKENS PER
DOLLAR. I MEAN, THAT'S WHAT THE
ENTIRE INDUSTRY IS TALKING
ABOUT. IT'S TALKING ABOUT
TOKENS PER DOLLAR. AND FROM OUR
STANDPOINT, YOU KNOW, WE
ACTUALLY WENT ON BOTH SIDES.
OUR HELIOS SYSTEMS HAVE MORE
PERFORMANCE THAN OUR
COMPETITION. AND SO, YOU KNOW,
LET'S CALL IT ANYWHERE FROM 10
TO 15% PLUS MORE PERFORMANCE.
AND WE ALSO HAVE LOWER TOKENS
PER DOLLAR. SO, YOU KNOW, UP TO
A 30% BENEFIT FOR OUR CUSTOMERS
IN TERMS OF TOKENS PER DOLLAR.
THAT'S HUGE. I MEAN, WHEN
YOU'RE TALKING ABOUT INFERENCE,
YOU KNOW, EVERYONE IS LOOKING
FOR THE OPPORTUNITY TO USE AI
IN MORE AND MORE APPLICATIONS.
AND IT IS SUCH AN SUCH A PLACE
WHERE EVERYONE'S TOKEN BUDGETS
ARE RAMPING UP, YOU KNOW,
INCLUDING OUR OWN, BY THE WAY,
EVERY MONTH OUR TOKEN BUDGETS
ARE GOING UP, BUT WE'RE ALSO
SEEING JUST TREMENDOUS
PRODUCTIVITY COME OUT OF THAT.
AND SO, YOU KNOW, THIS IS AN
OPPORTUNITY TO OPTIMIZE LIKE
NEW TECH IS THERE SO THAT YOU
CAN ADO
Ask follow-up questions or revisit key timestamps.
AMD CEO Lisa Su discusses the significant growth in the AI computing market, projecting it to reach a $2 trillion opportunity over the next five years. During the 'Advancing AI' event, Su announced that AMD's new Helios rack-scale systems and Venice processors are in full production, offering substantial performance improvements over previous generations. Major industry players like OpenAI, Meta, and Anthropic are already integrating these systems into their large-scale, multi-gigawatt deployments, focusing on maximizing efficiency through a better tokens-per-dollar ratio.
Videos recently processed by our community