Artificial intelligence challenge.. How did Microsoft create a supercomputer?

  • Tech
  • March 14, 2023

In 2019, when Microsoft Corporation invested $1 billion in OpenAI, the developer of ChatGPT, “OpenAI,” Microsoft agreed to build a supercomputer to run artificial intelligence research, but the only problem was, according to an article written by author Tina Bass, published. In the agency Bloomberg“Not sure Microsoft can build something big on its Azure cloud without crashing.”

At the time, according to Bass’ article, OpenAI trained a large group of AI programs, called models, that consumed large amounts of data and learned more and more variables that the AI ​​system extracted through training and retraining.

This meant that OpenAI needed access to powerful cloud computing services for long periods of time and at constant speeds.

Manufacturing and assembly challenges

To meet this challenge, Microsoft had to find ways to assemble tens of thousands of A100 graphics chips from Nvidia Corporation, the backbone of artificial intelligence training models. To develop.

Microsoft piled up a large number of Nvidia chips to build its supercomputer

“We’ve built a system architecture that works and can be trusted at scale, and that’s what made ChatGPT possible,” said Niti Gable, director of infrastructure at Microsoft.

When OpenAI or Microsoft is training a large AI model, where millions of computational operations are all happening simultaneously, according to Bass, “units need to talk to each other to share and learn from the work they’ve done.”

With all the hardware running at the same time, Microsoft had to think about where to put the chips and where to find the power supply.

Alistair Spears, Azure’s global infrastructure manager, said the company had to make sure it could cool all of these machines and chips.

See also  Learn how to transfer Facebook posts and notes directly to Google Docs

This technology allowed OpenAI to launch ChatGPT, which attracted more than 1 million users within days of its November IPO, and is now being pulled into other companies’ business models.

Among those interested in AI are credit hedgers, banking services and food delivery services, Bass says.

But in the future, according to Bass, this will put more pressure on cloud service providers like Microsoft, Amazon and Google to ensure that their data centers can provide the massive computing power required.

A cloud service depends on thousands of different parts and components, and a delay or lack of any one component, however small, can affect everything.

  • Stuart Wagner

    "Professional coffee fan. Total beer nerd. Hardcore reader. Alcohol fanatic. Evil twitter buff. Friendly tv scholar."

    Related Posts

    • Tech
    • June 5, 2024
    • 505 views
    Artificial Intelligence in Daily Work

    Using AI has become a part of our everyday lives, including work. We can ease so many tasks and still be good at what we do for a living! Many…

    • Tech
    • May 20, 2024
    • 599 views
    Unlock the easiest way to get EU citizenship of Slovenia and Romania with Union Permits

    Due to the nature of their immigration programs, Slovenia and Romania are the European countries where it is easier to get EU citizenship. In these states, newcomers can obtain a…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    How to Choose the Right Mattress: Find the Best Fit for You

    How to Choose the Right Mattress: Find the Best Fit for You

    Emils Kerimovs on Wealthtech Revolution: Investing in the Middle East and Africa

    Emils Kerimovs on Wealthtech Revolution: Investing in the Middle East and Africa

    Forex Brokers Review: Is ITBFX A Safe Broker?

    Forex Brokers Review: Is ITBFX A Safe Broker?

    Best Kitchen Renovation Ideas to Upgrade Your Space

    Best Kitchen Renovation Ideas to Upgrade Your Space

    Where to Get a Professional Massage in Dubai

    Where to Get a Professional Massage in Dubai

    Dog Spay Surgery 101: Benefits, Risks, Cost, and Aftercare

    Dog Spay Surgery 101: Benefits, Risks, Cost, and Aftercare