Artificial Intelligence News - Page 1

Meta has purchased 500,000 more AI GPUs for a total of 1 million AI GPUs, which is valued at $30 billion.

We're hearing about the gargantuan AI GPU hardware investment from Meta AI boss Yann LeCun at the AI Summit, also saying that upcoming variations of its Llama 3 large language model are on the way. LeCun emphasized the computational limitations and GPU costs as things that are slowing the progression of AI.

OpenAI CEO Sam Altman plans to spend $50 billion a year on AGI development (artificial general intelligence) by using 720,000 NVIDIA H100 AI GPUs that cost a hefty $21.6 billion. Microsoft is aiming for 1.8 million AI GPUs by the end of 2024, while OpenAI wants to have 10 million AI GPUs before the end of the year.

In a new interview with MIT Technology Review, OpenAI CEO Sam Altman revealed what the future will look like with artificial intelligence-powered systems becoming more engrained in our lives.

The CEO of one of the companies leading the charge in AI development began the interview by saying AI tools will replace the smartphone as the most dependent piece of technology in our daily lives, and the capabilities of AI will be so great that it will feel like "this thing that is off helping you." Altman went on to describe the perfect app for AI would be a "super-competent colleague that knows absolutely everything about my whole life, every email, every conversation I've ever had, but doesn't feel like an extension."

Additionally, this level of AI could attempt things outside its known capabilities, fail, and then come back to the user with follow-up questions. The answers the user provides to those questions are then integrated into its second attempt at the task. So, what will power this crazy new AI? Altman believes there's a chance that we won't even need a specific piece of hardware to use this AI on the go, as the new app could simply access the cloud.

Apple is reportedly working on its own AI chip according to sources of The Wall Street Journal, which reports the Curpentino-based giant is building AI chips for its data centers to run new AI-based features that'll be announced at WWDC 2024 next month.

The World Wide Developers Conference (WWDC) is where APple will unveil its plans for the future of AI with its products and services, with the WSJ reporting: "Apple has been working on its own chip designed to run artificial intelligence software in data center servers, a move that has the potential to provide the company with a key advantage in the AI arms race".

The project is called ACDC which stands for Apple Chips in Data Center, but I can see some truly awesome marketing from Apple using the "ACDC" branding if they do it right. Come on, Apple... you know you're going to do it anyway.

Samsung has established a new dream team of engineers to secure HBM memory chip deals for AI GPUs from NVIDIA.

The news is coming from South Korean outlet KED Global, which reports Samsung's new task force features about 100 "excellent engineers" who have been working on improving manufacturing yields and quality with the first objective being passing NVIDIA's tests.

NVIDIA CEO Jensen Huang asked Samsung to raise the yields and quality of its 8-layer and 12-layer HBM3E memory chips for supply according to industry insiders on Monday. HBM3E memory is the cornerstone of NVIDIA's next-gen Blackwell B200 AI GPUs, as well as the new beefed-up Hopper H200 AI GPU, each with HBM3E memory mostly from Samsung's South Korean HBM rival: SK hynix.

TSMC is focused on getting its advanced packaging production capacity to new levels, with the company boosting advanced packaging capacity at its Zhonghe, Nanka, and Jiake fabs, which are "all in the process of expanding production".

The news is coming from Taiwanese media outlet Ctee, reporting that the Chiayi Science Park was finalized this year and is expected to build two advanced packaging plants first. The first phase of Jiake will see the breaking ground ceremony in the coming weeks, and into operation in the second half of the year.

The second phase of Jiake is expected to begin construction in Q2 2024, with operation in Q1 2027 which is still a few years away, which Ctee reports will continue to expand the market share of AI and HPC.

AMD and NVIDIA are both pumping out new generations of AI hardware, with the two GPU giants eating all of TSMC's advanced packaging capacity for not just 2024, but also 2025.

In a new report from UDN, the site reports that TSMC will contract advanced packaging production capacity of its in-house CoWoS and SoIC for this and next year, as AI GPU hardware orders aren't slowing down. TSMC expects revenue contributed by server AI processors to more than double this year, and once NVIDIA's new Blackwell B200 AI GPUs are being pumped out later this year, 2025 is going to be a bananas year for TSMC.

In response to the insatiable AI demand, TSMC is now actively expanding its advanced packaging production capacity, with industry estimates that TSMC's CoWoS monthly production capacity will be between 45,000 and 50,000 by the end of 2024. This is a gigantic 3x increase from the 15,000 in 2023, and it's expected to hit 50,000 in 2025.

AMD has announced that Nscale is the world's first AMD technology-focused cloud provider, using the company's new Instinct MI300X AI accelerators.

Nscale is a vertically integrated GPU cloud company spun out of Arkon Energy, with a 300MW data center and hosting business in the United States. Nscale is based in Northern Norway, with its N1 Glomfjord site featuring some of the cheapest renewable energy on the planet, making the N1 Glomfjord site one of the most cost-effective LLM and AI training hubs in the world.

Some of the key benefits and features of the Nscale cloud:

For quite some time we have been hearing how iOS 18 is expected to be Apple's biggest update ever to iOS, with reports even stating that internally Apple is referring to iOS 18 as "biggest update ever".

The main reason iOS 18 is so monumental is because it will be the time Apple implements artificial intelligence into its operating system. Rumors of this have been circulating for months and well documented by Bloomberg's Mark Gurman, who has reported Apple will be introducing a suite of new AI features that will include a revamped version of Siri, heavy AI integration into Apple's apps such as Apple Music, iWork apps like Keynote and Pages, and more overall customization.

Now, AppleInsider has learned more details about the AI implementation, with "people familiar with the software" telling the publication about the generative AI capabilities of the Ajax Large Language Model (LLM), Apple's generative AI model. The insiders said Ajax will power a feature that enables text summarization, which covers anything from webpages to messages. The feature will quickly read the on-screen text and provide summarized key points on the analyzed text.

X has rolled out an update that enables its Premium users to receive AI-generated summaries of news and topics trending on the platform.

The new feature called "Stories on X" has become available to Premium subscribers, and according to a post from the company's engineering account, the new feature will appear within the Explore tab and is entirely curated by X's GrokAI tool. So, how does it work? Grok has been leveraged to identify the most popular content trending on X, which can be news stories and any general public discussion that has gained a lot of attention.

Grok then digests the popular content and generates a summary. Users exploring the new feature have posted screenshots to X showcasing the design and layout, with some screenshots showing AI-generated summaries for stories such as Apple's earnings report, aid to Ukraine, and "Musk, Experts Debate National Debt," which was a summary of an online discussion between Musk and other prominent X users.

SK hynix has had an absolutely stellar last 12 months riding the ever-growing AI wave, with the South Korean memory giant expecting over $10 billion in revenue from HBM alone by the end of 2024.

The news is coming from South Korean outlet TheElec, which sums up that SK hynix has sold out of its 2024 supply of HBM memory, and is already close to selling out its 2025 supply of HBM. NVIDIA's current H100 uses HBM3, while its new H200 and next-gen B200 AI GPUs both use HBM3E memory, provided by SK hynix.

SK hynix is staying ahead of its HBM competitors in Samsung and Micron, with plans to provide samples of its new 12-stack HBM3E this month, with mass production of the new HBM memory chips expected in Q3 2024 according to SK hynix CEO Kwak Noh-jung at a press conference on Thursday.