Artificial Intelligence News - Page 3

All the latest Artificial Intelligence (AI) news with plenty of coverage on new developments, AI tech, impressive AI demos & plenty more - Page 3.

Follow TweakTown on Google News

Elon Musk says training next-gen Grok 3 will require 100,000 NVIDIA H100 AI GPUs

Anthony Garreffa | Apr 9, 2024 12:05 AM CDT

Elon Musk has talked about training his next-gen Grok 3 AI chatbot, saying it will require an insane 100,000 NVIDIA H100 AI GPUs.

Elon Musk says training next-gen Grok 3 will require 100,000 NVIDIA H100 AI GPUs

During a recent X spaces chat, the SpaceX and Tesla boss said that Grok 2 used around 20,000 NVIDIA H100 AI GPUs to train, but the new Grok 3 training will require a monster 100,000 separate NVIDIA H100 AI GPUs, a mammoth amount of AI compute power.

Musk said that the upcoming Grok model and beyond will require 100,000 NVIDIA H100 AI GPUs, so we can expect Grok 4 to require an unimaginable amount of AI GPU compute power. NVIDIA has now announced its new Blackwell B200 AI GPU, which I'm sure Elon has been eyeing off... which will be pumped out later this year, and flood the market in 2025 with brute force AI GPU performance.

Continue reading: Elon Musk says training next-gen Grok 3 will require 100,000 NVIDIA H100 AI GPUs (full post)

Samsung announces it has manufactured a sample of 16-stack HBM for AI GPUs

Anthony Garreffa | Apr 8, 2024 11:33 PM CDT

Samsung has announced that it has manufactured a sample of its brand-new 16-stack HBM. The company manufactured the chip with hybrid bonding last week.

Samsung announces it has manufactured a sample of 16-stack HBM for AI GPUs

Samsung vice president Kim Dae-woo said the South Korean giant made its new 16-layer HBM with HBM3 but plans to use HBM4 to improve productivity. Due to alignment issues, Samsung was expected to use hybrid bonding for just one or two stacks of the HBM chip but applied the hybrid bonding technique to all 16 stacks.

The 16-stack HBM memory sample was made using equipment from Samsung's fab equipment subsidiary, Semes, with Kim noting that Samsung considered using hybrid bonding or thermal compression non-conductive film for HBM4, which Samsung will be sampling in 2025 and mass producing next-gen HBM4 memory in 2026.

Continue reading: Samsung announces it has manufactured a sample of 16-stack HBM for AI GPUs (full post)

Elon Musk has between 30,000 and 350,000 x NVIDIA H100 AI GPUs training Tesla and xAI

Anthony Garreffa | Apr 8, 2024 7:33 PM CDT

We know SpaceX and Tesla boss Elon Musk loves hardware as much as he loves AI, so it's no surprise that he's posting on X that Tesla has the second-highest H100 AI GPU count in the world.

Elon Musk has between 30,000 and 350,000 x NVIDIA H100 AI GPUs training Tesla and xAI

In a reply to @thetechbrother on X who posted that Meta has 350,000+ NVIDIA H100 AI GPUs, with a bunch of other companies -- including Tesla -- and how many H100 AI GPUs they've got so far. Elon replied to that, saying "this is not accurate. Tesla would be second highest and X/xAI would be third if measured correctly".

Continue reading: Elon Musk has between 30,000 and 350,000 x NVIDIA H100 AI GPUs training Tesla and xAI (full post)

Samsung wins advanced chip packaging order from NVIDIA for AI GPUs, TSMC isn't enough

Anthony Garreffa | Apr 7, 2024 10:33 PM CDT

Samsung has reportedly won a contract with NVIDIA to provide the AI GPU giant with advanced 2.5D packaging.

Samsung wins advanced chip packaging order from NVIDIA for AI GPUs, TSMC isn't enough

The news is coming from TheElec, with their sources saying Samsung's Advanced Package (AVP) team will be providing an interposer and I-Cube -- its 2.5D package -- to NVIDIA. Other companies will produce the High-Bandwidth Memory (HBM) and GPU wafers, with the 2.5D packaging housing the chip dies-CPU, GPU, I/O, HBM, and others-placed horizontally onto the interposer.

Samsung calls its 2.5D packaging technology I-Cube, while TSMC calls its 2.5D packaging CoWoS (Chip-on-Wafer-on-Substrate). NVIDIA's entire fleet of A100 and H200 series AI GPUs uses 2.5D packaging, and more importantly, the monster new 208 billion transistor Blackwell B200 AI GPU uses the same advanced packaging.

Continue reading: Samsung wins advanced chip packaging order from NVIDIA for AI GPUs, TSMC isn't enough (full post)

OpenAI's Sam Altman and Jony Ive are teaming up on a new personal AI device, but they need cash

Oliver Haslam | Apr 6, 2024 3:30 PM CDT

Jony Ive, Apple's former head of design, is reportedly working with OpenAI CEO Sam Altman on a new AI-powered personal device with the pair now seeking funding for the new project.

OpenAI's Sam Altman and Jony Ive are teaming up on a new personal AI device, but they need cash

The news, shared by The Information, means that the pair have teamed up on what could be a new device similar to the Humane AI pin or something along those lines. Notably, Altman is also a major investor in Humane so there are clear links there.

Details on exactly what the product will be are hard to come by right now but it apparently won't be like a smartphone, something that will surely be music to the ears of Apple's executives. This also isn't the first time that we've heard that the pair are working together after information surfaced last fall. However, things seem to have now progressed somewhat with the two people now thought to be seeking funding to the tune of $1 billion.

Continue reading: OpenAI's Sam Altman and Jony Ive are teaming up on a new personal AI device, but they need cash (full post)

AI safety expert predicts a 99.999999% chance of p(doom). What's that mean? Well, it isn't good

Darren Allan | Apr 3, 2024 10:24 AM CDT

Could AI spell doom for humankind eventually? Depending on which expert you talk to, the chances vary considerably, but one researcher definitely has a gloomy (and doomy) opinion - one that Elon Musk doesn't share.

AI safety expert predicts a 99.999999% chance of p(doom). What's that mean? Well, it isn't good

Business Insider reported on revelations made at the recent Abundance Summit (held last month), which included a 'great AI debate' where Musk estimated the risk of AI ending humanity was "about 10% or 20% or something like that."

Obviously that's something akin to wild guesswork, but the general gist of the billionaire's philosophy is that we should push ahead with AI development as the probable positive outcomes outweigh any negative scenario.

Continue reading: AI safety expert predicts a 99.999999% chance of p(doom). What's that mean? Well, it isn't good (full post)

Apple's new AI system can 'see' and could be a game-changer for Siri

Jak Connor | Apr 3, 2024 1:27 AM CDT

Apple is diving head first into artificial intelligence-powered systems and according to reports citing Apple researchers behind these new systems, one specifically is designed to take on OpenAI's GPT products.

Apple's new AI system can 'see' and could be a game-changer for Siri

Reports indicate that Apple is developing the ReaLM system, which stands for "Reference Resolution As Language Modeling", a new system that is designed to make interacting with AI much more natural. Additionally, ReaLM is able to "see" on-screen content, with the researchers behind the project saying it outperforms OpenAI's GPT-4, the underlying technology powering ChatGPT, in determining context and interpreting linguistic expressions.

Additionally, the researchers behind the project believe ReaLM is "an ideal choice" for a context deciphering system that would be present "on-device without compromising on performance". So, how would it work? Imagine asking Siri to show you a list of local groceries around your location. After Siri has completed bringing that list up you will then be able to ask her "Call the bottom one." With ReaLM implementation Siri would be able to identify the bottom option and proceed to call them. Apple researchers say ReaLM outperformed GPT-4 in this context deciphering area.

Continue reading: Apple's new AI system can 'see' and could be a game-changer for Siri (full post)

Samsung shows off next-gen 3D DRAM tech, should hit the market after 2030

Anthony Garreffa | Apr 2, 2024 6:03 PM CDT

Samsung has just unveiled its next-generation 3D DRAM technology for next-generation memory solutions, with a single-chip capacity of over 100GB, a massive leap over current limitations in DRAM technology.

Samsung shows off next-gen 3D DRAM tech, should hit the market after 2030

Samsung made the announcement at the recent Memcon 2024 conference. With DRAM line widths expected to fall below 10nm in the coming years, current memory architectures are getting close to their scaling limits. This is where 3D DRAM will come into play, boosting memory capacity and reducing its footprint.

Samsung talked about two different key technologies for 3D DRAM: Vertical Channel Transistors and Stacked DRAM. Starting with Vertical Channel Transistors (VCT), which will be a fundamental change in transistor design, where the current flow channel is changed from horizontal to vertical, Samsung aims to massively reduce the transistor's footprint. VCT requires much higher precision during the etching process, so there are caveats.

Continue reading: Samsung shows off next-gen 3D DRAM tech, should hit the market after 2030 (full post)

US Government wants tech companies to go nuclear to meet the power demands of AI data centers

Kosta Andreadis | Apr 2, 2024 1:33 AM CDT

The AI boom is in full swing, with Microsoft and OpenAI teaming up to build a $100 billion AI supercomputer, Amazon planning to spend $150 billion on data centers, and Meta planning to install 50,000 NVIDIA H100 GPUs by the end of 2024. These are mind-boggling projects, and with powerful GPU hardware at the heart of them, you can be sure that the power bills will be astronomical.

US Government wants tech companies to go nuclear to meet the power demands of AI data centers

Governments and big tech are aware of the "AI power issue" and are looking at nuclear energy as a potential solution. US Energy Secretary Jennifer Granholm spoke with Axiom to confirm that it plans to accelerate discussions with companies like Microsoft, Google, and Amazon to host "small nuclear plants" next to their massive data centers.

"AI itself isn't a problem because AI could help solve the problem," Granholm said, nodding toward the AI boom as a good thing.

Continue reading: US Government wants tech companies to go nuclear to meet the power demands of AI data centers (full post)

OpenAI makes ChatGPT extra free but with one big catch

Jak Connor | Apr 2, 2024 1:16 AM CDT

OpenAI has decided to make ChatGPT even more accessible than it already is, as users now don't have to make an account to use the artificial intelligence-powered tool.

OpenAI makes ChatGPT extra free but with one big catch

TechCrunch has reported that starting today users will no longer have to make an account to access the world's most popular AI-powered chatbot, with the company behind the tool, OpenAI, telling the publication that the even freer version will use the same large language model as logged in users, but with some changes. Searching for chat.openai.com will now bring users to an open conversation with ChatGPT, but unlogged in users won't get access to the AI's full range of features such as saving chats, using custom instructions, and more.

Notably, users without an account will still be able to disable OpenAI using chats for training its model, which can be achieved by heading to the question mark in the lower right-hand side, clicking "settings" and then navigating to the disable data tracking toggle. Furthermore, the even freer ChatGPT will come with "slightly more restrictive content policies," which are seemingly not specified. When asked by TechCrunch and OpenAI spokesperson responded with the below message.

Continue reading: OpenAI makes ChatGPT extra free but with one big catch (full post)