Artificial Intelligence - Page 5

Samsung has still yet to pass HBM3E memory qualification from NVIDIA, and now it seems that won't be happening this year as it is "realistically impossible" for Samsung to supply its HBM3E to NVIDIA this year.

In a new report from Korean media outlet Daily Korea, we're learning that Samsung's supply of HBM3E memory to NVIDIA this year looks "impossible" in both 8-layer and 12-layer HBM3E form. The reason for the delay is that Samsung is reportedly still unable to meet NVIDIA's requirements for chip performance.

Daily Korea's source said: "It is realistically impossible for Samsung Electronics to supply 8-layer and 12-layer HBM3E to NVIDIA this year. The reason for the delay in supply is that we were unable to meet NVIDIA's requirements for chip performance".

Google's CEO Sundar Pichai has weighed in on the recent conversation surrounding AI and its development - Are leading AI companies struggling to scale AI models due to a lack of high-quality training data?

Reports indicate that top AI development companies such as Anthropic, OpenAI, and Google will soon hit a wall that will hinder the explosive performance jumps of AI models such as OpenAI's GPT, or Google's Gemini. However, according to former Google CEO Eric Schmidt, these assumptions about AI model scaling are unfounded, saying, "There's no evidence that the scaling laws have begun to stop. They will eventually stop, but we're not there yet."

These assertions that AI models will still continue to develop rapidly in the immediate future were subtly reiterated by OpenAI CEO Sam Altman, who wrote on X, "There's no wall". Current Google CEO Sundar Pichai joined in on the conversation at The New York Times' Dealbook summit, where he said, "I think the progress is going to get harder when I look at '25. The low-hanging fruit is gone. The hill is steeper." Pichai recognized there will be challenges ahead that simply can't be solved by throwing more compute at the AI model.

Marvell has just unveiled its new custom HBM compute architecture, enabling XPUs to have even higher levels of compute performance and memory density.

The new HBM compute architecture is available on all of its custom silicon partners, with Marvell collaborating with its cloud customers and leading HBM manufacturers SK hynix, Samsung, and Micron to develop custom HBM solutions for next-generation XPUs.

Will Chu, Senior Vice President and General Manager of the Custom, Compute and Storage Group at Marvell, said: "The leading cloud data center operators have scaled with custom infrastructure. Enhancing XPUs by tailoring HBM for specific performance, power, and total cost of ownership is the latest step in a new paradigm in the way AI accelerators are designed and delivered. We're very grateful to work with leading memory designers to accelerate this revolution and, help cloud data center operators continue to scale their XPUs and infrastructure for the AI era".

OpenAI has just created a more expensive version of its ChatGPT chatbot, with a new "reasoning" model series out of preview status with o1, costing $200 per month.

The new $200 per month subscription tier includes unlimited access to OpenAI o1, GPT-4o, and the new Advanced Voice mode. OpenAI is including a version of o1 that is exclusive to ChatGPT Pro subscribers, which provides more compute power to generate the best answer possible, even with the hardest questions or prompts.

The AI startup has compared its new o1-preview, with people paying $200 per month to expect a more powerful, faster, and more accurate model that is better at coding and math. The new o1 "reasoning" model is also able to respond to images, with OpenAI promising that it's been trained to be more concice, leading to faster response times than the o1-preview model.

NVIDIA CEO Jensen Huang attended the AI Vision event in Thailand last week, announcing a "sovereign AI" project with local AI company Siam.AI Cloud, the country's first Thai NVIDIA Cloud Partner.

In a new post from the Bangkok Post, we're learning that Siam.AI Cloud also announced comprehensive partnerships with leading institutions to drive the national digital transformation with "sovereign AI". NVIDIA CEO Jensen Huang has talked about sovereign AI many times in the past (in the links below) which refers to a nation's ability to provide AI using its own infrastructure, data, workforce, and business networks.

Jensen said: "Thailand recognizes the importance of having AI infrastructure and data. Siam AI Cloud is the first AI cloud in Thailand, the first AI language in Thailand, with the OpenThai GPT local large language model, and this is an extraordinary moment. And frankly, there are only 20 countries in the world that have done this".

UnitedHealthcare CEO Brain Thompson was killed in Midtown Manhattan earlier this week, and with the suspect currently on the run, the public has begun digging into a potential motive for the grim assassination.

With police having yet to make an arrest, publications have begun looking into UnitedHealthcare, and one of the points leading to a possible motive that has gained some attention is a lawsuit filed against UnitedHealthcare in November 2023. The lawsuit filed by two now-deceased individuals, but still ongoing and yet to reach a final conclusion, alleges UnitedHealthcare pressed employees to use an algorithm designed to evaluate how long a patient would be staying based on their condition and issue denials for coverage. Moreover, the suit alleges internally, UnitedHealthcare knew the algorithm had an error rate of approximately 90%.

Notably, the lawsuit specifically states that UnitedHealth and its subsidiary, NaviHealth, are using a computer algorithm reportedly called nH Predict to "systematically deny claims" for coverage for beneficiaries struggling to recover from illnesses while in nursing homes. A UnitedHealth spokesperson responded to the suit, stating the company doesn't use its NaviHealth predict tool to make coverage determinations and that the "lawsuit has no merit and we will defend ourselves vigorously."

TSMC is reportedly in discussions with NVIDIA to make its Blackwell AI GPUs in the USA, producing the world-leading AI chips at its new Fab 21 plant in Phoenix, Arizona.

In a new report from Reuters, we're learning that TSMC is "already making preparations to start production" in early 2025, according to Reuters' sources. NVIDIA unveiled its new Blackwell AI GPUs in March, and are now making their way into tech companies' hands in the form of B200 and GB200, with GB200 NVL72 AI server cabinets insanely popular.

If the agreement between TSMC and NVIDIA is made, it would see the Taiwanese contract manufacturer securing another high-profile client for its US semiconductor manufacturing. TSMC is already preparing to make next-gen chips for the likes of Apple and AMD on US soil, so if NVIDIA joins the party... it's going to be a rather big deal to have some of the most advanced AI chips made in the United States.

Elon Musk's xAI startup has promised to expand its Colossus AI supercomputer by 10x its computational power, with over 1 million GPUs in total... yes, 1,000,000+ AI GPUs.

xAI built Colossus in just 3 months earlier this year, with the world's largest AI supercomputer featuring over 100,000 x NVIDIA IA GPUs operating at once, training Grok for X, and more. The expansion project has already started, with the first step being increasing the size of the facility in Memphis, Tennessee.

NVIDIA, Dell, and Supermicro are going to establish operations in Memphis in order to support xAI's extension of Colossus, while FT reports that the chamber of commerce saying that it would establish an "xAI special operations team" in order to "provide round-the-clock concierge service to the company".

An OpenAI safety researcher has shared a message on her Substack saying she is quitting her position at the company as she believes her goal of implementing humanity-protecting policies into the development of AI can be better achieved externally.

OpenAI has seen a selection of pivotal staff members leave the company recently, and now another has been added to the list. Rosie Campbell joined OpenAI in 2021 with the goal of implementing safety policies for AI development, and now, according to a Substack post, the AI safety researcher is departing the company, citing several internal changes such as workplace culture and the ability to perform what Campbell believes is the most fundamental part of her job - AI safety.

Campbell wrote in the Substack post that she was a member of OpenAI's Policy Research team, where she worked closely with Miles Brundage, a senior staffer who worked at OpenAI's Artificial General Intelligence (AGI) team, a team dedicated to making sure the world is prepared for AGI when it's achieved. Notably, Brundage left OpenAI in October and published a letter on Substack citing concerns with OpenAI's internal policies regarding AGI safety and writing there are "gaps" in the company's readiness policy.

OpenAI has just announced its new "Shipmas" period, with new features, products, and demos for the next 12 days starting December 5.

The ChatGPT creator is expected to debut its much-anticipated text-to-video service codenamed Sora, as well as a new reasoning model according to sources "familiar with OpenAI's plans" according to The Verge. OpenAI CEO Sam Altman confirmed the 12 days of "Shipmas" event on-stage at The New York Times' DealBook conference on Wednesday morning, but didn't elaborate.

Leading up to the launch, OpenAI staffers were teasing some of the upcoming releases on X, with one of them posting "What's on your Christmas list?" while another posted "Got back just in time to put up the shipmas tree". Sora boss Bill Peebles responded to a staffer who said that OpenAI is "unbelievably back" to which he replied with a single word: "Correct".