Researchers use Stable Diffusion AI to translate brain waves into images

Examples of AI creating accurate images from brain waves is the sort of stuff from Cyberpunk novels, except it's real and impressive.

1 minute & 10 seconds read time

The power of AI in image generation is undeniable, and we've seen some remarkable strides in this space in recent months - with Stable Diffusion being one of the leaders. That said, the latest revelation sounds pretty incredible, as it could lead to a situation where AI can reconstruct accurate images based on your memories. It sounds like something from Cyberpunk 2077, except real.

Researchers use Stable Diffusion AI to translate brain waves into images 01

A new research paper from Yu Takagi and Shinji Nishimoto, from the Graduate School of Frontier Biosciences at Osaka University, outlines how it's possible to reconstruct high-resolution and accurate images from reading brain activity gained from fMRI signals "without the need for any additional training and fine-tuning of complex deep-learning models."

You can see some examples of image reconstruction above, with the presented images in the top row and the reconstructed images from brain waves in the bottom row. There's a definite dreamlike quality to the results, which is fascinating.

Granted, the images are only 512x512 in terms of resolution, but it's impressive nonetheless.

Previous studies in this field have used different generative models, but using the Stable Diffusion image generation model has resolved several limitations. Training complex models with limited samples is even more complicated when dealing with neuroscience. The use of AI in this way is groundbreaking and could pave the way for a future where memories can be recorded or even present a new form of art that complements someone's imagination.

If you want to learn more about the study, methodology, and findings, be sure to read the entire research paper (available in PDF here).

Buy at Amazon

Eilik - an Interactive Companion Robot

TodayYesterday7 days ago30 days ago
* Prices last scanned on 9/30/2023 at 12:54 pm CDT - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.

Kosta might be a relatively new member of TweakTown, but he’s a veteran gaming journalist that cut his teeth on well-respected Aussie publications like PC PowerPlay and HYPER back when articles were printed on paper. A lifelong gamer since the 8-bit Nintendo era, it was the CD-ROM-powered 90s that cemented his love for all things games and technology. From point-and-click adventure games to RTS games with full-motion video cut-scenes and FPS titles referred to as Doom clones. Genres he still loves to this day. Kosta is also a musician, releasing dreamy electronic jams under the name Kbit.

Newsletter Subscription

Related Tags