Sony VASG game R&D division to use machine learning for facial capture

Sony VASG is using new AI-based machine learning methods to boost facial capture technologies for next-gen PlayStation 5 games.

1 minute & 49 seconds read time

Sony's Visual Arts Service Group is using AI and machine learning to help optimize its advanced facial capture techniques for future PlayStation exclusives.

Sony VASG game R&D division to use machine learning for facial capture 34

A new job listing on Sony's VASG department confirms the division is using experimental R&D tech to bring next-gen visuals to life. The division is currently hiring a Senior R&D Engineer for its Facial Realism Technology segment to streamline its motion, body, and facial capture tech. Sony VASG has worked on every major first-party PlayStation exclusive, and will use AI-based machine learning to help automate capture processes.

"We seek research engineers in the field of Computer Vision, Machine Learning, and Advanced Computer Graphics to help develop solutions that will advance our facial performance capture," the listing reads.

"If you're ready to join an elite R&D team working on the future technology of AAA games like Uncharted, God of War, Spider-Man, and more, please apply!"

Sony VASG is working directly with Sony's AI division on this tech. This job listing goes hand-in-hand with a Senior Machine Learning Engineer opening that was posted in February, which focuses on developing the AI algorithms that will power the facial automation process.

"We seek a Machine Learning Engineer passionate about developing algorithms. Here, you will develop algorithms with clear technical documentation and prototypes that demonstrate high quality results. You will be tasked to advance our production technology and tools related to performance capture and virtual humans," the ML listing reads.

The fruits of this partnership have already shown up in key games like Spider-Man Miles Morales, which uses machine learning inference via a special algorithm to augment in-game models in real-time.

"Our team is passionate about crafting the next generation of digital humans. We've been pushing the limits of realistic humans in games for the last 15 years and are at the forefront of the newest technology in gaming," the VASG listing says.

It's likely this technology is being used to power new PlayStation games like Horizon Forbidden West as well as next-gen PS5 exclusives like the new God of War.

Buy at Amazon

The Last of Us Part II - PlayStation 4

TodayYesterday7 days ago30 days ago
* Prices last scanned on 2/21/2024 at 4:53 am CST - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.

Derek joined the TweakTown team in 2015 and has since reviewed and played 1000s of hours of new games. Derek is absorbed with the intersection of technology and gaming, and is always looking forward to new advancements. With over six years in games journalism under his belt, Derek aims to further engage the gaming sector while taking a peek under the tech that powers it. He hopes to one day explore the stars in No Man's Sky with the magic of VR.

Newsletter Subscription

Related Tags