Facebook researchers are working on keyboard-less typing for VR

Facebook Reality Labs researchers are working on a technique to use tracked fingers are a virtual keyboard in Oculus VR headsets.

Published Oct 21, 2020 8:39 PM CDT   |   Updated Mon, Nov 2 2020 10:53 PM CST
1 minute & 13 seconds read time

Facebook's Quest 2 gives you multiple ways to interact with digital content, including motion controllers and hand tracking. It's also working with Logitech to bring keyboards into the virtual office. But what if you didn't need a keyboard to type in VR? Facebook's latest experiment does just that.

Facebook researchers are working on keyboard-less typing for VR 01

Facebook Reality Labs researchers have been developing new text input methods that work better in VR. Pointing your controller at a virtual keyboard gets the job done, but it's hardly intuitive and definitely a step backwards for productivity. In September, Facebook revealed that it's working with Logitech to build trackable keyboards for Quest 2, but you may not have to buy hardware to get a good typing experience in VR.

Facebook's researchers recently demonstrated a virtual keyboard solution that allows you to type on any flat surface. Facebook developed a motion model derived from speech recognition technology to analyze hand motion to predict your keystrokes. Facebook said that typists who tried the experiment averaged 73 words per minute, which was consistent when their typical keyboard typing speed.

Facebook's virtual keyboard technology isn't yet ready for primetime. In fact, the experiment wasn't even performed with Facebook's hand tracking technology. The research team relied on an external tracing system with around a dozen markers on each hand to prove the concept.

It's unclear when or if we'll see the virtual keyboard technology on Quest 2 or if it will be part of a future Oculus headset. For now, Facebook is taking the insights that in gleaned from the test, such as the fact that hand tracking works better for virtual keyboards than touchscreen surfaces to steer the direction of its future research.


Kevin joined the TweakTown team in 2020 and has since kept us informed daily on the latest news. Kevin is a lifelong tech enthusiast. His fascination with computer technology started at a very young age when he watched a family friend install a new hard drive into the family PC. After building his first computer at 15, Kevin started selling custom computers. After graduating, Kevin spent ten years working in the IT industry. These days, he spends his time learning and writing about technology - specifically immersive technologies like augmented reality and virtual reality.

Newsletter Subscription

    Related Tags

    Newsletter Subscription
    Latest News
    View More News
    Latest Reviews
    View More Reviews
    Latest Articles
    View More Articles