Meta, owner of Facebook, works on artificial intelligence research generate worlds through speech, improve how people talk to voice wizards and translate between languages, said CEO Mark Zuckerberg on Wednesday, while he was drawing out key steps for building the metaverse.
Zuckerberg bets the metaverse, a futuristic idea of virtual environments where users can socialize and play will be the successor to the mobile the Internet.
“The key for unlocking many of that progress is AI,” he said, speaking at the company’s conference. live-broadcast “Inside the Lab” event.
Zuckerberg said Meta works on a new to classify of Generative AI models It’s okay allow people describe a world and generate aspects of this. In a pre-recorded demo, Zuckerberg demonstrated an AI concept called Builder Bot, where he appeared as a legless 3D avatar. on an island and gave voice commands to create a beach, then add clouds, trees and even a picnic blanket.
“As we move on technology further, you can create nuanced worlds to explore and share experiences with others, with just ton voice”, Zuckerberg said. He did not set a timeline for this progress or give more details on how Builder Bot works.
He said Meta was working on AI research for allow people to have more natural conversations with voice assistants, a step towards how people will communicate with AI in the metaverse. He said the company’s CAIRaoke project was “an end-to-end neural system model for building on-device assistants.”
A demonstration of the CAIRaoke project tech showed a family using that to help cook a stew, with the voice wizard chime in to warn that the salt had already summer added in the pot. The wizard also noticed they were weak on salt and ordered more.
Meta said it was using the model in son video call portal device and aiming to integrate it into devices with increase reality (RA) and virtual reality (RV). He said he was narrowly restricting responses of son new CAIRaoke-based assistant until he can ensure that the system did not generate offensive language.
Zuckerberg also announced that Meta was working on a universal voice translator, aiming to provide instant speech-to-speech translation in any language. The company before set a goal for son AI system for translate all written languages.
the social media company, which recently lost a third of son market value after a lamentable earnings report, has invested a lot in son new to concentrate on building the metaverse and changed son name to reflect this ambition. This month, Meta reported a 2021 net loss of $10.2 billion from its Reality Labs, the augmented system and virtual reality business.
On Wednesday, Zuckerberg said Meta was preparing for how AI could interpret and predict types of interactions that would be occur in the metaverse, working on “learning auto-supervised” – where the AI receives raw data rather than being trained on many of labeled data.
Zuckerberg said Meta was also working on egocentric data, which involves seeing the worlds of a first- person’s point of view. He said he had assembled a global consortium of 13 universities and laboratories for work on most grand egocentric dataset ever created, called Ego4D.
In a nod to transparency, Meta plans make open source the TorchRec recommendation library that enables product customization like Facebook news feed,” said Jérôme Pesenti, vice-president of AI, in another one event session. The company also will publish a stream ranking prototype for show how its algorithms prioritize content it displays to users on Instagram, he says.
Facebook also said he would expand free education initiatives aimed at more racial minorities in techwhat researchers say are critical create AI systems for free of bias. About 80% of data analytics and AI executives identify as men and 65% as white, according to a recent survey conducted in the United States and Europe by recruiter Heidrick & Struggles.
Some of Meta projects announced on On Wednesday, like the CAIRaoke project and the Algorithm Transparency effort, follow similar innovations announced in in recent years by rivals such as Alphabet Inc.’s Google.
Meta also recently announced son research team at built a new artificial intelligence supercomputer which he says will be the fastest in the world when finished in mid-2022.