Roblox announces AI tool for generating 3D game worlds from text

Were making it so anyone can create anything on Roblox The only limit is their own creativity

We also spoke with Roblox Studios head Stefano Corazza about the future of Roblox together with such technology. Sturman said the hope is for the translator model to move past just translating text chats eventually. “In the future, we could use AI to translate non-compliant [banned] words to compliant words or throw it at voice chats for real-time voice translation. In the coming months, Roblox will begin offering a new solution to help developers optimize in-experience pricing. Price Optimization, a recommendation tool, runs price tests to identify the most attractive pricing strategy.

Thinking Outside the Blox: How Roblox Is Using Generative AI to Enhance User Experiences - NVIDIA Blog

Thinking Outside the Blox: How Roblox Is Using Generative AI to Enhance User Experiences.

Posted: Wed, 26 Jun 2024 07:00:00 GMT [source]

Beyond conversational AI and rapidly evolving art tools, it's the way AI is moving into being a copilot for coding that grabs me the most. I don't know how to code, and I've often found game creation tools, even ones like Sony's Dreams on PlayStation, to be intimidating. But much more so than in any other capacity, it looks like a way to quickly enable complicated creations. Roblox, like many companies, believes it’s well equipped to use AI to help people who use its services. We know what it means to enable creators.” Its AI tools do seem genuinely useful; I’ve always wanted to make a video game, even though I don’t know how, and the Roblox Assistant seems like something that could at least help me get started. I’m generally skeptical of generative AI, but I think this is a pretty interesting use for the technology.

Google appealed again, and yesterday, the EU’s highest court, the Court of Justice of the European Union (CJEU), upheld the original ruling. In a separate case, the same court determined that Apple received an unfair tax break on profits between 2003 to 2014. The company must now pay $15 billion in back taxes and fees to Ireland, where Apple’s European headquarters are located. And then there are the lawyers, who understandably worry about the potential for hallucinations or other bad actions on the part of generative AI. The legal team at Comcast allowed the IT team to put generative AI into production only with legal warnings saying the information had been generated with AI, said Mahajanam.

And about $893.5 million was generated in revenue in Q2 2024, up 31% year-over-year. To do that, Roblox will focus on three key areas, Baszucki said at the tenth annual Roblox Developers Conference in San Jose, California, today. Those areas are helping creators, bringing people together to scale their creations and audience and build their businesses. Similar to the feature-rich analytic suites found in engines like Unreal and Unity, Roblox says the inaugural analytical tools – called Economy and Funnel event analytics – will help developers better understand in-app spending and player retention. Roblox Corp is rolling out a new range of analytical tools for developers to "track funnel and economy events to grow your experience faster". But none have been able to simulate the experience of having true autonomy in a virtual world.

Our AI translation technology is already growing the community by breaking down language barriers, helping more people to access everything Roblox has to offer with no geographic restriction. This mindset is all about lowering the barrier to entry and facilitating creation of anything for anyone, anywhere. We want to unlock the creativity of millions of creators to build better, more diverse UGC scenes, games, and items across Roblox. Roblox’s new tool works by “tokenizing” the 3D blocks that make up its millions of in-game worlds, or treating them as units that can be assigned a numerical value on the basis of how likely they are to come next in a sequence. This is similar to the way in which a large language model handles words or fractions of words. If you put “The capital of France is ...” into a large language model like GPT-4, for example, it assesses what the next token is most likely to be.

Tech News Roundup for the Week Ending Sept. 20, 2024

Roblox’s venture into generative AI began with the introduction of Code Assist and Material Generator earlier this year. These tools, currently in beta, automatically generate code and object textures, streamlining the game development process. Microsoft was thefirst to harness the latest generation of AI for coding, through a deal with OpenAI, which has adapted a general purpose language technology called GPT to power a code generator called Codex. Microsoft enhanced the Codex’s coding abilities by feeding it more data from GitHub, a popular repository for software development, and has made it available through its Visual Studio programming application. Roblox says the code-making AI it uses relies on a combination of in-house technology and capabilities from outside sources, although it is not disclosing where from.

But there’s still work to be done, she said at the GenAI Productionize 2024 virtual event hosted by Galileo, a generative AI company. "This is an industry-wide challenge, and many companies are working to bring greater controllability into generative AI. As we begin to solve the challenges on this road to 4D, our creators will be able to create more, faster." It aims to build AI tools that understand the individual parts within objects. For example, that a car isn’t one fixed item, but the product of an engine, wheels, and more - so that elements can function independently and with other objects, at scale, with individual modifiers.

And, Roblox is exploring a Roblox-supported architecture for server authority for competitive games. Roblox is focused on providing the technology to support scale — for performance, creation, and safety. Early next year, Roblox will add an application programming interface (API) that will allow developers to expand the Party experience. Developers will be able to teleport Party members to the same starting point, drop them into a private lobby, or pre-pair them into a team. In the second quarter of 2024, daily active users grew by double digits in each of the regions where Roblox is available — and more than 20% in the U.S. and Canada; Asia; and Rest of World. Of the 79.5 million users who come to Roblox daily, 58% are aged 13 or older.

Roblox is aiming for Westworld-like ease of design with generative AI tools

Right now, AI can only think in three dimensions of static content — text, images, and 3D models. But, Roblox wants to teach AI to produce 4D content that interacts seamlessly with the game environment. That means going beyond superficial 3D models to create replicas of objects as they exist in reality. Meanwhile, Texture Generator empowers creators to swiftly alter the appearance of 3D objects using text prompts.

Though Apple's Vision Pro and Meta's Quest 3 are going to lead the way with a new wave of mixed reality–enabled VR headsets, Roblox isn't making any announcements on that front right now. But it looks like Roblox is going to lean on its creative community to suss that out when the time comes. I'm curious about when these tools will emerge in the everyday Roblox app. There are already developers hooking in ChatGPT into Roblox now, but Roblox aims to eventually have some of these creative tools come outside of Studio. Both of those functions might sound familiar to you if you've experimented AI chatbots — GPT-3 can already create functional code snippets based on prompts.

As of June 2nd, 2024, approximately 535 million characters of code have been suggested by the AI-powered Code Assist alone. "Across the industry, 1D and 2D are state of the art, and 3D is at the cutting edge of generative AI," Roblox chief scientist Morgan McGuire shared in a blog post. In practice, this will mean creating objects through generative AI that can interact with one another dynamically. In the same vein, the company is going to start experimenting with regional pricing recommendations to allow developers to tailor their prices to local markets. Last year, GamesIndustry.biz spoke to Roblox CTO Daniel Sturman about its conversational AI tool Roblox Assistant, and how the company intended to use generative AI across various aspects of its platform. "We will combine our internal research and development teams, university collaborations, and rapid iteration of prototypes in partnership with our community."

That age group saw 26% growth year over year in the second quarter of 2024. Roblox also recently revealed it was working towards providing players the ability to create characters and objects with "4D generative AI". But the bigger question of whether AI will be able to assist in creating authentic virtual world experiences that rival real life, still remains to be answered. Current approaches range from multiplayer survival games that refuse to offer you a fixed goal, to layered roleplaying titles with different dialogue options and alternate pathways to approach a scenario.

The system can translate between any combination of the supported languages with approximately 100-millisecond latency, creating near-instantaneous conversations. Previously, Roblox used AI to translate static game content but not real-time interactions. Roblox is an online game platform and game creation system that is built on user-generated content. Soon, developers can use a generative AI tool, the 3D Foundations Model, to construct 3D elements with text prompts, images, or even videos. The model will be open source in the hope that it will gain wider adoption in the gaming industry. Roblox Assistant also enables rapid 3D scene prototyping from text prompts.

• Because of those growing numbers — and because the game industry has seen an unprecedented wave of layoffs in the past two years driven by dropping numbers — all eyes are on Roblox.
• We think for developers, this is going to accelerate quality up and down the stack.
• This would allow game developers to set the state for unscripted interactions within the world.
• For this first round of features we have mostly targeted existing users to make them more productive; although we have also significantly lowered the barrier for new users.
• For example, if a creator asks to create a texture for a 3D wooden treasure chest, Texture Generator will create a texture that accentuates the chest’s sharp corners and takes into consideration features like the wooden planks and the lock.

"Our custom large language model is so fast we're able to do real-time translations from any one of 16 languages to any of the others as people type to help them connect in real time, no matter where they're from," said Roblox CTO Daniel Sturman. Automatic chat translation features are available now in any and all Roblox experiences leveraging the platform’s chat engine, TextChatService, with ambitions for Roblox to grow beyond global accessibility and into true localisation. Built upon Roblox’s "proprietary artificial intelligence technology", this latest tech addition completely removes the language barrier between players (provided they speak one of the 16 supported languages), as the AI can translate messages live. Popular online creating and gaming platform Roblox has launched its latest AI feature this week, this time with a focus on connecting players around the world rather than generative content production as was prevalent last year. At a product level, we openly announce our goals for the year at our annual developer conference. We’re a company that is confident in our ability to iterate in public in collaboration with our community.

Roblox is sharing some early demonstrations from an incubation project the company launched a few months ago with a team of researchers and engineers. The 3D foundational model will be open source and multimodal, and it will power 3D generation through text, video, and 3D prompts. People play on Roblox every day in ways that are impossible elsewhere — and now it wants to make it even easier. He said the Party feature will enable friends ages nine or older to seamlessly group up, discover, and join their favorite experiences together. Party will also let friend groups communicate via text and (for phone-verified users aged 13 or older) voice, both within and outside of Roblox experiences. More specifically, the company wants 10% of all gaming content revenue to flow through the Roblox ecosystem and be distributed within the community of creators.

It has been so exciting to see how creators are using Code Assist, as well as how we’ve been able to finetune the model in tandem. Code Assist is a valuable tool for developers of any experience level, but it’s not the only AI-assisted tool for creation. AI also plays a role in bringing users together and scaling access on Roblox. Thanks to our real-time translation technologies, we’re making something possible on Roblox that isn’t even possible in the physical world — enabling users to relate to and engage with people and content from around the world. We believe 10% of all global gaming revenue will flow through the Roblox ecosystem – and be distributed within our Roblox community.

The GitHub Copilot AI coding assistant was one of Microsoft’s earliest projects employing OpenAI’s large language models, and the  pair programmer has become very popular. On the visual front, Roblox creators have already started using text-to-image AI tools like DALL-E and Midjourney, and OpenAI recently opened a new dimension of creation through its POINT-E text-to-object generative AI  tool. Roblox has plans to encourage creators to embed all kinds of generative AI tools in its metaverse in addition to its home-grown features. The Roblox metaverse is set to revolutionize game creation with the power of generative AI!

Back in February, Roblox revealed its vision for the future of AI on its platform, particularly regarding users of Roblox Studio; the tool offers developers across a range of skill levels control over building new environments. Roblox is testing a tool that could accelerate the process of building and altering in-game objects by getting artificial intelligence to write the code. Roblox, the online multiplayer game that’s more of a shared virtual universe, thinks that the solution could be found in generative AI. With its new suite of AI-powered creator tools, Roblox is trying to decode the 4th dimension of game development — interaction.

Roblox is working towards providing players the ability to create characters and objects with "4D generative AI". The combinatorial complexity and variety of AI models also helps generate unique outputs that the creator can then take in further unique directions. Instead of implementing new UX paradigms and tools, you can simply provide Assistant a set of examples and that functionality will be live and integrated with existing creation and coding workflows. You already know that agents and small language models are the next big things. A string of startups are racing to build models that can produce better and better software.

She details Imbue’s approach to building reasoning capabilities into its products, the challenges of verifying the correctness of AI outputs and how Imbue is focusing on post-training and fine-tuning to improve verification capabilities. —Govind Balakrishnan, senior vice-president of creative platform Adobe Express, laments the growing trend for jobseekers to use the same AI tools to write their applications to the Financial Times. By the end of this decade, AI will likely surpass humans at all cognitive tasks, igniting the scientific revolution that futurists have long imagined.

It's the kind of feature that, if it wasn't in Roblox, would have most of us fulminating. Whether Roblox can deliver what it says it can, however, remains to be seen. But one of the genuinely impressive touches came when Baszucki gave a flourish in the direction of AI, which Roblox has been gradually integrating into its creator development tools for years. It has a tool that helps automate creating textures, for example, but apparently we ain't seen nothing yet. So, with the foundational tools already in place, Roblox is now looking towards 4D - the interaction between people, objects, and environments. The system will also reportedly let users make modifications, such as changing the time of day or swapping out entire landscapes, and Roblox says the multimodal AI model will ultimately accept video and 3D prompts, not just text.

AI is already being used in games for eliminating inappropriate languageThis new Roblox development comes after the company introduced AI to analyze in-game voice chat in real time last fall. If the AI determines that a player is using foul language, it will issue a warning, and then a ban if restricted words keep coming. A tool developed by the team at Roblox aims to allow developers to make 3D environments and scenes in an instant with nothing but text prompts. Typically, creating an environment may take a week for a small game or much longer for a studio project, depending on how complex the designs are. But Roblox aims to let developers almost instantly bring their personal vision to life. Texture Generator enables creators to use text prompts to quickly change the look of 3D objects.

Corazza refers to Roblox's own metaverse, and its hundreds of millions of users, as an example. "Until now, just the scale of content that was needed was not met," Corazza says, referring to metaverse platforms. With the Roblox Assistant, creators will be able to type in prompts to do things like generate virtual environments. In one demo, somebody types in “I want to make a game set in ancient ruins,” and Roblox drops in some stones, moss-covered columns, and broken architecture. “Make the player spawn by a campfire in the ruins” adds a campfire and a stool. Roblox will grab assets from either its marketplace or your own visual asset library, according to Roblox spokesperson Roman Skuratovskiy.

• The first half of 2023 has been full of developments in the AI space, with the technology becoming increasingly prevalent in the public eye and growing in popularity in the form of chatbots, art generators and more.
• Visual Studio and other AI-enabled programming environments typically write code in response to a developer’s comment or when the user starts typing.
• Therefore, Roblox users will be able to craft intricate worlds and games by merely typing their ideas.
• Roblox deployed a large model (now considered a small model) called Bert back in 2020.

Avatar Auto-Setup is available in alpha, and Texture Generator is available in a public beta and can be accessed in Roblox’s advanced development environment, Roblox Studio. And what are your predictions regarding the mass adoption of AI within games? From cataloguing the year’s biggest breakthroughs in emerging technology to exploring the far future, 2024 kept us busy. Researchers have devised a way to make computer vision systems more efficient by building networks out of computer chips’ logic gates. A nerd with a passion for open source software, building custom gaming rigs/workstations, motorsports, and more. Well, to mitigate that, there's a second AI model that has been trained on 2D data from both open-source and licensed data sets to moderate the first one's output.

Metaverse platform Roblox has introduced two new generative AI tools for game developers in beta called Code Assist and Material Generator. The new features follow Roblox’s generative AI strategy that the company recently outlined, aiming at accelerating and streamlining object design and deployment in its digital universe. It'll also likely accelerate the process of creating new experiences in Roblox.

Roblox sees a huge opportunity for the AI community itself to become creators on the Roblox platform. This work involves unique technical challenges as the company tackles the ability to generate 3D models with event handlers, an animation rig, and physical properties. While the engine is an underlying portion of the platform, it is up to the creator to build or otherwise acquire everything in the experience, Sturman said.

Don't miss tomorrow's marketing industry news

That turns out to be a lot of potential training data for AI models, and also a lot of potential generative AI inference cost. “We see generative AI tools being applicable to each of these different creative processes. What we have already started to see through internal prototypes is that specialized generative AI tools can not only accelerate creator productivity, but can significantly drop the technical skill needed to bring ideas to life,” Sturman said. Sturman said generative AI learns the underlying patterns and structures of data and generates new content, such as images, audio, code, text, 3D models or other forms of media, that have not been seen before. Roblox's multistage plan is to have these cross-platform sellable items be applied to avatars, then to objects that could move across experiences, and then even to larger creations and worlds.

Just as generative AI capabilities were being rolled out last year, we spoke with Roblox Studios head Stefano Corazza about using this technology to democratise content and empower more people to create. All of the features announced today are part of Roblox’s ambitious goal of having 10% of all gaming content revenue worldwide flow through its ecosystem. Although the company didn’t provide a timeline for when it aims to reach this goal, Roblox believes the changes it is introducing will help it achieve the milestone.

Roblox reveals more details about its work on 4D generative AI - VentureBeat

Roblox reveals more details about its work on 4D generative AI.

Posted: Mon, 24 Jun 2024 07:00:00 GMT [source]

This enables the AI model to anticipate the subsequent blocks and generate 3D environments. We think for developers, this is going to accelerate quality up and down the stack. …We will see people who before didn't expect to be creators making immersive 3D experiences. And we'll see the ones that are created by developers become more rich and dynamic. We may ultimately even see experiences that are dynamically personalized for each individual player.

“Even when you’re using an open source model, you really don’t know all of the data that it was pre-trained on. So like all of the ML engineers on this call, we all know what data went into our models when you are training them right in the classical ML approach. But now you really don’t know what went into the pre-training of it, and so that makes the model very unpredictable. Comcast also has a dedicated AI technology group comprised of AI experts.

These 4D generative AI tools aim to make 3D objects more dynamic by using generative AI text or voice prompts to create a drivable race car, for example. In a recent post to its blog, the developer explained that 4D generative AI will focus on interactivity when creating people, objects, and environments. The Roblox userbase will decide which experiences are the most fun, engaging, and exciting, and creativity will be rewarded, as it always has. For example, developers would be able to simply greybox their experience, and let AI build a world around the map, iterate on it by giving AI feedback or further adjust and improve their creations via existing tooling. Our goal is to allow creators to define their desired style with this model – whether photorealistic, anime, low-poly, or steampunk – and generate objects and scenes that fit that style.

By simply inputting descriptive phrases, creators can generate textures tailored to their specifications, facilitating rapid prototyping and iteration. Giving people a private, online persona where they’re able to build and interact and express themselves without the constraints of physical spaces. The way we enable that with generation for the avatar, the clothing - you can create whatever version of yourself you wish.

We’re designing our AI to support highly-customised creation with detailed layers of creator input to finesse everything from lighting conditions to textures and scenery. With the combination of AI and our endlessly creative creator community, the future will go beyond anything we have imagined today with an open-source solution that is not just foundational for us, but foundational for the industry. In the future, we envision every part of a user and social experience on Roblox to be fully translated into their native language. In this interview (conducted in conjunction with our partner newsletter, AI Gamechangers), Corazza outlines how Roblox integrates AI tools to assist and speed up creation across its platform. Generative AI continued to dominate tech headlines in 2024, as companies raced to integrate it into their products.