Generative AI on Roblox: Our Vision for the Future of Creation

Today, Roblox provides creators with a platform that enables end-to-end tools, services, and support to help them build the most immersive 3D experiences. With Roblox Studio, creators have everything they need, out-of-the-box and for free, to build their experiences and publish immediately on all popular platforms, reaching 58.8 million people daily worldwide. With the advent of generative AI techniques, however, we are seeing an opportunity to revolutionize creation on the platform, both by augmenting Roblox Studio to make creation dramatically faster and easier, and also by enabling every user on Roblox to be a creator.

As we all know, generative AI learns the underlying patterns and structures of data and generates new content, such as images, audio, code, text, 3D models, or other forms of media, that have not been seen before. With a dramatic acceleration in these tools’ effectiveness for everyday content creation, this technology is at an inflection point. It now has the capability to capture the creator’s intent, provide a broad range of digital editing capabilities, help create the content, and allow for fast iteration. We have already heard from Roblox creators about how they are using this technology to create. However, these off-the-shelf AI systems are not integrated with our platform and they often do not produce “Roblox ready” output that requires substantial follow on work from a creator. We see an incredible opportunity to build generative AI tools and APIs focused on Roblox.

The Value of Generative AI for Our Creators

Today a Roblox experience is created through a combination of 3D objects of various forms (constructive solid geometry, avatars, meshes, terrain, etc), connected in behavior through Lua scripting, and backed by a universal physics engine that provides core behavior on the platform. While the engine is an underlying portion of the platform, it is up to the creator to build or otherwise acquire everything in the experience. We see generative AI tools being applicable to each of these different creative processes. What we have already started to see through internal prototypes is that specialized generative AI tools can not only accelerate creator productivity, but can significantly drop the technical skill needed to bring ideas to life.

For example, some creators know how to code, but may have limited experience creating high-fidelity 3D models. Others may be more experienced with model design, but less experienced with code. In both cases, we see a future in which even a beginner (such as myself for example – I’m a terrible artist!) can get a running head start as they look to bring their imagination to life in a Roblox experience.  

Even more powerful, the convergence of media supported by generative AI will allow creators to develop integrated 3D objects that come with behavior built in. For example, a creator could design a car through a simple statement such as “A red, two seater, convertible sports car with front-wheel drive”. This new creation would both look like a red sports car but also have all the behavior coded into it to be driven through a 3D virtual world. 

This work involves unique technical challenges as we tackle the ability to generate 3D models with event handlers, an animation rig, and physical properties. This work is unprecedented because making interactive content requires a deeper understanding of the generated object. With the breadth of immersive content opportunities on Roblox, we also have the unique opportunity to create a generative model for all types of content at once – image, code, 3D models, audio, avatar creation, and more.

Everyone becomes a creator

We are building a platform that will enable every user to be a creator – not just those comfortable with Roblox Studio and other 3D content creation tools. We believe that many experiences in Roblox will become creation experiences where one can create a new shirt, hat, an entire avatar; a house or even an entire experience – all from within another experience. This vision requires a set of tools significantly more accessible to a typical user than exists in any environment today – things like voice and text or touch-based gestures rather than intricate mouse and keyboard movements. Generative AI tooling can help make creation intuitive and natural for users and be directly embedded into experiences, allowing any of our 58.8 million daily users to create unique content that can be shared across the platform.

We also see a huge opportunity for the AI community itself to become creators on the Roblox platform. By enabling 3rd party AI creation services to plug directly into Roblox (likely as a creation experience), we provide a mechanism for their unique creations to be directly offered to Roblox users. For example, if you develop an AI model that builds the most expressive superhero characters based on a combination of text prompts, graphical queues, and photo examples, that capability is something you should be able to offer directly to those Roblox users who want an incredible superhero avatar. We envision the community as a force multiplier for generative AI, creating an ecosystem that our creators and users can leverage to create content and tools more effectively. 

This vision also involves some unique technical challenges. First, the tools have to be suited to things a user would create, and how they might fit into an in-experience creation environment. Second, in all cases we need to keep Roblox safe and civil. This means we need to build a fast and scalable moderation flow for all types of creation. Third, we need an economic system that encourages such creation. Roblox stands apart as a platform with a robust creator-backed marketplace and economy, and we must extend that to support in-experience user-creators as well as AI algorithm developers.

As we do this, we remain aware of the need to implement generative AI thoughtfully and ethically on the Roblox platform, in line with the value we have always placed on respecting our community. We are committed to using diverse and robust data sets to limit biased content and encourage safe and high-quality content output.

Learn More at DeveloperWeek

Our teams are working on rolling out tests for two new AI tools in the coming weeks: generative AI materials from a text prompt and generative AI code completion to help increase development velocity. These are just our first steps to bring the creation power of generative AI to our creator community. I’ll be sharing more this week at my talk on the Tech Stack for the Metaverse at DeveloperWeek. And Stef Corazza will also share more during his talk at the AI Summit of Game Developers Conference next month. We hope you are as excited as we are to embark on this journey together.