NebulAI - Fully Generative AI Game

Overview

Created a 2D space exploration game with the help of OpenAI’s API for precise text generation for planet names and descriptions, a chatbot which acted as the spaceship’s AI and information point in case the player needed help or wanted more information on a planet, and DALL-E to design randomised planet sprites. The objective was to integrate AI as much as we could to showcase its potential application in games.

Project Details

Description

In “NebulAI”, players explore a procedurally generated galaxy with planets uniquely created using DALL-E 3. Players can visit these planets and engage in a 2D platformer game where they control a spacesuit-clad character to collect items and upgrade or repair their spaceship. The spaceship’s AI, a helpful robot, assists players with gameplay information and detailed facts about each planet, including its formation, atmospheric conditions, humidity, temperature, gravity, and hospitability.

Below is the first concept art I drew up using Krita. I believe we implemented the game very similarly to the original idea. The images of the planets in the concept art were generated with Microsoft Bing’s Image Generator and DALL-E 3. We later decided to use DALL-E 3 exclusively because we were able to integrate it dynamically into our C# Unity scripts for real-time generation, as opposed to statically generating images externally.

NebulAI Concept Art

Here we can see the implemented in-game design of the main scene. NebulAI Concept Art

Role

I worked as the team’s manager, one of two programmers for C# scripting in Unity, and the sole programmer integrating OpenAI capabilities. I also thought up the game’s concept and created concept art to clearly depict my ideas to our team.

Team and Responsibilities

Our team comprised five members, compromising of people in both programming and creative skills.

Tools and Technologies

Unity: For game development and environment creation.
OpenAI API: For generating dynamic NPC dialogues and planet descriptions.
DALL-E 3: For creating real-time planet sprites.
C#: For scripting and game mechanics.

Project Highlights

Gameplay

In the game, players explore a galaxy with procedurally generated planets. On these planets, players engage in a 2D platformer game, collecting items to upgrade or repair their spaceship. The spaceship’s AI, a robot, provides assistance and information about the planet’s conditions and history.

Testing and Feedback

We conducted several testing phases, gathering feedback to refine the gameplay experience. Testers appreciated the educational aspect and the seamless integration of AI technologies, which added depth to the game’s narrative and mechanics.

Challenges and Solutions

Technical Challenges

Integrating real-time image generation with DALL-E 3 and ensuring the OpenAI API’s seamless operation within Unity were significant technical challenges. We addressed these by refining our API calls and optimizing our C# scripts for better performance and reliability.

In the below image you can see the Chatbot we created for the game, which acts as the “Spaceship’s AI” in-game to inform players on what they should be doing, how to play, and can explain more information about a specific planet.

Concept Art

Project Management

Using Trello, regular team meetings in person and online through Discord, we maintained clear communication and task tracking, ensuring that the project stayed on schedule and met our development milestones.

Conclusion

”NebulAI” successfully demonstrates the potential of AI technologies in game development, offering a new type of exploration based gaming. The project showcases how AI can enhance worldbuilding and gameplay, providing players with a unique and dynamic universe to explore.

Media

Images

Concept art (also created by myself in Krita). In the image below there is an astronaut depicted visiting one of the planets and walking towards a ship module.