Creating LLM powered NPCs from Coursera

Dive deep into the dynamic and increasingly intertwined realms of the Metaverse and Large Language Models (LLMs)!

To such an end, the course introduces "Inworld," a cutting-edge platform that shortens the way for the creation of responsive and expressive non-playable characters (NPCs). Through a unique usecase and "Guide for the Creation of Non-Human Characters", you'll gain proficiency in designing rich characters with the help of ChatGPT before expanding upon them using Inworld Studio where we'll make use of its myriad features and capabilities.

Transitioning from character creation to implementation, the course delves into the practicalities of integrating such avatars into the broader metaverse. You'll use Meshy to design a 3D model of your avatar before bringing everything together in Roblox. Here, you'll design and implement an online metaverse experience for your LLM powered NPCs, which you can share with the wider world.

Through three different Generative AI tools and Roblox, you'll bring your very own avatar to life. Let's get started!

*Note that the purchase of a license for Inworld is required.*

What's inside

Syllabus

Traffic lights

Read about what's good

what should give you pause

and possible dealbreakers

Explores the integration of Large Language Models with the Metaverse, which is a growing area of interest for developers and innovators

Uses Inworld, Meshy, and Roblox, which are platforms that are used for character creation, 3D modeling, and metaverse implementation

Teaches the design and deployment of digital avatars powered by Large Language Models, which is a cutting-edge application of AI

Requires the purchase of a license for Inworld, which may pose a financial barrier for some learners

Reviews summary

Hands-on llm npc creation project

According to learners, this course offers a practical, project-based approach to creating LLM-powered NPCs for the metaverse. Many found the hands-on experience to be engaging and highly valuable, allowing them to actually build a functional AI character using tools like Inworld and Meshy. Students appreciated the clear steps provided for integrating these avatars into a Roblox environment. However, a notable point highlighted by multiple reviewers is the required purchase of an Inworld license, which represents an additional and potentially significant cost not covered by the course fee. Some learners also mentioned encountering technical difficulties or finding certain integration steps less clear. Overall, students say it's a solid and unique introduction to combining AI and virtual world development, particularly suited for those prepared for the external software costs.

Leverages Inworld, Meshy, and Roblox.

"Loved working with Inworld Studio, it's very powerful for character design and AI personality."

"The course introduces you to Inworld, Meshy, and integrating into Roblox."

"It's a great way to see how these specific platforms can be combined for creative AI projects."

Accessible for newcomers to the topic.

"As someone new to LLMs and game development, I found this very accessible and well-explained."

"This course is a good introduction if you're just starting out with these technologies."

"Might be too basic if you already know a lot about AI or game engines, but perfect for a beginner overview."

Strong emphasis on building a real NPC.

"The hands-on coding and projects are the strongest part of the course for me. It's great that we actually build a working NPC by the end."

"I really appreciated the practical application; not just theory. Building the NPC step-by-step made it concrete."

"Fantastic course for beginners! It walked me through everything step-by-step to create my own NPC, which felt amazing."

Some difficulties reported during setup.

"Had some trouble getting the NPC to work correctly in Roblox after following the steps."

"The integration part felt a bit complex and could be explained better, especially for troubleshooting."

"Encountered a few bugs or unclear points while setting up the project environment for integration."

External software cost is necessary.

"Warning: This course requires you to purchase an Inworld license."

"The unexpected cost of the Inworld subscription was a major drawback and should be stated upfront."

"Be prepared for the additional expense outside of the course fee, as the project heavily relies on Inworld."

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Creating LLM powered NPCs with these activities:

Review Basics of 3D Modeling

Show steps

Reinforce your understanding of 3D modeling concepts to better utilize Meshy for avatar design.

Browse courses on 3D Modeling

Show steps

Watch introductory videos on 3D modeling principles.
Practice basic modeling techniques using free software.
Familiarize yourself with common 3D file formats.

Brush up on Roblox Scripting

Show steps

Strengthen your Roblox scripting skills to effectively implement and control your LLM-powered NPCs within the Roblox environment.

Browse courses on Lua

Show steps

Review Roblox's official scripting documentation.
Complete basic scripting tutorials on the Roblox Developer Hub.
Experiment with simple scripts to control in-game objects.

Read 'Building Virtual Worlds with VRChat'

Show steps

Expand your understanding of virtual world design principles, which are applicable to Roblox development.

View Putting Knowledge to Work on Amazon

Show steps

Read the book, focusing on world design and avatar interaction.
Take notes on key concepts and design considerations.
Reflect on how these concepts can be applied to your Roblox project.

Four other activities

Expand to see all activities and additional details

Show all seven activities

Follow Inworld AI Tutorials

Show steps

Deepen your understanding of Inworld AI's features and capabilities through their official tutorials.

Browse courses on LLM

Show steps

Explore the Inworld AI documentation and tutorial library.
Complete tutorials on character creation, behavior scripting, and integration.
Experiment with different settings and parameters to customize your NPCs.

Design a Simple Metaverse Experience

Show steps

Apply your knowledge by creating a small-scale metaverse experience in Roblox, incorporating your LLM-powered NPC.

Show steps

Plan the layout and functionality of your metaverse environment.
Design and implement the environment in Roblox Studio.
Integrate your Inworld AI character into the environment.
Test and refine the interaction between the player and the NPC.

Read 'AI and the Metaverse'

Show steps

Gain a broader understanding of the future trends and possibilities in the metaverse space.

View Putting Knowledge to Work on Amazon

Show steps

Read the book, focusing on the applications of AI in the metaverse.
Take notes on key concepts and future trends.
Reflect on how these trends might impact your own metaverse projects.

Create a Portfolio Piece

Show steps

Showcase your skills by creating a polished portfolio piece demonstrating your ability to create LLM-powered NPCs and integrate them into a metaverse environment.

Show steps

Refine your metaverse experience and NPC interaction.
Record a video demonstration of your project.
Write a detailed description of your project, highlighting your skills and accomplishments.
Publish your portfolio piece on a platform like GitHub or a personal website.

Career center

Learners who complete Creating LLM powered NPCs will develop knowledge and skills that may be useful to these careers:

Digital Avatar Creator

A Digital Avatar Creator design and develops virtual representations of people or characters for use in digital contexts. This role can benefit significantly from the course’s focus on building LLM-powered NPCs, using specific tools like Inworld, Meshy, and Roblox. The course’s focus on creating dynamic, responsive avatars, along with practical tips on implementing them in virtual environments, could build a solid foundation for someone in this profession. Therefore anyone who wants to work in digital avatar creation would learn from the hands-on experience this course provides.

See salaries and explore the career path for Digital Avatar Creator

AI Character Designer

An AI Character Designer specializes in the creation of digital characters that are powered by artificial intelligence, often found in games and virtual worlds. This course is directly relevant to this role, as it focuses on creating LLM-powered NPCs using Inworld, Meshy and Roblox. The course also provides hands-on experience in designing and implementing expressive AI avatars, which is essential to the work of an AI Character Designer. Anyone pursuing this role should take this course to deeply understand how to generate dynamic characters.

See salaries and explore the career path for AI Character Designer

Game Designer

A Game Designer crafts the rules, mechanics, and narratives of video games, often involving the creation of engaging characters. This course can assist a Game Designer by focusing on creating dynamic non-playable characters (NPCs) using LLMs and deploying them into virtual environments. The course introduces specific tools like Inworld and Meshy for designing and modeling characters, and it uses Roblox as a platform to implement interactive metaverse experiences. A Game Designer who wishes to explore AI driven characters in their games may find this course especially relevant.

See salaries and explore the career path for Game Designer

Virtual Reality Developer

A Virtual Reality Developer builds immersive and interactive virtual experiences. The course may be helpful to a Virtual Reality Developer as it offers instruction on designing and implementing non-player characters (NPCs) using tools like Inworld and Roblox. The course also provides practical experience in the creation of interactive metaverse experiences. The Virtual Reality Developer would benefit from the course by gaining skills in character development in the metaverse.

See salaries and explore the career path for Virtual Reality Developer

Metaverse developer

A Metaverse Developer builds and maintains virtual worlds and experiences, which often includes the design and implementation of interactive elements. This course may be useful for anyone interested in this area, providing specialized instruction on the creation of expressive non-playable characters (NPCs) using Large Language Models (LLMs). The course uses tools like Inworld, Meshy, and Roblox to create avatars and integrate them into a metaverse experience, which helps build a foundation in essential skills. The hands-on approach of the course is directly applicable to the kind of work a Metaverse Developer might do on a day-to-day basis.

See salaries and explore the career path for Metaverse developer

Interactive Experience Designer

An Interactive Experience Designer creates engaging digital experiences that users can actively participate in. This course may be useful for this role due to its emphasis on building interactive and responsive non-player characters using LLMs. Using Inworld, Meshy, and Roblox, this course provides techniques about character design and virtual world implementation. An Interactive Experience Designer who wants to use AI based characters should consider taking this course.

See salaries and explore the career path for Interactive Experience Designer

Virtual World Artist

Virtual World Artists create the visual assets for metaverse platforms and virtual experiences. This course may be helpful as it provides a hands-on introduction to creating avatars, which is a key element of many virtual worlds. The course uses tools like Meshy for 3D modeling and Roblox for implementation, which may provide the learner with practical experience in the field. This course may also help the Virtual World Artist understand how interactive and AI-powered characters can enhance virtual ecosystems.

See salaries and explore the career path for Virtual World Artist

Content Creator

A Content Creator develops engaging content for various digital platforms, often incorporating interactive elements. This course may be useful for a Content Creator who wishes to offer their audience a more immersive experience by incorporating AI characters into their virtual world. The course’s hands-on experience with designing and implementing non-player characters using tools like Inworld and Roblox may build a foundation for a Content Creator.

See salaries and explore the career path for Content Creator

3D Modeler

A 3D Modeler creates three-dimensional models of objects and characters using specialized software. The course may help provide useful experience, as it uses Meshy to create 3D models. The course teaches how to design and deploy digital avatars, which gives insight into the kind of assets a 3D Modeler might encounter when designing virtual worlds. The skills gained in this course will benefit the 3D Modeler in their work.

See salaries and explore the career path for 3D Modeler

Simulation Designer

A Simulation Designer creates models and experiences that simulate real-world or fictional scenarios. This course may provide relevant skills, as it focuses on designing and deploying interactive non-playable characters using LLMs and deploying them in virtual spaces. This course uses Inworld, Meshy, and Roblox, which may assist a Simulation Designer. The implementation of avatars in a virtual world may provide critical insights for a Simulation Designer.

See salaries and explore the career path for Simulation Designer

Technical Artist

A Technical Artist bridges the gap between art and technology, often optimizing assets and tools for game and virtual world development. This course may be useful to this role, as it provides a practical approach to implementing interactive characters in virtual environments, using tools like Meshy and Roblox. A Technical Artist who wishes to understand the intricacies of integrating AI-driven characters into games may find this course relevant. This course may also provide valuable insights into the workflow of character creation.

See salaries and explore the career path for Technical Artist

AI Application Developer

An AI Application Developer builds software applications that incorporate artificial intelligence. This course may be useful for someone interested in this field, as it teaches how to create LLM-powered characters using platforms like Inworld and Roblox. While the course is specific to virtual world avatars, it provides experience in building applications that use AI. An AI Application Developer who wishes to broaden their understanding of different applications of AI may find this course helpful.

See salaries and explore the career path for AI Application Developer

Instructional Designer

An Instructional Designer creates educational materials and experiences that incorporate interactive elements. This course, which explores the creation of interactive AI characters, may be useful for an Instructional Designer who wishes to offer immersive educational experiences in a virtual space. The course uses tools like Inworld and Roblox to create avatars and integrate them into a metaverse. An Instructional Designer who takes this course may be able to build AI driven learning experiences.

See salaries and explore the career path for Instructional Designer

AI Engineer

An AI Engineer develops and implements artificial intelligence models and systems. This course may be helpful for understanding one application of AI, as it focuses on creating LLM-powered non-playable characters within a virtual world environment. The course uses Inworld to develop characters and Roblox to integrate them in a virtual world. While this course does not delve into the theoretical underpinnings of AI models, an AI Engineer may want to broaden their knowledge of practical AI applications by taking this course.

See salaries and explore the career path for AI Engineer

AI Ethicist

An AI Ethicist analyzes the societal impact of artificial intelligence and develops guidelines for ethical implementation. While this course does not directly discuss ethical issues, it does familiarize learners with one particular implementation of AI. The course teaches how to create AI-powered non-player characters using tools like Inworld and Roblox, which could help an AI Ethicist better understand the kinds of systems they are analyzing. This course may also help illustrate certain ethical issues.

See salaries and explore the career path for AI Ethicist

Creating LLM powered NPCs

Here's a deal for you

What's inside

Syllabus

Traffic lights

Save this course

Reviews summary

Hands-on llm npc creation project

Activities

Career center

Featured in The Course Notes

Reading list

Share

Similar courses