AI Advances for Game Dev

This is a collection of artificial intelligence and machine learning advances that are possible to be applied in the future game development process. Hope this can offer some inspirations for game data scientists, game developers, and maybe just spark some imaginations of passionate game players:video_game:.

✨ Keep Updating ✨

Todo:

• Assign tags Code, Paper, Article to indicate the format of the linked contents;
• More papers and codes coming!
• More of my thoughts on possible applications...

Reinforcement Learning

Possible application: smart object training, real-time learning game character, new rogue-like strategies

Deep Multi-Agent Reinforcement Learning for Decentralized Continuous Cooperative Control Paper

Dreamer: Learning Behaviors by Latent Imagination Codes
Dream to Control: Learning Behaviors by Latent ImaginationPaper

d3rlpy: A data-driven deep reinforcement learning library as an out-of-the-box tool Codes

mrl: Modular Reinforcement Learning Implementations Codes

Some Reinforcement Learning Algorithms Implemented with TensorFlow2 Codes

Unity ML-Agents Toolkit Codes
Announcing ML-Agents Unity Package v1.0! Article
Training intelligent adversaries using self-play with Unity ML-Agents Article

MultiGrid: Multi-Agent Gridworld Environment Codes

Comuper Graphics

Possible applications: sharders and rendering technologies, visual content automatic generation, graphic art development assistant

Neural supersampling for real-time rendering Paper
Introducing neural supersampling for real-time rendering Article

genetic-drawing: drawing with genetic algorithms assistant Codes

webcam-based controller/footage generation Article

valora: a graphics library and CLI focused on generative fine art for print Codes

NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis (Generate 5D continous objects by scanning images) Article
NeRF paper Paper
NeRF pytorch implementation v1 Codes
NeRF pytorch implementation v2 Codes

SoftSMPL: Data-driven Modeling of Nonlinear Soft-tissue Dynamics for Parametric Humans Article
SoftSMPL paper Paper

Learning to Shadow Hand-drawn Sketches Article
Learning to Shadow Hand-drawn Sketches Paper
Official Implementation of "Learning to Shadow Hand-drawn Sketches" Codes

PyTorch 3D Machine Learning Framework Codes

Natural Language Processing

Possible applications: automated dialogue/script generation, dialogue robot, understanding users' behaviors/inputs

API for using BERT to calculate semantic text similarity Codes

A pipeline for text generation Codes

dialogpt: make your own dialogue robot with just several lines of codes Article
DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation Paper
A State-of-the-Art Large-scale Pretrained Response Generation Model (DialoGPT) Codes

Build a Twitter bot with GPT-2 Codes

Facebook Light: A Multiplayer Text Adventure Game for Dialogue Research Article
Learning to Speak and Act in a Fantasy Text Adventure Game Paper

GPT AI Dungeon Codes
How to arrange massive scale deployment of AI Dungeon Article

Audio Processing

A list of papers about audio captioning PaperS

Music Grid: a simple music grid web app in which you can tap on cells to create music Codes

Realtime_PyAudio_FFT: A simple package to do realtime audio analysis in native Python Codes

Make A Song Together: a small game to build your own music with friends Article

OpenAI Jukebox: a neural net that generates music with inputs of genres, artists and lyrics Article
Jukebox Codes
Jukebox: A Generative Model for Music Paper

Generating music in the waveform domain Paper(online interactive)

Misc

(Chinese Language Only) GameAISDK: A framework for UI detection，In-game objects recognition and implementation of some game AI alrorithms (by Tecent Game) Codes

Awesome Anime Research: collection of papers regarding to signal processing of anime or manga PaperS

GameGAN: Interactive Evolution and Exploration Within Latent Level-Design Space of Generative Adversarial Networks Codes

Generative Forensics: Procedural Generation and Information Games Paper

Explorable Physics: Algebra based physics with explorable explanations Article
Explorable Physics Codes

Poker AI: an open source implementation of a poker AI using the ideas of Counterfactual Regret Codes