the quality of data. And the other thing is the computational power which is required to train these models. “For this project, specifically,” explains Mohammad Reza, “the training data was hardest to get. Basically, there is no data set for video game content before this work. We wanted to change that. We created the biggest data set of video game screenshots and conversation and question answering regarding video game content!” Let's say that you are playing a game and you want to have a digital companion, a chatbot inside the game that exactly looks at the screen that you are looking at and give you some hints. Or if you run into some challenges for crafting new items inside the game, like Minecraft, how should I combine different items to create a specific new item? These models can help us to build those in-game vision assistance. This is also very useful for video game testing and debugging. “For example,” says Mohammad Reza, “if you want to make sure that there are no glitches in the videogame, you need these models to detect those artifacts, glitches inside the game. This model is not specifically designed for that task, but it's a base model, that you can start from this model, fine-tune it for different tasks and create those models.” 5 DAILY WACV Sunday VideoGameBunny
RkJQdWJsaXNoZXIy NTc3NzU=