High schooler creates Minecraft site for AI challenges

A high school student has launched a new website called Minecraft Benchmark, or MC-Bench. This site allows users to challenge different AI models to build creations in the popular game Minecraft. The idea behind MC-Bench is to test AI skills in a fun way. Users can see the results of the challenges and vote on which AI did a better job. After voting, they learn which AI created each build. Adi Singh, the 12th grader who created the site, believes that Minecraft is an effective tool for showcasing AI abilities because many people are familiar with the game's style. Currently, eight volunteers help run MC-Bench. Major companies like Anthropic, Google, OpenAI, and Alibaba support the project by providing resources, but they do not have a direct partnership with it. MC-Bench primarily focuses on simpler builds, but Singh hopes to expand the project to more complex tasks in the future. Benchmarking AI can be challenging. Traditional methods sometimes give AI models an advantage due to how they are trained. MC-Bench tries to overcome this by using visual builds, making it easier for users to compare the outputs. This approach may also provide valuable data on AI performance. Singh believes that the scores from MC-Bench offer useful insights into how well different AI models work in real-world tasks. He hopes that data from the site could help companies understand their progress in AI development.