Originally, our group wanted to use a medium stepper motor as the turret mechanism. To combat this issue in the future, a LIDAR scanner would be helpful to isolate the targets. We believe this is a limitation of the machine learning algorithm as it can only infer so much information from a 2D stream of images. While playtesting the game, we realized that if players were standing too close to each other and one person moved, the pose detection would detect both players to have moved making it unfair to the person who didn’t move. We chose the distance between the shoulders as it was the most reliable, then we measured points from different distances from the camera and created a general formula for estimating the distance. Afterwards, we discovered that we could map the distance between two points on the pose to the distance from the camera. We first thought of using a LIDAR sensor to map out a 3d space of the players, however, this seemed to complicate a simple problem at hand. One of the problems we faced was having to find the distance of the players from the turret in order to accurately determine the shooting angle. All these components are interfaced with an Arduino Mega. As fore mentioned, this was replaced with a laser pointer indicator. The firing mechanism is positioned on top of another high-torque servo that acts as the turret mechanism allowing the servo to aim at the target. A pair of drone motors are used as flywheels in order to fire the dart over 30m. On the hardware side, darts are loaded into the magazine chamber and fed into the firing mechanism by a rack and pinion mechanism connected to a servo. This angle is sent to the Node.js server using Socket.io, which is then piped over to the Arduino which controls the hardware. If the player is to be eliminated, the app then calculates the angle required for the turret to hit the player. While the light is still red, the app actively checks the new poses of each player and if any component of a pose exceeds a predetermined threshold, the player will be eliminated. This is used as a reference point to determine if the player moves during the red light period. When the light turns red, after a small delay, the app takes a snapshot of all the poses within the frame. Using Tensorflow’s MoveNet library, we integrated it into the React app to detect the poses of each player in real-time.
#Squids with guns software
On the software side of the product, we developed a web app written in Typescript to run the game and also perform real-time pose detection. Our product is split into two sections, software and hardware. Due to one of our motors burning out and numerous futile attempts to revive it, we switched to using a laser pointer to have a similar effect. Players who are hit by a nerf dart are thus eliminated and the game continues - or at least was the original plan. If detected, the algorithm will calculate the necessary angle of the turret and send a signal to fire. When the light is red, the web app kicks in to determine any player movement.
The game operator controls the laptop and decides when to switch the light from green to red and vice versa, everything else is completely automated. The game supports up to 7 players with one person selected as the game operator. Our product allows players to feel the thrill of playing in a high-stakes game of “Red light, green light” by recreating the AI-based movement detection using machine learning and by simulating the gun shots with a DIY nerf gun mounted on a turret. Whenever the game master calls “Red light”, players must immediately stop in their tracks, if they are caught moving, they are eliminated from the game. The rules of the game are simple, when the game master calls “Green light”, players are allowed to move from the start line towards the finish line. Game of Squid is a hardware-software system that runs the classical game “Red light, green light” from a popular show. It’s all the fun of the show’s hit game and cultural classic ‘Red Light, Green Light’, but with half the bloodshed! What it does We made our dreams come true by making the hottest toy of 2022, what we are calling the ‘Game of Squid’ (no copyright intended). We really liked this popular show and thought to ourselves, “those games looked fun!”.
0 kommentar(er)
