How we used pose detection to build an interactive swimming pool game PoC that helped founder advance in founding.
This client helps swimmers become more confident in water; helps them rehabilitate, recover, deal with mental illness issues, or simply relax. Besides, they encourage people from all ages and all levels of experience and expertise to improve their swimming performance, by gathering meaningful data for analysis, statistics and reporting.
The client needed to create an immersive experience, using artificial intelligence in a swimming pool, and making water-based workouts fun, exciting and entertaining. The goal was to count the swimming strokes and identify certain gestures, in order to control certain responses and actions within the experience.
We needed to create our own dataset. For this type of project, that meant making real-time experiments with the client. So we developed a program that connected with the client's projector and swimming pool, and were able to create a meaningful amount of data.
We needed to create our own dataset. For this type of project, that meant making real-time experiments with the client. So we developed a program that connected with the client's projector and swimming pool, and were able to create a meaningful amount of data.
At first, we tried training the model to detect 9 different instructions. But, some gestures weren’t perfectly recognizable under the water. So we focused on 6 instructions instead, which we managed to complete successfully. These instructions were: “Close your right fist”, “Close your left fist”, “Spread your fingers on your right hand”, “Spread your fingers on your left hand”, “Breathe right”, “Breathe left”.
Then, we proceeded with the interactive environments within the experience. Meaning, making sessions entertaining enough for people to enjoy and engage with the workouts even more. On this occasion, we included analysis, suggestions, rewards when making a certain action, and more. Allowing the participants to have full control of their swimming experience.
The final PoC helped our client broaden their market segmentation, raise hundreds of thousands of dollars and secured relevant and meaningful partnerships. Currently, we are beginning a new development for future integrations for this project.
“They are very creative, good problem solvers. Besides, they were very patient in understanding my problems and treating them with respect and urgency”
