Input
Hand tracking
The camera recognises the opening, alignment and closing of the hands.
Work
XR
Spike Game / Decathlon
The first mobile app with hand tracking: from a hand-recognition test to a complete AR video game for iOS and Android in twelve months.
- Period
- 2021–2022
- Role
- Research · Concept · Design · Development
- Client
- Decathlon
Interaction first
On 4 April 2021 the project is still a hand-tracking test: the camera detects the points and joints of the hands and follows their movement.
The test defines the interface before the game. The hands become the controller, with no wearable device or dedicated accessory.
Twelve months to the finished game
The sequence in the master connects the test of 4 April 2021 to the branded iOS and Android video game shown on 4 April 2022.
The result applies hand detection to an augmented reality match and adds characters, a profile, challenges, leaderboards, levels and statistics.
Game
Augmented reality
The hands intercept and direct the ball in the space framed by the phone.
System
Progression and challenges
Profile, levels, statistics, leaderboards and competitive modes complete the game loop.
From test to product
In twelve months, research into interaction became the first mobile app with hand tracking, complete and available for iOS and Android.
The path connects technology, game design, characters, progression and social features within the same product.