In nuce: The user Xavier (Jack), developer, animator and programmer in one, has presented the current development status of his real-time hand tracking app via Twitter. On 23 January, Xavier posted a moving image on Twitter that demonstrates what his app currently looks like in use. See below:
Good news!
I got a small grant to experiment with the creative use of real-time hand tracking in the browser.
First step, get that hand rig working with mediapipe (@tensorflow) and @threejs pic.twitter.com/RwXocbxZqJ
— Xavier (Jack) (@KMkota0) January 23, 2023
In toto: The highlight: His app should work directly in the web browser. According to Xavier, his app should still achieve good results even if the fingers being recorded are obscured by objects in the foreground of the image, for example. During development, Xavier utilised both the open source library TensorFlow , which focuses on machine learning for research and production, and Three.js, a cross-browser JavaScript library and application programming interface that can be used to create animated 3D graphics in the web browser.
Click further: To the Twitter account of the user Xavier (Jack).
Source: 80.lv ( message from Theodore McKenzie)