0.0.5 • Published 4 years ago
hand3000 v0.0.5
Hand3000
༼ つ ◕_◕ ༽つ
Currently an experimental and rudimentary decorator for TensorFlow's Handpose.
What
TensorFlow's handpose only outputs a set of points described by x, y, z coordinates. This little experimental "decorator" just evaluates these points and decorates the output of estimateHands
with values such as distance
, spread
, roll
, pitch
, isFist
. If you have any additions, suggestions, please feel free to make a PR!
- isPointing
- Some other inference?
Value | Description |
---|---|
distance | An estimate of the hand distance from the camera. Basically a measurement between 2 of the "static" points in the model |
spread | An average calculation of the distance between fingertips |
roll | Like how an airplane moves, roll is the rotation in the x-axis |
pitch | Like how an airplane moves, pitch is the rotation in the z-axis |
isFist | Not glamorously named, but it is what it says. A rough estimation IF a user's hand is closed |
isPointing | Coming soon |
Usage
yarn add hand3000
or npm i hand3000
import * as handpose from '@tensorflow-models/handpose';
import DecorateHand from 'hand3000';
// Initialize tensorflow as usual
const model = await handpose.load();
// Feed the model into Hand3000
DecorateHand(model);
// This just tweaks the estimateHand methods and adds
// above computed values in the return of estimateHands
const predictions = await model.estimateHands(source);