Hand Pose

Hand pose detection from MediaPipe. This predictor implements the hand pose model, but not the palm detector. It only supports detecting a single hand in the image.

Installing Hand Pose

Add the following items to your Unity project's Packages/manifest.json:

{
  "scopedRegistries": [
    {
      "name": "NatML",
      "url": "https://registry.npmjs.com",
      "scopes": ["ai.natml"]
    }
  ],
  "dependencies": {
    "ai.natml.vision.hand-pose": "1.0.1"
  }
}

Detecting Hand Pose in an Image

First, create the predictor:

// Create the hand pose predictor
var predictor = await HandPosePredictor.Create();

Then detect the hand pose in an image:

Texture2D image = ...;
// Detect hand pose in an image
HandPosePredictor.Hand hand = predictor.Predict(image);

Requirements

• Unity 2021.2+

Quick Tips

• Discover more ML models on NatML Hub.
• See the NatML documentation
• Join the NatML community on Discord
• Contact us at [email protected]

Thank you very much!