BlazePoseBarracuda

Thisi is Pose landmark tracker that works with a monocular color camera.
This works by using the MediaPipe Pose model in Unity Barracuda.

BlazePoseBaracuda is based on HandPoseBarracuda implementation by keijiro.
In his repositories, There are several tracking solutions using Barracuda including HondPoseBarracuda. Please check it.

This consists mainly of a pipeline from two ONNX models converted from TensorFlow Lite model. For more information about them, please check the package in the repository.

• PoseDetectBarracuda (Detect pose ROI)
• PoseLandmarkBarracuda (Detect pose landmark from ROI)

Require

• Unity 2020

Note

• In the original implementation of MediaPipe, the ROI is set from the pose landmarks ofthe previous frame, except for the initial frame. This can be expected to run muchfaster. However, in this project, the implementation currently uses both models toperform inference for each frame.
• Using the UpperBodyOnly option, more accurate detection can be expected in situations where a large part of the lower body is occluded.

Install

It can be installed by adding scoped registry to the manifest file(Packages/manifest.json).

scopedRegistries

{
    "name": "torinos",
    "url": "https://registry.npmjs.com",
    "scopes": ["jp.torinos"]
}

dependencies

"jp.torinos.mediapipe.blazepose": "1.0.0"