Webcam Motion Capture

[bonemap]

Hi,

I came across this implementation of webcam motion tracking that uses OSC output and is therefore compatible with Isadora:

It uses a software implementation of MediaPipe, a machine-learning tool that tracks the body, hands and faces. In the video, I am tracking just one hand point (wrist) via OSC using this software download.

It is a virtual youtuber avatar controller but outputs accessible OSC motion tracking points.

This may be of interest to some who want an accessible and free option to try performer motion tracking using just a webcam.

Best Wishes

Russell

[RIL]

@bonemap said:

software download

 

I'm super interested!
I could open the Receiver but not the Capture...And I don't know how to continue

Best,

RIL

[bonemap]

@ril

Hi,

It possibly requires an ARM-based mac. You could try email the developer to ask about compatibility.

Best Wishes,

Russell

[Fred]

@bonemap you can also check this out: 

https://github.com/LingDong-/PoseOSC

It uses the posenet model to do skeleton tracking from a webcam stream in real time, and sends it via osc. Posenet is pretty light weight, not much worse than openNI. 

Fred

[bonemap]

@fred

Thanks, @fred. I have an implementation of MediaPipe constructed using the Isadora Pythoner beta module. However, as the version of Isadora with Pythoner has yet to be released, these options provide an alternative. I will have a look at PoseOSC, too.

Best Wishes

Russell