realme
v0.1.0
Published
Tools to turn avatars into realistic looking people.
Downloads
5
Readme
Real Me
Tools to turn avatars into realistic looking people.
Why?
- Using existing 3D tooling to compose images/videos allows finer grain control than text-only prompts
- Avatar design tools are very rich with content and customization so we'll leverage ReadyPlayerMe's tools/models
- Perhaps there is a better tool to be made from first principles once we understand the building blocks
Tools
- Use AvatarCam to capture test videos (enable green screen)
- https://www.avatarcam.app/
- Use ffmpeg to convert any video into images:
- JPGs (quality-level 2):
ffmpeg -i avatar-input-video.mp4 -qscale:v 2 output/frame_%04d.jpg
- PNGs:
ffmpeg -i avatar-input-video.mp4 output/frame_%04d.png
Experiments
Detailed notes about the experiments are tracked on a private Notion site
- ControlNet Canny Edges: https://twitter.com/seflless/status/1628773766435074048
- ControlNet Depth: https://twitter.com/seflless/status/1625592540895272997