realme v0.1.0

Real Me

Tools to turn avatars into realistic looking people.

Why?

• Using existing 3D tooling to compose images/videos allows finer grain control than text-only prompts
• Avatar design tools are very rich with content and customization so we'll leverage ReadyPlayerMe's tools/models
• Perhaps there is a better tool to be made from first principles once we understand the building blocks

Tools

• Use AvatarCam to capture test videos (enable green screen)
• https://www.avatarcam.app/
• Use ffmpeg to convert any video into images:
• JPGs (quality-level 2): ffmpeg -i avatar-input-video.mp4 -qscale:v 2 output/frame_%04d.jpg
• PNGs: ffmpeg -i avatar-input-video.mp4 output/frame_%04d.png

Experiments

Detailed notes about the experiments are tracked on a private Notion site

• ControlNet Canny Edges: https://twitter.com/seflless/status/1628773766435074048
• ControlNet Depth: https://twitter.com/seflless/status/1625592540895272997