Skip to content

arif39x/initial

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

46 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

initial logo

initial

Rust Python WebGPU License Status

initial is an AI Character & Animation Studio — a desktop application that takes text prompts and produces rigged, animated, exportable 3D characters, all with a real-time WGPU preview.


Features

  1. Text-to-Character — prompt → rigged, skinned mesh + base idle animation
  2. Text-to-Motion — prompt → BVH/animation clip on the character's skeleton
  3. AI Pose Staging — two hand-set poses + prompt → generated in-between frames
  4. Style Transfer — existing animation + style prompt → restyled animation
  5. Auto-Retarget — external animation (Mixamo/asset-store) → adapted to initial's skeleton
  6. Live Preview + Export — real-time WGPU viewport with egui controls; export to FBX/GLB/ONNX

initial GUI


Architecture

initial/
├── client/              # Rust / WGPU desktop app
│   ├── src/app.rs       # Application state, event loop, WGPU + egui setup
│   ├── src/core/        # Skeleton, math, ECS, validation
│   ├── src/animation/   # Playback, blending, IK, retarget
│   ├── src/render/      # Skinned mesh, PBR, WGSL shaders, export
│   ├── src/network.rs   # WebSocket client
│   └── src/ui/          # egui panels (editor, chat, scene, inspector, toolbar, gen status)
├── compiler/            # Python / FastAPI backend
│   ├── api.py           # Generation and job endpoints
│   └── core/
│       ├── animation/   # Skeleton, motion, retarget, BVH import
│       ├── ml/          # Model orchestration, pose interpolation, text-to-mesh/motion
│       ├── llm/         # LLM router for chat
│       ├── executors/   # Job executors
│       └── jobs.py      # Async job queue with progress streaming
├── asset/               # Base skeletons, bone maps, style library (populated on first run)
├── start_universe.sh    # Launch script
└── README.md

Quick Start

Prerequisites: Rust 1.75+, Python 3.11+

# Set up the compiler
cd compiler
python3 -m venv venv && source venv/bin/activate
pip install -r requirements.txt
cd ..

# Launch initial
./start_universe.sh

How It Works

Layer Technology Role
Animation Rust (custom math) Skeleton, FK, IK, blending, retargeting
Rendering Rust / WGPU GPU skinning, PBR shaders, egui overlay
Backend Python / FastAPI ML orchestration, async job queue
Network WebSocket Real-time progress streaming

All ML inference runs server-side (Python). The Rust client consumes generated data (mesh, motion, poses) over HTTP/WebSocket.


License

MIT

About

A LLM Powered 3d Renderer

Topics

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors