Repository navigation
Best place to host remotely or possible runpod serverless worker #23
Description
what do you recommend would be a good way to make this like an end point where they can connect to it as needed with other AI's
I'm not sure if it's best to just push it over to a docker image and run pond serverless or if you all know something a little easier to do this
Trying to build a little project to provide open source to trying to be as budget friendly as I can. Any advice is much appreciated thank you. I was planning on using live kit if it makes sense and possibly a. Eliza framework
Activity
anujnayyar1 commentedon Jan 12, 2025
@remsky firstly thank you for this awesome repo.
A Runpod Serverless compatible container would be extremely helpful!
remsky commentedon Jan 12, 2025
@anujnayyar1 @TheMindExpansionNetwork
That sounds like a great idea, glad it's been helpful. I'll take a look, just finishing up some restructuring to simplify container setup which should make it more deployable
TheMindExpansionNetwork commentedon Jan 12, 2025
yeah, it's super awesome. I'll tell you. I guess the stack that I'm looking to push with.
Serverless-runpod>kokoro>possible rvc but I like your voices > live kit > eliza>to machine or like avatar have a little Meta corner idea for digital entity that lives
I been looking something stable sounds decent because plans start deploying this stuff give people from homeless to learn free education
Throw partys and raves to fund it all
Super impressed quality amazing how you did it to super transparent
What if we did this just idea love to help
We can have AI even got the pro ai to generate a basic synthetic dataset
Of just midi notes
Then we take that bad boy with all native instruments or other stuff purchased
Then in theory we be legal train ai on it release apache or what ever
Idk how hard be but its and idea
Think we need more open source quality music models
quetzalsly commentedon Jan 15, 2025
Hey sorry to ask this question here but, how does this version of kokoro differ from replicate/jaaari/kokoro-82m?
I really love the simplicity of using replicate in my workflow but thinking of switching to this one, but also not sure where to host it, how about huggingface dedicated endpoints?
remsky commentedon Jan 15, 2025
Not sure to be honest, they have it always live and hosted there for cloud use, but I don't know know what source code they're using, just the same base model. This repo is geared more towards local use and development, source files so it can be modified if needed and built on over time.
For an equivalent endpoint on local hardware, or any cloud endpoints (haven't tested yet, so if you do manage to, feel free to submit a PR with instructions/mods), you'd probably want to run these to just get the voice server up fast.
docker run -p 8880:8880 ghcr.io/remsky/kokoro-fastapi-cpu:v0.1.0post1 # CPUordocker run --gpus all -p 8880:8880 ghcr.io/remsky/kokoro-fastapi-gpu:v0.1.0post1 # Nvidia GPUIf HF doesn't already have a drop in hosting for the voice images, I can take a look around to try and include a guide along with RunPod/etc instructions, just gotta finish up getting the quantized versions and model selection update worked into the code first