Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gradio inference interface #12

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

RootingInLoad
Copy link

Added a very simple Gradio app for inference.
It is necessary to: pip install gradio
Added a --server argument so that the app is also accessible from outside localhost.

Added a very simple Gradio app for inference.
It is necessary to: pip install gradio
@thewh1teagle
Copy link
Owner

For now, let's focus this repository specifically on the kokoro-onnx package and its examples, so we'll hold off on adding unrelated elements.

By the way, there's already a Gradio interface available here: https://huggingface.co/spaces/hexgrad/Kokoro-TTS, even featuring a beta version of this model!

Looking forward to your thoughts!

@RootingInLoad
Copy link
Author

No problem, I just wanted to benefit from having the Onnx models, plus the one on the Space seems harder to implement than the one I created.

It'll be useful for those who just to try it out very easily !

@m4jki
Copy link

m4jki commented Jan 6, 2025

is it possible to run it on nvidia gpu instead of cpu?

@RootingInLoad
Copy link
Author

is it possible to run it on nvidia gpu instead of cpu?

I recommend you to follow this guide. I'm going to upload my updated app.py file there: #11 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants