AMD ROCm support #91
Description
It worked!
Install PyTorch from here
https://rocm.docs.amd.com/projects/radeon-ryzen/en/latest/docs/install/installrad/windows/install-pytorch.html
Mask torch in the requirements and then pop install -r requirements and it would work
(Note I had to allow some packages to be higher than their current versions to be Python 3.12 compaitable since this project is Python 3.11 which have no ROCm PyTorch packages so yeah, I don’t remember which tbh I might upload the file later though, however it works and very easily, but I moved away from Orephus I am using Kokoro now and might use Maya1 in the future, Orephus is cool but I needed lower latency for my app (Orephus Q2 works like 0.8x-1.01x real time generation which isn’t great and this API isn’t real time, which chucking in OpenWebUI also doesn’t work until all the chunks have been generated not to mention tone change so many many problems to fix, TL;DR the model is cool but no out of the box streaming API or even ecosystem yet (bummer!))