I tried building an alternative to local hosting for privacy, would love some criticism

r/LocalLLaMA
Generative AI

Hi all, So Local hosting is obviously the gold standard for privacy, but it also has some real downsides in either cost, speed, or inference quality. So I tried to design a system that lets people use hosted LLMs anonymously instead. The project is called LLMTor. The core idea is simple: make it impossible for the proxy operator to link who paid for usage with which prompts were sent, even deploying malicious code on the proxy shouldn't work.