Built a simple PyTorch flash-attention alternative for AMD GPUs that don't have it
r/LocalLLaMA
•
Generative AI
Open Source AI
AI Tools
I've been using a couple 32GB MI50s with my setup for the past 9 months. Most of my use-cases just rely on llama.cpp and it works like a charm now! (A huge leap compared to how things were back then) I would occasionally also dabble with ComfyUI to try out the new ImageGen/AudioGen models just for the fun of things. But one specific use case that was never practically feasible with MI50s for me was video generation.