Karpathy's autoresearch running on Apple Neural Engine (ANE)

r/LocalLLaMA
AI Hardware

We have Karpathy's autoresearch, and we have ANE reverse engineered performance. Why wouldn't we combine both? Here it comes - The appeal is to have a much better deal in throughput per watt comparing to official APIs, of