AI Doomsday Toolbox v0.932 update
r/LocalLLaMA
•
Generative AI
Open Source AI
AI Research
I’ve been working on this Android project for running local AI, I've posted about this before and the latest version adds a pretty big batch of changes and additions. Main additions in this update: Benchmarking for local LLMs Users can benchmark their device and compare different thread counts to figure out the best setup for a model instead of guessing. Dataset creator You can import txt or PDF files, split them into chunks, clean them up, generate question/answer pairs, rate them, and export the final dataset in Alpaca JSON format. The prompts used in the pipeline can also be customized.