After continued pretraining, the LLM model is no longer capable of answering questions.
r/LocalLLaMA
•
Machine Learning
Generative AI
Open Source AI
AI Research
Hi, I have continued pretrained llama 1B model on raw text. but after the