So LTX itself does not like loras, too much fighting causes the base model to lose adherence...

So LTX-2 itself obviously has a hard time with loras, maybe most are not trained right? It seems the model will do whatever you want but when it comes to loras and or certain specific motions or asthetics it changes the output entirely. Its obvious front the live preview nodes. Is it Gemma filters secretly saying no under the hood and the base model changing the Gen or is it LTX itself or underlying text encoder? Where do we go from here? It seems the only way to get exactly what you want out of these DiTs is to train the actual model itself but that comes at massive cost.