8x2080TI 22GB a good idea?

Ok so hear me out, I have a rather unique situation here and wants some good recommendations. I currently have a server (ESC8000A-E12) that's designed to host 8xH100, it's already set up and working with 2x2080TI with 22GB of mod. I got this very long ago during the stable diffusion era and the idea of running LLMs (ChatGPT was just a thing back then) on this never crossed my mind. Jump to the present and everyone is deploying LLMs on their local hardware, and I'm currently thinking about "finishing" the machine by filling out the last 6 GPU slots.