Serving 1B+ tokens/day locally in my research lab

I lead a reserach lab at a university hospital and spent the last weeks configuring our internal LLM server. I put a lot of thought into the server config, software stack and model. Now I am at a point where I am happy, it actually holds up under load and we are pushing than 1B tokens/day (roughly 2/3 ingestion, 1/3 decode) through 2x H200 serving GPT-OSS-120B. I Thought this could be interesting for others looking to do something similar and also hoping to get some feedback. So I am sharing my software stack below as well as some considerations why I chose GPT-OSS-120B.