Ask HN: Best way to implement logging and audit trails for AI apps?

So i’ve been experimenting with a small AI-based project recently and started thinking about logging around prompts, responses, and model calls etc etc. for traditional systems observability tools handle most of this, but with LLM-based apps it feels less clear what the standard approach is, especially if you need proper audit trails for debugging or compliance.