AI RESEARCH

Behavioral Consistency and Transparency Analysis on Large Language Model API Gateways

arXiv CS.AI

ArXi:2604.21083v1 Announce Type: cross Third-party Large Language Model (LLM) API gateways are rapidly emerging as unified access points to models offered by multiple vendors. However, the internal routing, caching, and billing policies of these gateways are largely undisclosed, leaving users with limited visibility into whether requests are served by the advertised models, whether responses remain faithful to upstream APIs, or whether invoices accurately reflect public pricing policies. To address this gap, we