This Is Taking Too Long -- Investigating Time as a Proxy for Energy Consumption of LLMs

ArXi:2603.15699v1 Announce Type: cross The energy consumption of Large Language Models (LLMs) is raising growing concerns due to their adverse effects on environmental stability and resource use. Yet, these energy costs remain largely opaque to users, especially when models are accessed through an API -- a black box in which all information depends on what providers choose to disclose. In this work, we investigate inference time measurements as a proxy to approximate the associated energy costs of API-based LLMs.