AI RESEARCH
Green Prompting: Characterizing Prompt-driven Energy Costs of LLM Inference
arXiv CS.LG
•
ArXi:2503.10666v3 Announce Type: replace-cross Large Language Models (LLMs) have become widely used across various domains spanning search engines, code generation, and text creation. However, a major concern associated with their adoption is the high cost of inference, impacting both their sustainability and financial feasibility. In this study, we empirically study how different prompt and response characteristics directly impact LLM inference energy cost.