GOV.UK chatbot gets smarter but slower as LLMs improve

The Register AI
Generative AI AI Research

Accuracy jumps from 76% to 90% across public pilots, while users wait nearly 11 seconds for answers powerful large language models (LLMs) are helping make the UK government's in-development chatbot accurate but are also slowing it down, according to the Government Digital Service