AI RESEARCH
Synthesis and Verification of Transformer Programs (Technical Report)
arXiv CS.LG
•
ArXi:2602.16473v2 Announce Type: replace C-RASP is a simple programming language that was recently shown to capture concepts expressible by transformers. In this paper, we develop new algorithmic techniques for automatically verifying C-RASPs. To this end, we establish a connection to the verification of synchronous dataflow programs in Lustre, which enables us to exploit state-of-the-art model checkers utilizing highly optimized SMT-solvers. Our second contribution addresses learning a C-RASP program in the first place.