AI RESEARCH
PBT-Bench: Benchmarking AI Agents on Property-Based Testing
arXiv CS.AI
•
ArXi:2605.15229v1 Announce Type: cross Existing code benchmarks measure whether an agent can produce any test that reproduces a known bug, or whether it can produce a patch that fixes a described issue. Neither isolates the distinct skill of property-based testing: deriving a semantic invariant from documentation, and then constructing an input-generation strategy precise enough to make a random search reveal the violation.