Skip to content

Projects

Projects
Infrastructure2026★ 1

VERITAS

Synthesizing verifiable reward signals outside maths and code

A C++ framework that automatically infers formal constraint schemas from ideal responses and executes constraint solvers plus generated unit tests, to produce verifiable rewards in law, biology, chemistry and clinical reasoning.

//The problem

RLVR produces emergent chain-of-thought without supervised fine-tuning — but only where a deterministic verifier exists. That means maths and code. For law, medicine and the sciences, researchers hand-craft reward functions one domain at a time.

//What it does

  • A schema inference engine that derives formal constraints from ideal responses.
  • A bridge to formal constraint solvers such as Z3.
  • Auto-generated unit tests feeding a composite reward scorer.
  • Python bindings that plug directly into a TRL GRPOTrainer reward function.

//Measured

Target domains
Law, biology, chemistry, clinical reasoning
Integration
Drop-in reward function for TRL GRPOTrainer

//Built with

  • C++
  • Z3
  • RLVR
  • TRL / GRPOTrainer

status: Research framework