FreeBSD srcmgr@ has launched llm-postcr, an opt-in service that runs each src commit through an LLM (currently Claude) and reports bugs after the commit.

Opting in: run touch ${HOME}/.llm-postcr-opt-in on freefall. If your home directory isn’t readable by others, email srcmgr privately. Reports go to the committer if they’ve opted in, otherwise to srcmgr.

What it reports: only concrete, observable problems, not style(9) issues. It also flags pre-existing bugs in the code a commit touches, and fixing those is generally up to the committer. The exception is a commit that fixes some instances of a problem but misses others, where the missed ones should be addressed.

Results so far: after a couple of weeks of running with manual validation, it found about 100 new and 50 pre-existing bugs in the last 500 commits, with widely varying severity.

Limits: it doesn’t replace code review or testing.

Plans:

• An opt-in pre-commit review service is in the works.
• Reports are logged in a database and may become public later, for example in Bugzilla.

Feedback goes to srcmgr.