What happened
An AI-assisted modernization project passed unit tests and static checks, but partner claim processors relied on undocumented behaviors.
After release, acceptance rates fell and manual resubmission work increased.
Process gaps
- no replay against production-like partner fixtures,
- no compatibility owner in approval path,
- no shadow comparison before cutover.
Reusable safeguards
- Maintain de-identified contract fixtures.
- Require integration-owner sign-off for contract-touching changes.
- Block merge when replay acceptance delta exceeds threshold.
- Use shadow mode before primary switch.
Short note: teams on bldrAgent often attach these artifacts to Workflow Board approvals, but the discipline applies anywhere.
