A feature proposal, end to end

A feature proposal, end to end A sequence diagram generated by Archify. propose_feature dry-run LIMIT 0 register hypothesis + SQL review feature shuffled Ids, half rows approve or quarantine verdict + evidence evaluate(feature_ids) approved only MCC + AP vs noise bar Propose Warden review Evaluate Hypothesis agent · LLM, tool calls · Sequence participant Hypothesis agent LLM, tool calls SQL guard · DuckDB parser · Sequence participant SQL guard DuckDB parser Split sandbox · one split, no labels · Sequence participant Split sandbox one split, no labels Feature registry · status + findings · Sequence participant Feature registry status + findings Leakage warden · tests + rule · Sequence participant Leakage warden tests + rule Ensemble scorer · 3-seed LightGBM · Sequence participant Ensemble scorer 3-seed LightGBM Legend request return security default message

Before registration

  • • One SELECT over sandbox views only
  • • No windows, no labels, no holdout Id literals

Warden veto

  • • Row scope, Id shuffle, strict time refit
  • • Stricter of model and rule wins; quarantine is final

Beat the noise

  • • Bar = best + 2 placebo SDs on MCC and AP
  • • Three failed evaluations end the search