What a production incident taught me about trusting a model to judge another model's work