AIMech AI

Evaluation Methods

3 Concepts

Empirical protocols and test methodologies for measuring AI system performance.

Showing 3 of 3
Concept Origin Kind / Branch Identifier Evidence / Status
Bivariate counterfactual-fairness sensitivity analysis
aka Kilbertus grid-based counterfactual-fairness sensitivity
A model-based sensitivity procedure that varies the correlation between two structural error terms and measures how a predictor built under…
Curated Evaluation Methods AIMech:BivariateCounterfactualFairnessSensitivity 1 claim
1 source
MAXCFU
aka Optimization-based counterfactual-fairness sensitivity
A multivariate sensitivity algorithm that uses gradient ascent through fitted additive-noise models to search for large counterfactual predi…
Curated Evaluation Methods AIMech:MaxCFU 2 claims
2 sources
Topic-model evocation score
aka Top-m evocation metric
A topic-model evaluation method that orders judged word pairs by model-derived weights and sums their human evocation ratings over a chosen…
Curated Evaluation Methods AIMech:TopicModelEvocationScore 2 claims
2 sources