Model Performance

2023 Season · 2,986 graded predictions

In-sample data: All predictions for this season were generated after games completed (historical backfill), so metrics reflect in-sample fit rather than true out-of-sample accuracy. Metrics will become trustworthy as the current season progresses and daily ETL generates pre-game predictions.
66%
Overall Accuracy
0.2638
Brier Score (↓ better)
1.0334
Log Loss (↓ better)
0.6102
AUC (↑ better)
2,986
Predictions Graded

Calibration

When the model says X%, does the favored team win X% of the time? The vertical bar shows the predicted probability; the filled bar shows actual.

50–55%210 games49% actual(-4pp)
55–60%229 games51% actual(-6pp)
60–65%217 games60% actual(-3pp)
65–70%250 games63% actual(-4pp)
70–75%237 games69% actual(-3pp)
75–80%197 games75% actual(-2pp)
80–100%1646 games70% actual(-27pp)
Actual win rate Predicted

Score Projection Accuracy

How close were the Monte Carlo score projections to actual results?

4.7
Avg margin error (runs)
+1.0
Margin bias (under-projects)
58%
Own-line cover rate
Within 2 runs of projected margin29%
Within 5 runs of projected margin62%

Based on 2986 games with score projections.

D1 Diamond Top 25 — 2026 Season

Composite ranking of all D1 teams with ≥5 games played.

#TeamRecordEloRun DiffScore
1GT4591841+6.092
2UCLA4861830+4.590
3UNC44101839+4.687
4UGA43121826+4.387
5TEX40121804+3.786
6MSST39161756+4.081
7ORST43121737+3.080
8TA&M38141765+3.780
9AUB36181771+3.179
10FLA37181756+2.477
11FSU38161758+2.977
12WVU37131752+3.277
13USM40141714+2.576
14WAKE38181732+3.275
15MISS37191759+2.375
16ORE38151725+2.575
17CBU1931621+3.975
18JVST42131679+3.074
19NEB41141739+2.574
20USC41141698+3.074
21TENN37191746+2.473
22CAM39151666+2.973
23KU39161730+1.873
24ASU36181671+2.673
25ARK36191750+2.372

Minimum 5 games played. wOBA/FIP from FanGraphs.

By Confidence Tier

Accuracy when the model is highly confident in its pick.

ConfidenceGamesAccuracy
60%254769%
65%233070%
70%208070%
75%184371%

Top Teams by Elo

Rolling Elo rating (1500 = average). Updated after every game result.

RankTeamGamesElo
1Georgia Tech Yellow Jackets2891841
2North Carolina Tar Heels3031839
3UCLA Bruins2891830
4Georgia Bulldogs2901826
5Texas Longhorns3031804
6Auburn Tigers2911771
7Texas A&M Aggies3051765
8Ole Miss Rebels2951759
9Florida State Seminoles2911758
10Mississippi State Bulldogs2861756

How to Read This

Overall Accuracy — % of games where the model's favored team won.

Brier Score — measures probability calibration quality. Lower is better.

Log Loss — penalises confident wrong predictions more harshly than Brier score. Lower is better.

AUC — probability that the model ranks a random home win above a random home loss. 0.5 = no skill; 1.0 = perfect.

Calibration chart — a perfectly calibrated model's bar would exactly touch the line in every bucket.

Elo ratings — self-correcting power ratings that update after every game. 1500 is average.