Model Performance

2023 Season · 2,986 graded predictions

In-sample data: All predictions for this season were generated after games completed (historical backfill), so metrics reflect in-sample fit rather than true out-of-sample accuracy. Metrics will become trustworthy as the current season progresses and daily ETL generates pre-game predictions.
66%
Overall Accuracy
0.2638
Brier Score (↓ better)
1.0334
Log Loss (↓ better)
0.6102
AUC (↑ better)
2,986
Predictions Graded

Calibration

When the model says X%, does the favored team win X% of the time? The vertical bar shows the predicted probability; the filled bar shows actual.

50–55%210 games49% actual(-4pp)
55–60%229 games51% actual(-6pp)
60–65%217 games60% actual(-3pp)
65–70%250 games63% actual(-4pp)
70–75%237 games69% actual(-3pp)
75–80%197 games75% actual(-2pp)
80–100%1646 games70% actual(-27pp)
Actual win rate Predicted

Score Projection Accuracy

How close were the Monte Carlo score projections to actual results?

4.7
Avg margin error (runs)
+1.0
Margin bias (under-projects)
58%
Own-line cover rate
Within 2 runs of projected margin29%
Within 5 runs of projected margin62%

Based on 2986 games with score projections.

D1 Diamond Top 25 — 2026 Season

Composite ranking of all D1 teams with ≥5 games played.

#TeamRecordEloRun DiffScore
1UCLA3531838+5.490
2GT3171787+6.389
3TEX3071800+4.686
4UNC3461858+4.786
5UGA3291780+4.883
6TA&M3071785+5.383
7MSST29101744+4.980
8ORST2981751+3.079
9MISS29111776+2.978
10AUB27121746+2.977
11MIA29101721+4.676
12NEB3091739+2.875
13FLA28131725+2.274
14FSU27111749+3.174
15JVST3281679+3.673
16WVU2691705+3.873
17BC32111740+3.073
18KU28111731+1.772
19OU26121724+2.471
20ALA27131720+2.571
21ORE27111679+3.271
22ASU28131661+2.971
23CBU1321572+4.471
24CCU28101752+2.270
25UVA28131691+2.870

Minimum 5 games played. wOBA/FIP from FanGraphs.

By Confidence Tier

Accuracy when the model is highly confident in its pick.

ConfidenceGamesAccuracy
60%254769%
65%233070%
70%208070%
75%184371%

Top Teams by Elo

Rolling Elo rating (1500 = average). Updated after every game result.

RankTeamGamesElo
1North Carolina Tar Heels2891858
2UCLA Bruins2731838
3Texas Longhorns2881800
4Georgia Tech Yellow Jackets2731787
5Texas A&M Aggies2901785
6Georgia Bulldogs2761780
7Ole Miss Rebels2791776
8Coastal Carolina Chanticleers2261752
9Oregon State Beavers2901751
10Florida State Seminoles2751749

How to Read This

Overall Accuracy — % of games where the model's favored team won.

Brier Score — measures probability calibration quality. Lower is better.

Log Loss — penalises confident wrong predictions more harshly than Brier score. Lower is better.

AUC — probability that the model ranks a random home win above a random home loss. 0.5 = no skill; 1.0 = perfect.

Calibration chart — a perfectly calibrated model's bar would exactly touch the line in every bucket.

Elo ratings — self-correcting power ratings that update after every game. 1500 is average.