Model Performance

2024 Season · 3,078 graded predictions

In-sample data: All predictions for this season were generated after games completed (historical backfill), so metrics reflect in-sample fit rather than true out-of-sample accuracy. Metrics will become trustworthy as the current season progresses and daily ETL generates pre-game predictions.
66%
Overall Accuracy
0.2060
Brier Score (↓ better)
0.5947
Log Loss (↓ better)
0.7284
AUC (↑ better)
3,078
Predictions Graded

Calibration

When the model says X%, does the favored team win X% of the time? The vertical bar shows the predicted probability; the filled bar shows actual.

50–55%381 games51% actual(-2pp)
55–60%418 games51% actual(-7pp)
60–65%445 games55% actual(-8pp)
65–70%450 games64% actual(-4pp)
70–75%355 games70% actual(-2pp)
75–80%339 games73% actual(-4pp)
80–100%690 games87% actual
Actual win rate Predicted

Score Projection Accuracy

How close were the Monte Carlo score projections to actual results?

4.7
Avg margin error (runs)
+1.0
Margin bias (under-projects)
56%
Own-line cover rate
Within 2 runs of projected margin28%
Within 5 runs of projected margin62%

Based on 3078 games with score projections.

D1 Diamond Top 25 — 2026 Season

Composite ranking of all D1 teams with ≥5 games played.

#TeamRecordEloRun DiffScore
1UCLA3831847+5.391
2GT3471820+6.191
3TEX3181794+4.587
4UNC3681832+4.485
5MSST32101764+4.783
6UGA32101769+4.583
7TA&M3181778+4.983
8AUB29121761+3.179
9ORST3191747+3.179
10MISS30121766+3.078
11FSU29121744+3.076
12ORE30111706+3.275
13KU31111761+2.075
14FLA29141722+2.273
15MIA30121693+3.973
16JVST3491673+3.473
17NEB31111719+2.673
18TENN29151732+2.572
19USM30121699+1.772
20ARK29151742+2.571
21WAKE28151687+3.571
22OU28131723+2.371
23WVU27101695+3.171
24ASU29141652+3.071
25UCSB27121685+2.470

Minimum 5 games played. wOBA/FIP from FanGraphs.

By Confidence Tier

Accuracy when the model is highly confident in its pick.

ConfidenceGamesAccuracy
60%227972%
65%183476%
70%138480%
75%102983%

Top Teams by Elo

Rolling Elo rating (1500 = average). Updated after every game result.

RankTeamGamesElo
1UCLA Bruins2761847
2North Carolina Tar Heels2931832
3Georgia Tech Yellow Jackets2761820
4Texas Longhorns2901794
5Texas A&M Aggies2921778
6Georgia Bulldogs2771769
7Ole Miss Rebels2811766
8Mississippi State Bulldogs2731764
9Auburn Tigers2781761
10Kansas Jayhawks2671761

How to Read This

Overall Accuracy — % of games where the model's favored team won.

Brier Score — measures probability calibration quality. Lower is better.

Log Loss — penalises confident wrong predictions more harshly than Brier score. Lower is better.

AUC — probability that the model ranks a random home win above a random home loss. 0.5 = no skill; 1.0 = perfect.

Calibration chart — a perfectly calibrated model's bar would exactly touch the line in every bucket.

Elo ratings — self-correcting power ratings that update after every game. 1500 is average.