Model Performance

2024 Season · 3,078 graded predictions

In-sample data: All predictions for this season were generated after games completed (historical backfill), so metrics reflect in-sample fit rather than true out-of-sample accuracy. Metrics will become trustworthy as the current season progresses and daily ETL generates pre-game predictions.
66%
Overall Accuracy
0.2060
Brier Score (↓ better)
0.5947
Log Loss (↓ better)
0.7284
AUC (↑ better)
3,078
Predictions Graded

Calibration

When the model says X%, does the favored team win X% of the time? The vertical bar shows the predicted probability; the filled bar shows actual.

50–55%381 games51% actual(-2pp)
55–60%418 games51% actual(-7pp)
60–65%445 games55% actual(-8pp)
65–70%450 games64% actual(-4pp)
70–75%355 games70% actual(-2pp)
75–80%339 games73% actual(-4pp)
80–100%690 games87% actual
Actual win rate Predicted

Score Projection Accuracy

How close were the Monte Carlo score projections to actual results?

4.7
Avg margin error (runs)
+1.0
Margin bias (under-projects)
56%
Own-line cover rate
Within 2 runs of projected margin28%
Within 5 runs of projected margin62%

Based on 3078 games with score projections.

D1 Diamond Top 25 — 2026 Season

Composite ranking of all D1 teams with ≥5 games played.

#TeamRecordEloRun DiffScore
1GT4591841+6.092
2UCLA4861830+4.589
3UNC44101839+4.687
4UGA43121826+4.387
5TEX40121804+3.786
6MSST39161756+4.081
7ORST43121737+3.080
8TA&M38141765+3.779
9AUB36181771+3.178
10FSU38161758+2.978
11FLA37181756+2.477
12USM40141714+2.577
13MISS37191759+2.376
14WVU37131752+3.276
15WAKE38181732+3.275
16ORE38151725+2.575
17CBU1931621+3.975
18JVST42131679+3.074
19KU39161730+1.874
20NEB41141739+2.574
21USC41141698+3.074
22TENN37191746+2.473
23CAM39151666+2.973
24ARK36191750+2.372
25ALA37181754+1.672

Minimum 5 games played. wOBA/FIP from FanGraphs.

By Confidence Tier

Accuracy when the model is highly confident in its pick.

ConfidenceGamesAccuracy
60%227972%
65%183476%
70%138480%
75%102983%

Top Teams by Elo

Rolling Elo rating (1500 = average). Updated after every game result.

RankTeamGamesElo
1Georgia Tech Yellow Jackets2891841
2North Carolina Tar Heels3031839
3UCLA Bruins2891830
4Georgia Bulldogs2901826
5Texas Longhorns3031804
6Auburn Tigers2911771
7Texas A&M Aggies3051765
8Ole Miss Rebels2951759
9Florida State Seminoles2911758
10Mississippi State Bulldogs2861756

How to Read This

Overall Accuracy — % of games where the model's favored team won.

Brier Score — measures probability calibration quality. Lower is better.

Log Loss — penalises confident wrong predictions more harshly than Brier score. Lower is better.

AUC — probability that the model ranks a random home win above a random home loss. 0.5 = no skill; 1.0 = perfect.

Calibration chart — a perfectly calibrated model's bar would exactly touch the line in every bucket.

Elo ratings — self-correcting power ratings that update after every game. 1500 is average.