How many of the top hitters and pitchers at the end of the year were actually drafted? How many of the top hitters and pitchers were not drafted and were picked up during the season? Were hitters or pitchers drafted more accurately? What is the dollar value earned by the players that were picked up during the season? Is there a position of hitter that’s more reliable than other positions?
Have you ever asked yourself draft analysis questions like these?
What follows is a five year analysis (with colorful graphs and an enormous Excel file!) of how accurately our projections in the preseason depict what has actually happened at the end of the season. How well we drafted. What positions yield the best returns. What positions offer the most free loot. And more.
Assumptions You Should Know
A number of the graphs depend on dollar value earnings for the “top 168” projected hitters or “top 108” projected pitchers. The dollar values are calculated using the approach documented in “Using Standings Gain Points to Rank and Value Fantasy Baseball Players” assuming a 12-team league, $260 team budget, 14 hitters (C, C, 1B, 2B, SS, 3B, CI, MI, OF, OF, OF, OF, OF, UTIL), 9 pitchers, and a 70%-30% hitter-to-pitcher allocation. That’s a total of 168 hitters and 108 pitchers.
These top projected players in the preseason were determined using Steamer’s preseason projections for that season (I downloaded the historical projections here).
I suppose using ADP results or expert rankings from the given year might give a better picture of the players that were actually drafted, but then you get into the question of what’s good ADP data, where to get it, what experts to use, league differences, lineup differences, etc.
To Be Clear… The Goal of this Study
The goal of this is not to measure the accuracy of particular experts. It is to determine which positions can we draft and get the most return on our investment. To some extent this is a review of Steamer’s accuracy, but that’s also not my intent. It’s my understanding (tell me if I’m wrong) that there are not significant differences between the top projections systems. So whether we were looking at PECOTA, Steamer, or Marcel projections, we would see similar results.
How Much of a Return Do We Get For Drafting HItters vs. Pitchers?
People have long been telling us to, “Load up on hitters early in the draft”.
“Don’t overspend on pitching.”
“Wait on pitching until most teams already have one.”
I’ve always heard these things. They sounded right. But I can’t say I’ve ever seen the data to support it.
In looking at the chart below it is very clear that we are much better at identifying the top hitters than the top pitchers. The top 168 hitters in the preseason provide about 70% of the dollars earned at the end of the season. For pitchers, it’s more in the neighborhood of 40%.
With results like that it’s very easy to see why the hitter-pitcher split is not 50-50.
Hitters are safer investments than pitchers. We’ve always been told this, but now you can see it. And things have not changed in the new era of pitching that we’ve been seeing the last few years. If anything, the gap seems to have widened.