Goaltender Performance vs Salary, 2005-09
We've discussed the notion of goaltender talent numerous times here. Suffice to say, while it's not non-existent, it's much less significant than people tend to believe. But whether it exists or not, NHL teams have a hard time evaluating it and determining what to pay for it. The trend for goaltender performance is just slightly upwards with salary:
The key place to look is above $10M - these are free agent goalies signed to long-term contracts - and their long-term performance is terrible. I've made the situation look better than it is because I've only included goalies who actually played during a given season, so Rick DiPietro's zero of a contract doesn't pull down the averages. That dot out at $35M for virtually zero production? Nikolai Khabibulin.
Again, the story's no better if we look at four-year save percentages:
The problem is that goaltender performance is very luck-driven. A guy who posts a good save percentage over a season and a half will very likely find himself with a huge contract. But 90-100 games is barely long enough to evaluate a player's ability, and teams can very easily find themselves with someone who's nowhere near as good as they thought. Of course, with so many millions on the line, the goalie has to play anyways.
In a nutshell: there is very little talent variation among starting goaltenders; only a small number of goaltenders (Vokoun, Luongo) have long-term ability that's worth paying big money for; and most big goalie contracts don't produce much value relative to picking guys up off the scrap heap.
0 recs |
38 comments
|
Comments
If there is a small but measurable value of a goaltender how does this compare to other positions? Is a goaltender as important as a top pair D man? Or a top line forward? Or is their impact (wins above replacement, for instance) more in line with a bottom pair D or 3rd line forward? That would be good to know for in the case if, say, your team signed a good goalie, does this have an expected impact on your team of signing a good 2nd line forward?
by ThrashersRecaps on Apr 16, 2010 9:19 AM EDT reply actions
Great piece. What would it look like if you used cap hit rather than total contract value? Presumably very similar?
I think I’m going to flag this and mail it to Burke when Gustavsson’s contract expires in two years.
thanks gabe. the charts really drive home the point.
by sunnymehta.com on Apr 16, 2010 11:15 AM EDT reply actions
Confused by Kabby
He made, what, $27MM in Chicago over four years? And then $3.75MM this year with Edmonton? Not that it matters a lot but you seem to have him making too much money.
What’s a win worth in terms of dollars in the NHL?
It seems to me the correlation is ruined by a handful of teams screwing up with the six contracts in the bottom right. Other than that there seems to be a good trend of paying for performance. You could chalk up that up to a half dozen ‘dumb’ management groups instead of a general inability to value goaltenders.
But you could also say that if you look at just contracts over $10MM, the trend is downwards.
by The '67 Sound on Apr 16, 2010 11:48 AM EDT up reply actions
Or
you could say that if you look at people who are over 15 then 4 out of 5 are payed over 10 million. Who’s the low-paid one? I bet he’s young :)
The league seems to know who the absolute best top guys are and to pay them… it’s just not very sure about anyone else.
Is there a way to find out who the goaltenders are
Instead of just a graph, is there a table with all the data points somewhere?
I did not need to see this chart to conclude that some GMs are stupid and over pay players based on one year of outstanding play (happens all the time and isn’t limited to goalies) but I am not sure it is to the extent you show here. There are flaws in your analysis with the most significant being that you don’t account anywhere for who that goalie is playing for. The same goalie would have a lower save percentage on a weak defensive team than a great offensive team and unless you factor that sort of thing into your chart it isn’t telling a complete story.
Elsewhere on this blog you have a post about how coaching style influences shot difficulty and how Jacques Lemaire coaching style greatly limits shot difficulty against. Interestingly, Niklas Backstrom’s save percentages in his 4 year career are .929, .920, .923, and .903. The first three of those were under Lemaire, the fourth was for Todd Richards. Coincidence or no? Did Lemaire’s system make Backstrom look better than he actually was or was this year was just a bad year for Backstrom? How many other goalies are good goalies playing behind bad defensive teams/systems? How many other goalies are mediocre goalies playing under great defensive systems? All these sorts of things need to be considered.
Do many GMs not fully take this kind of thought process into account when evaluating goalies (and players) and thus make mistakes? Sure, happens all the time. Did Minnesota made a mistake signing Backstrom to a big contract? Maybe, but maybe not because he only had one good season, but because they didn’t take into account the Lemaire effect.
----------------------------------------------------------------------------------
HockeyAnalysis.com - Taking a Deeper Look at the World of Hockey
by HockeyAnalysis on Apr 16, 2010 12:16 PM EDT reply actions
We also went through (here and elsewhere) the details of shot quality. Over a four-year period – the period in my analysis – a player’s team has very little impact on his save percentage. There’s the rare guy like Backstrom who played entirely in a system that suppressed shooting percentage by 0.004, but 95% of guys are unaffected, and the talent spread is 5x the shot quality spread.
So what you are saying is that the team a goalie plays for has very little impact on his save percentage? So what you are saying is that Martin Brodeur would have the same save percentage on the Devils as he would on the Oilers? I am not sure I accept that.
----------------------------------------------------------------------------------
HockeyAnalysis.com - Taking a Deeper Look at the World of Hockey
by HockeyAnalysis on Apr 16, 2010 2:01 PM EDT up reply actions
The team that a goaltender plays for has a huge impact on his goals-against-average.
The team he plays for has very little impact on his even-strength save percentage, particularly over the course of four seasons. Backstrom was the biggest beneficiary, and it was, like I said, about 0.004. You don’t get such large extremes on the bottom end because poor-performing goalies and coaches tend to find themselves out of jobs.
I’m the biggest proponent of shot quality on the face of th Earth, and even I don’t think it has enough of an impact to affect Gabe’s analysis. For an individual guy, yes it would skew the numbers A LITTLE, but in terms of the macro-correlation between performance and salary the argument would remain exactly the same. If anything, scorer bias (number of shots recorded by each home arena) would have a larger impact than shot quality.
Interesting work, Gabe.
Is Wins Above Replacement for goalies based solely on Save Percentage, or are non-save effects included?
Writer for The Copper & Blue and primary shareholder of Zorg Industries
"Never be ashamed of who you are" -- Jean-Baptiste Emanuel Zorg
Do you think it converges between two goalies of very different styles? (I call the main groups “stoppers” and “sweepers”)
Writer for The Copper & Blue and primary shareholder of Zorg Industries
"Never be ashamed of who you are" -- Jean-Baptiste Emanuel Zorg
by Bruce McCurdy on Apr 16, 2010 3:47 PM EDT up reply actions
After taking a second look at the salary vs save% chart I think your conclusions aren’t quite so obvious.
-There are 7 goalies with a save percentage under .910, only one of them made more than $10M.
-Of the bottom 14 goalies in save percentage, 12 of them made less than $10M.
-Of the 17 goalies who made more than $10M, 11 had a wins above replacement greater than 5.
-Of the 26 goalies who made under $10M, 17 had a wins above replacement under 5.
That actually tells me that there aren’t a lot of huge mistakes being made by GMs.
To me there appear to be 6 goalie contract mistakes – those goalies earning >20M and have a wins above replacement <~5). Take out those 6 contracts and it appears you have a fairly decent relationship between salary and wins above replacement.
I too would be interested in seeing a table/chart with goalie names.
----------------------------------------------------------------------------------
HockeyAnalysis.com - Taking a Deeper Look at the World of Hockey
You’re using the wins contributed by entry-level and RFA goaltenders – who have their contracts suppressed by the CBA – to argue that the market is efficient. But the UFA goaltenders (essentially anybody who made $10M over four years) are all underperforming deals – one win from a UFA cost $2M in 2008-09 dollars.
Marc-Andre Fleury
is signed to a $35 million contract… he was an RFA at the time of signing.
Cam Ward WAS signed to an $8 million dollar contract, and then was signed to a $37.8 million RFA contract.
What starting goalies are signing small deals as RFAs? Pekka Rinne? Chris Mason?
I’d agree on entry level deals being lower end numbers… not so sure about the RFA’s automatically “suppressing” anything if they’re performing. RFA’s that are successful tend to get paid pretty decently… and teams are happy to lock them up just the same.
"Success is the ability to go from one failure to another with no loss of enthusiasm."
- Sir Winston Churchill
I'm pretty sure he's talking about the Leafs.
by Steve Burtch on Apr 16, 2010 5:40 PM EDT up reply actions
Here’s Ward’s salary:
2004-05 AHL (entry-level season 1)
2005-06 0.684M (entry-level season 2)
2006-07 0.684M (entry-level season 3)
2007-08 2.0M (RFA season 1)
2008-09 2.5M (RFA season 2)
2009-10 3.5M (RFA season 3)
2010-11 5.0M (UFA year 1)
2011-12 6.3M
2012-13 6.4M
2013-14 6.6M
2014-15 6.7M
2015-16 6.8M
The typical RFA discount is 40%, which he took in his 3-year $7M deal (some people say it was $7.5M). His big contract starts in UFA year 1.
And Fleury:
2003-04 1.24M
2004-05 AHL
2005-06 0.942M
2006-07 0.990M
2007-08 1.6M
2008-09 3.5M
2009-10 3.5M
2010-11 5.5M
2011-12 5.5M
2012-13 5.5M
2013-14 5.8M
2014-15 5.8M
Again, Fleury sold his RFA years at a 40% discount and starts getting paid full cost once he would have been a UFA.
The key is not that a player is an RFA when he signs the deal; it’s what his status is when the contract starts.
Have you ever looked at save percentage versus age?
by DoctorMyBrainHurts on Apr 16, 2010 7:34 PM EDT reply actions
This is really tricky
Elsewhere you (and others) have noted that it’s best to take 4 years worth of EV data to get a good sense of a goalie’s talent. And this is assuming that they’ve played a starting role somewhere. Here it seems to suggest that you’re best bet to not overpay are good, young goalies, at least able to get near .915 at EV. But for young goalies, you might not have that much data, or at least not have it all at NHL level. (I assume that there are inefficiencies in projecting from junior, AHL, or other leagues, but correct me if I’m wrong.)
Thus, it seems to me that the inefficiency is partially due to the fact that, as a GM, you might have to come to up with a contract decision based on less than optimal data. No?
For example, if you were the MTL GM last summer, and you thought to yourself you’d like to move one of your goalies to save money, and maybe pick up a large winger from someone. Esp. since you’re not sure you’ll want to sign both at the end of this season (both RFAs), esp. b/c you’re worried the price tag for both could go up. You’ve got Price with about 2795 NHL shots under his belt (.912, not sure EV vs SH splits), 310 AHL shots (.906) and 5349 WHL shots (.915), and an ELC of $2.2 million. Added to that, you know that Price has all kinds of good image pedigree (top 5 pick, WJC, made a good first impression). Halak, still on a two-way for 775,000, has 1697 NHL shots (.914 overall), 2009 AHL shots (.930), 516 ECHL shots (.932), 1442 QJMHL shots (.913). He’s also older by two years, and a 9th rounder, although also a WJC goalie.
Let’s say a player you want is available for one or the other: do you think you have enough info to make a call on this? If you moved Price, and picked up a Raycroft for your back up, you could spend the million+ on another position.
I’m not saying that MTL should have thought in these terms, it’s just an example of what kind of decision might be available at the time, and with what kinds of information.
I think that other inefficiencies come up because you need to manage image (i.e., this is a good team to play for, we care about our players and develop them, etc.), and sending away a top five pick when he’s only 21-22 might not be the best thing for your image, esp when the other guy isn’t totally proven in fan/media eyes.
Any entry-level or RFA guy who plays a lot is a bargain. Obviously most of them won’t play a lot.
The mistake that GMs make is that they are too influenced by recent performance or by small sample sizes. Cam Ward and Marc-Andre Fleury both won Stanley Cups. Yet it’s not clear that either is one of the ten-best goalies in the league. Play hardball – let them walk – and sign a guy like Anderson or Jonas Hiller. A GM has two choices – overpay a guy, which gives him an excuse when he loses – or go to the scrap heap and risk having a disaster season like Brian Burke and Ron Wilson just did. Only a GM who has nothing to lose (e.g. Colorado) is usually that ballsy. Most people opt for the “defensible” sure thing – Khabibulin.
Yes, I agree with you. Your examples of Cam Ward and MA Fleury is kinda what I meant by “managing image”. If a goalie got hot and helped you win a Stanley Cup, it would be hard to play hard ball with him. Not just b/c he could walk, but also b/c you might get a reputation and scare away other players who you do want. Not exactly the same scenario, but this happened to Keenan with Luongo. Played hardball, Luongo got pissed off, and then basically Keenan knew he had to trade him. Brian Allen was a good pick up…
But my question was mostly genuine and only a bit rhetorical. Let’s say you had the info on Halak and Price from last summer, and for some reason wanted to keep only one (like, halak is good enough, moving Price would get us a player we want, and allow us to move a million and a half to another position). Do you think there’s enough data, in terms of shots at different levels, to make a reasonable call that you have the goalie that you’re going to want to re-sign one year later, maybe for 3 million?
Price had played 92 games and had a .912 SV%. Halak had played 56 games with a .916 or so. With Price, you are starting to get into the range where you know what you’ve got; Halak less so. That would be a very risky time to make a move, and thankfully, since they both had entry-level contracts, there was no need to make a move.
As of today, you have Halak at .919 in 101 games and Price at .912 in 134 games. You are getting to the point where you can pretty much guarantee that Halak is better than Price. Until you have 100 games of data, save percentage can really mislead you. (And I should have looked at even-strength save percentage.)
Halak and Price are both going to be looking at long-term deals now. Together, they are worth $4M; so you sign them to slightly back-loaded 3-year deals and you sell high on whichever one outperforms the most next season.
Thanks for the answer (I really do appreciate you’re taking the time). I do realize that MTL didn’t really have to make a decision last year, I was trying to coming up with a scenario where the amount of data is limited on the goalie (< 100 games or 4 years, interesting it’s not in shots).
So (if I may impose once more), this hypothetical GM shouldn’t look at pre-NHL at all?
Probably not:
http://puckprospectus.com/article.php?articleid=160
You need to look for guys who have such high save percentages that it’s virtually impossible that they don’t have talent that’s well above the mean. So a guy like Hiller, who dominated in Europe, would be someone where you’re looking at other stats.
I think the key is that a guy just isn’t going to make that much money until he’s played 100 games, so you have a bit of time to figure things out.

by 







