Behind The Net: An SB Nation Community

Navigation: Jump to content areas:


Pro Quality. Fan Perspective.
Login-facebook
New Blog: Along The Olentangy for Ohio State Fans!

Goaltender Performance vs Salary, 2005-09

We've discussed the notion of goaltender talent numerous times here.  Suffice to say, while it's not non-existent, it's much less significant than people tend to believe.  But whether it exists or not, NHL teams have a hard time evaluating it and determining what to pay for it.  The trend for goaltender performance is just slightly upwards with salary:

Goalie_salary1_medium

The key place to look is above $10M - these are free agent goalies signed to long-term contracts - and their long-term performance is terrible.  I've made the situation look better than it is because I've only included goalies who actually played during a given season, so Rick DiPietro's zero of a contract doesn't pull down the averages.  That dot out at $35M for virtually zero production?  Nikolai Khabibulin.

Again, the story's no better if we look at four-year save percentages:

Goalie_salary2_medium

The problem is that goaltender performance is very luck-driven.  A guy who posts a good save percentage over a season and a half will very likely find himself with a huge contract.  But 90-100 games is barely long enough to evaluate a player's ability, and teams can very easily find themselves with someone who's nowhere near as good as they thought.  Of course, with so many millions on the line, the goalie has to play anyways.

In a nutshell: there is very little talent variation among starting goaltenders; only a small number of goaltenders (Vokoun, Luongo) have long-term ability that's worth paying big money for; and most big goalie contracts don't produce much value relative to picking guys up off the scrap heap.

0 recs  |  Comment 38 comments |

Story-email Email Printer Print

More from Behind The Net

Around SB Nation

SBN Off-season: Vocal Chords

Sep 2010 from From The Rink - 0 comments

Poorcoff

Sep 2010 from The Copper & Blue - 50 comments

September 1 Open Ice

Sep 2010 from Nucks Misconduct - 160 comments

Comments

Display:

If there is a small but measurable value of a goaltender how does this compare to other positions? Is a goaltender as important as a top pair D man? Or a top line forward? Or is their impact (wins above replacement, for instance) more in line with a bottom pair D or 3rd line forward? That would be good to know for in the case if, say, your team signed a good goalie, does this have an expected impact on your team of signing a good 2nd line forward?

by ThrashersRecaps on Apr 16, 2010 9:19 AM EDT reply actions  

Good stuff. I’d come to the conclusion recently as well that NHL GM’s really can’t evaluate goaltender talent and it’s basically a crap shoot, which these data confirm.

Sets up well for a few articles I have lined up on Sutter this summer.

by Kent Wilson on Apr 16, 2010 9:53 AM EDT reply actions  

Great piece. What would it look like if you used cap hit rather than total contract value? Presumably very similar?

I think I’m going to flag this and mail it to Burke when Gustavsson’s contract expires in two years.

by The '67 Sound on Apr 16, 2010 9:59 AM EDT reply actions  

I just did that, and yeah, scatterplot city.

by JustinM on Apr 16, 2010 11:28 AM EDT up reply actions  

I did mine as cap hit vs. GVT, and there is a slight positive relationship between the two, but it’s a really noisy graph.

by JustinM on Apr 16, 2010 11:35 AM EDT up reply actions  

thanks gabe. the charts really drive home the point.

by sunnymehta.com on Apr 16, 2010 11:15 AM EDT reply actions  

Is this just for goalies currently under contracts signed as UFAs?

I've always wanted to be a PPP Princess. You see kids, you can be anything you want to be; so long as Jay Leno doesn't also want to be that.

by SkinnyFish on Apr 16, 2010 11:19 AM EDT reply actions  

Confused by Kabby

He made, what, $27MM in Chicago over four years? And then $3.75MM this year with Edmonton? Not that it matters a lot but you seem to have him making too much money.

by Tyler Dellow on Apr 16, 2010 11:34 AM EDT reply actions  

Sorry, everything is adjusted to 2008-09 dollars!

by Hawerchuk on Apr 16, 2010 12:59 PM EDT up reply actions  

What’s a win worth in terms of dollars in the NHL?

It seems to me the correlation is ruined by a handful of teams screwing up with the six contracts in the bottom right. Other than that there seems to be a good trend of paying for performance. You could chalk up that up to a half dozen ‘dumb’ management groups instead of a general inability to value goaltenders.

by Pitseleh on Apr 16, 2010 11:41 AM EDT reply actions  

But you could also say that if you look at just contracts over $10MM, the trend is downwards.

by The '67 Sound on Apr 16, 2010 11:48 AM EDT up reply actions  

Roughly 1.5M$ / win, assuming a replacement team would win 15 games and 40M$ of marginal payroll to play with, 40M / (41 – 15) = 1.5M$/win.

by Tom Awad on Apr 16, 2010 3:00 PM EDT up reply actions  

Or

 you could say that if you look at people who are over 15 then 4 out of 5 are payed over 10 million. Who’s the low-paid one? I bet he’s young :)

The league seems to know who the absolute best top guys are and to pay them… it’s just not very sure about anyone else.

Glory glory Man United, AND the other MU, AAAAnd the Leafs. I think I need a drink now.

by Wan Ihite on Apr 16, 2010 11:53 AM EDT reply actions  

Is there a way to find out who the goaltenders are

Instead of just a graph, is there a table with all the data points somewhere?

by SJKel on Apr 16, 2010 12:04 PM EDT reply actions  

I did not need to see this chart to conclude that some GMs are stupid and over pay players based on one year of outstanding play (happens all the time and isn’t limited to goalies) but I am not sure it is to the extent you show here. There are flaws in your analysis with the most significant being that you don’t account anywhere for who that goalie is playing for. The same goalie would have a lower save percentage on a weak defensive team than a great offensive team and unless you factor that sort of thing into your chart it isn’t telling a complete story.

Elsewhere on this blog you have a post about how coaching style influences shot difficulty and how Jacques Lemaire coaching style greatly limits shot difficulty against. Interestingly, Niklas Backstrom’s save percentages in his 4 year career are .929, .920, .923, and .903. The first three of those were under Lemaire, the fourth was for Todd Richards. Coincidence or no? Did Lemaire’s system make Backstrom look better than he actually was or was this year was just a bad year for Backstrom? How many other goalies are good goalies playing behind bad defensive teams/systems? How many other goalies are mediocre goalies playing under great defensive systems? All these sorts of things need to be considered.

Do many GMs not fully take this kind of thought process into account when evaluating goalies (and players) and thus make mistakes? Sure, happens all the time. Did Minnesota made a mistake signing Backstrom to a big contract? Maybe, but maybe not because he only had one good season, but because they didn’t take into account the Lemaire effect.

----------------------------------------------------------------------------------
HockeyAnalysis.com - Taking a Deeper Look at the World of Hockey

by HockeyAnalysis on Apr 16, 2010 12:16 PM EDT reply actions  

We also went through (here and elsewhere) the details of shot quality. Over a four-year period – the period in my analysis – a player’s team has very little impact on his save percentage. There’s the rare guy like Backstrom who played entirely in a system that suppressed shooting percentage by 0.004, but 95% of guys are unaffected, and the talent spread is 5x the shot quality spread.

by Hawerchuk on Apr 16, 2010 1:22 PM EDT up reply actions  

So what you are saying is that the team a goalie plays for has very little impact on his save percentage? So what you are saying is that Martin Brodeur would have the same save percentage on the Devils as he would on the Oilers? I am not sure I accept that.

----------------------------------------------------------------------------------
HockeyAnalysis.com - Taking a Deeper Look at the World of Hockey

by HockeyAnalysis on Apr 16, 2010 2:01 PM EDT up reply actions  

The team that a goaltender plays for has a huge impact on his goals-against-average.

The team he plays for has very little impact on his even-strength save percentage, particularly over the course of four seasons. Backstrom was the biggest beneficiary, and it was, like I said, about 0.004. You don’t get such large extremes on the bottom end because poor-performing goalies and coaches tend to find themselves out of jobs.

by Hawerchuk on Apr 16, 2010 2:31 PM EDT up reply actions  

I’m the biggest proponent of shot quality on the face of th Earth, and even I don’t think it has enough of an impact to affect Gabe’s analysis. For an individual guy, yes it would skew the numbers A LITTLE, but in terms of the macro-correlation between performance and salary the argument would remain exactly the same. If anything, scorer bias (number of shots recorded by each home arena) would have a larger impact than shot quality.

by Tom Awad on Apr 16, 2010 3:02 PM EDT up reply actions  

Interesting work, Gabe.

Is Wins Above Replacement for goalies based solely on Save Percentage, or are non-save effects included?

Writer for The Copper & Blue and primary shareholder of Zorg Industries

"Never be ashamed of who you are" -- Jean-Baptiste Emanuel Zorg

by Bruce McCurdy on Apr 16, 2010 1:48 PM EDT reply actions  

Yeah, I just use EVSV%. Over hundreds of games, everything converges.

by Hawerchuk on Apr 16, 2010 2:00 PM EDT up reply actions  

Do you think it converges between two goalies of very different styles? (I call the main groups “stoppers” and “sweepers”)

Writer for The Copper & Blue and primary shareholder of Zorg Industries

"Never be ashamed of who you are" -- Jean-Baptiste Emanuel Zorg

by Bruce McCurdy on Apr 16, 2010 3:47 PM EDT up reply actions  

Never thought about it that way! This comes from Tyler and Vic’s work on save percentage.

by Hawerchuk on Apr 16, 2010 4:38 PM EDT up reply actions  

After taking a second look at the salary vs save% chart I think your conclusions aren’t quite so obvious.

-There are 7 goalies with a save percentage under .910, only one of them made more than $10M.

-Of the bottom 14 goalies in save percentage, 12 of them made less than $10M.

-Of the 17 goalies who made more than $10M, 11 had a wins above replacement greater than 5.

-Of the 26 goalies who made under $10M, 17 had a wins above replacement under 5.
That actually tells me that there aren’t a lot of huge mistakes being made by GMs.

To me there appear to be 6 goalie contract mistakes – those goalies earning >20M and have a wins above replacement <~5). Take out those 6 contracts and it appears you have a fairly decent relationship between salary and wins above replacement.

I too would be interested in seeing a table/chart with goalie names.

----------------------------------------------------------------------------------
HockeyAnalysis.com - Taking a Deeper Look at the World of Hockey

by HockeyAnalysis on Apr 16, 2010 4:10 PM EDT reply actions  

You’re using the wins contributed by entry-level and RFA goaltenders – who have their contracts suppressed by the CBA – to argue that the market is efficient. But the UFA goaltenders (essentially anybody who made $10M over four years) are all underperforming deals – one win from a UFA cost $2M in 2008-09 dollars.

by Hawerchuk on Apr 16, 2010 4:38 PM EDT up reply actions  

In effect, you could redo your chart just with the UFA contracts. This would prove your point even further.

by Tom Awad on Apr 16, 2010 5:21 PM EDT up reply actions  

Marc-Andre Fleury

is signed to a $35 million contract… he was an RFA at the time of signing.

Cam Ward WAS signed to an $8 million dollar contract, and then was signed to a $37.8 million RFA contract.

What starting goalies are signing small deals as RFAs? Pekka Rinne? Chris Mason?

I’d agree on entry level deals being lower end numbers… not so sure about the RFA’s automatically “suppressing” anything if they’re performing. RFA’s that are successful tend to get paid pretty decently… and teams are happy to lock them up just the same.

"Success is the ability to go from one failure to another with no loss of enthusiasm."

- Sir Winston Churchill

I'm pretty sure he's talking about the Leafs.

by Steve Burtch on Apr 16, 2010 5:40 PM EDT up reply actions  

Here’s Ward’s salary:

2004-05 AHL (entry-level season 1)
2005-06 0.684M (entry-level season 2)
2006-07 0.684M (entry-level season 3)
2007-08 2.0M (RFA season 1)
2008-09 2.5M (RFA season 2)
2009-10 3.5M (RFA season 3)
2010-11 5.0M (UFA year 1)
2011-12 6.3M
2012-13 6.4M
2013-14 6.6M
2014-15 6.7M
2015-16 6.8M

The typical RFA discount is 40%, which he took in his 3-year $7M deal (some people say it was $7.5M). His big contract starts in UFA year 1.

And Fleury:

2003-04 1.24M
2004-05 AHL
2005-06 0.942M
2006-07 0.990M
2007-08 1.6M
2008-09 3.5M
2009-10 3.5M
2010-11 5.5M
2011-12 5.5M
2012-13 5.5M
2013-14 5.8M
2014-15 5.8M

Again, Fleury sold his RFA years at a 40% discount and starts getting paid full cost once he would have been a UFA.

The key is not that a player is an RFA when he signs the deal; it’s what his status is when the contract starts.

by Hawerchuk on Apr 16, 2010 6:13 PM EDT up reply actions  

Have you ever looked at save percentage versus age?

by DoctorMyBrainHurts on Apr 16, 2010 7:34 PM EDT reply actions  

not much of a trend. goalies can come up at almost any age, and they usually expire after 120-150 games

by Hawerchuk on Apr 16, 2010 8:43 PM EDT up reply actions  

So Craig Anderson will be through by the end of December next season?

If we don't get our sauce, we ain't watching the game!

by Mike @ MHH on Apr 19, 2010 5:32 PM EDT up reply actions  

Well, he’s as likely to post a .909 SV% as he is a .917

by Hawerchuk on Apr 19, 2010 9:34 PM EDT up reply actions  

This is really tricky

Elsewhere you (and others) have noted that it’s best to take 4 years worth of EV data to get a good sense of a goalie’s talent. And this is assuming that they’ve played a starting role somewhere. Here it seems to suggest that you’re best bet to not overpay are good, young goalies, at least able to get near .915 at EV. But for young goalies, you might not have that much data, or at least not have it all at NHL level. (I assume that there are inefficiencies in projecting from junior, AHL, or other leagues, but correct me if I’m wrong.)

Thus, it seems to me that the inefficiency is partially due to the fact that, as a GM, you might have to come to up with a contract decision based on less than optimal data. No?

For example, if you were the MTL GM last summer, and you thought to yourself you’d like to move one of your goalies to save money, and maybe pick up a large winger from someone. Esp. since you’re not sure you’ll want to sign both at the end of this season (both RFAs), esp. b/c you’re worried the price tag for both could go up. You’ve got Price with about 2795 NHL shots under his belt (.912, not sure EV vs SH splits), 310 AHL shots (.906) and 5349 WHL shots (.915), and an ELC of $2.2 million. Added to that, you know that Price has all kinds of good image pedigree (top 5 pick, WJC, made a good first impression). Halak, still on a two-way for 775,000, has 1697 NHL shots (.914 overall), 2009 AHL shots (.930), 516 ECHL shots (.932), 1442 QJMHL shots (.913). He’s also older by two years, and a 9th rounder, although also a WJC goalie.

Let’s say a player you want is available for one or the other: do you think you have enough info to make a call on this? If you moved Price, and picked up a Raycroft for your back up, you could spend the million+ on another position.

I’m not saying that MTL should have thought in these terms, it’s just an example of what kind of decision might be available at the time, and with what kinds of information.

I think that other inefficiencies come up because you need to manage image (i.e., this is a good team to play for, we care about our players and develop them, etc.), and sending away a top five pick when he’s only 21-22 might not be the best thing for your image, esp when the other guy isn’t totally proven in fan/media eyes.

by antro on Apr 17, 2010 6:24 AM EDT reply actions  

Any entry-level or RFA guy who plays a lot is a bargain. Obviously most of them won’t play a lot.

The mistake that GMs make is that they are too influenced by recent performance or by small sample sizes. Cam Ward and Marc-Andre Fleury both won Stanley Cups. Yet it’s not clear that either is one of the ten-best goalies in the league. Play hardball – let them walk – and sign a guy like Anderson or Jonas Hiller. A GM has two choices – overpay a guy, which gives him an excuse when he loses – or go to the scrap heap and risk having a disaster season like Brian Burke and Ron Wilson just did. Only a GM who has nothing to lose (e.g. Colorado) is usually that ballsy. Most people opt for the “defensible” sure thing – Khabibulin.

by Hawerchuk on Apr 17, 2010 6:27 PM EDT up reply actions  

Yes, I agree with you. Your examples of Cam Ward and MA Fleury is kinda what I meant by “managing image”. If a goalie got hot and helped you win a Stanley Cup, it would be hard to play hard ball with him. Not just b/c he could walk, but also b/c you might get a reputation and scare away other players who you do want. Not exactly the same scenario, but this happened to Keenan with Luongo. Played hardball, Luongo got pissed off, and then basically Keenan knew he had to trade him. Brian Allen was a good pick up…

But my question was mostly genuine and only a bit rhetorical. Let’s say you had the info on Halak and Price from last summer, and for some reason wanted to keep only one (like, halak is good enough, moving Price would get us a player we want, and allow us to move a million and a half to another position). Do you think there’s enough data, in terms of shots at different levels, to make a reasonable call that you have the goalie that you’re going to want to re-sign one year later, maybe for 3 million?

by antro on Apr 18, 2010 7:58 AM EDT up reply actions  

Price had played 92 games and had a .912 SV%. Halak had played 56 games with a .916 or so. With Price, you are starting to get into the range where you know what you’ve got; Halak less so. That would be a very risky time to make a move, and thankfully, since they both had entry-level contracts, there was no need to make a move.

As of today, you have Halak at .919 in 101 games and Price at .912 in 134 games. You are getting to the point where you can pretty much guarantee that Halak is better than Price. Until you have 100 games of data, save percentage can really mislead you. (And I should have looked at even-strength save percentage.)

Halak and Price are both going to be looking at long-term deals now. Together, they are worth $4M; so you sign them to slightly back-loaded 3-year deals and you sell high on whichever one outperforms the most next season.

by Hawerchuk on Apr 18, 2010 12:59 PM EDT up reply actions  

Thanks for the answer (I really do appreciate you’re taking the time). I do realize that MTL didn’t really have to make a decision last year, I was trying to coming up with a scenario where the amount of data is limited on the goalie (< 100 games or 4 years, interesting it’s not in shots).

So (if I may impose once more), this hypothetical GM shouldn’t look at pre-NHL at all?

by antro on Apr 19, 2010 4:21 AM EDT up reply actions  

Probably not:

http://puckprospectus.com/article.php?articleid=160

You need to look for guys who have such high save percentages that it’s virtually impossible that they don’t have talent that’s well above the mean. So a guy like Hiller, who dominated in Europe, would be someone where you’re looking at other stats.

I think the key is that a guy just isn’t going to make that much money until he’s played 100 games, so you have a bit of time to figure things out.

by Hawerchuk on Apr 19, 2010 10:05 AM EDT up reply actions  

Comments For This Post Are Closed


User Tools

Hockey Analysis and Statistics
Start posting on Behind The Net »

Join SB Nation and dive into communities focused on all your favorite teams.

Connect_with_facebook

FanPosts

Community blog posts and discussion.

Recent FanPosts

Pens_ring_small
Why The Kovalchuk Contract Is Unique
Ryan_small
Koivu's contract compared to Plekanec & Backstrom
Dsc_0572_small
Wimbledon Black Swan
Pens_ring_small
Individual PDO Numbers

+ New FanPost All FanPosts >

SBNation.com Recent Stories

PHILADELPHIA - MAY 16:  A fan of the Philadelphia Flyers holds up a sign reading "Next Goalie" behind goalie Carey Price #32 of the Montreal Canadiens in Game 1 of the Eastern Conference Finals during the 2010 NHL Stanley Cup Playoffs at Wachovia Center on May 16, 2010 in Philadelphia, Pennsylvania.  (Photo by Bruce Bennett/Getty Images)

Habs Finally Lock Up Carey Price, Sign Goalie To Two-Year Deal

National Hockey League commissioner Gary Bettman answers questions during a pre-game media availability before the Pittsburgh Penguins season opener against the New York Rangers in a NHL hockey game in Pittsburgh, Friday, Oct. 2, 2009. (AP Photo/Gene J. Puskar) +25 updates

Ultimatum? NHL Reportedly Threatens To Toss Out Kovalchuk, Luongo Deals Without NHLPA Concessions

Photo +1 updates

Report: Donald Fehr Hands NHLPA List Of Conditions On Becoming Union Leader

More from SBNation.com >


Managers

Hawerchuk_small Hawerchuk