Why no 4-on-4 or 5-on-3 or 3-on-5?
If you've ever visited Behindthenet.ca, you'll notice that I don't lump all even-strength or man-advantage play together. Instead, 5-on-5 play is separated from 4-on-4, and 5-on-4 and 4-on-5 are separated from 5-on-3 and 3-on-5, which I find wholly justifiable based on the vastly different shot rates at each strength, and in the case of 4-on-4, the higher leverage and random outcomes of overtime. This has drawn the ire of some out there:
"[N]ote that Desjardins has issues with the way he presents his numbers. He does not include 4on4 play at all. And, he does not present numbers compiled for all situations. This severely compromised his stats with regards to Ehrhoff who excelled at 4on4. If there are other shortcomings in his approach, please let me know.
No problem regarding the issue of sample size, but it would be incorporated if he did an all-scenarios numbers. Desjardins also omits 3on5 and 5on3. In all of these cases, there is a good case to be made for publishing the numbers despite the sample size. In Ehrhoff's case, he stands out as we ran the numbers separately. I can also see it in his play in that scenario last year and this year. Additionally, Ehrhoff got significant 4on4 TOI which mitigates the sample size issue. 5on3 shows a big deficiency on the Sharks, not singling out any player."
First, let's look at the percentage of total shots recorded at each strength last season, both league-wide and by Ehrhoff:
| NHL | Ehrhoff | |||
| Reg | OT | Reg | OT | |
| 5v5 | 74.2 | 70.6 | ||
| 5v4/4v5 | 20.9 | 23.4 | ||
| 5v3/3v5 | 1.2 | 0.9 | ||
| 4v4 | 1.9 | 1.4 | 2.2 | 2.4 |
| 4v3/3v4 | 0.2 | 0.2 | 0.3 | 0.2 |
| 3v3 | 0.004 | 0.012 | 0.0 | 0.0 |
League-wide, 95.1% of shots were taken at 5-on-5, 5-on-4 or 4-on-5, with the other shots mostly distributed across two-man advantages and 4-on-4. A defenseman who plays 20 minutes per game might average 20 seconds per game at 5-on-3 or 3-on-5, and at 4-on-4 in regulation and in overtime. The NHL does not accurately record ice time at these strengths, so a 5- or 10-second error can completely distort a player's rate stats. In addition, 20 or 30 minutes per season at these strengths has basically zero predictive value. So, between uncertainty and high regression to the mean, I don't agree that "there is a good case to be made for publishing the numbers despite the sample size."
As for Ehrhoff, 94.0% of all shots while he was on the ice were at those first three strengths. I don't agree with the notion that "Ehrhoff got significant 4on4 TOI" - he got 16 times as much TOI at 5-on-5 as he did at 4-on-4. Let's look at the difference in Ehrhoff's Corsi percentage (=Shots For/[Shots For + Shots Against]) if we exclude and exclude 4-on-4 play:
| Home | Away | |
| 5v5 | 56.39 | 51.05 |
| All EV | 56.35 | 50.80 |
Not only is the difference negligible, but it is also not true that "Ehrhoff...excelled at 4on4." At least not last season!
I am willing to accept that Christian Ehrhoff could be a particularly good player at 4-on-4. His 80 minutes at 4-on-4 last year were undistinguished, but, as I mentioned above, such a small sample size has virtually zero predictive value. And according to the poster, "[i]n Ehrhoff's case, he stands out as we ran the numbers separately." I'd love to see these separate numbers because I can't construct a compelling case in Ehrhoff's favor.
Update:
From the original poster -
"Ehrhoff had at least 2 goals at 4 on 4, one a game winner. I agree that the sample size is small, but it would be interesting to see what a total stats picture, all situations would show, if you take his situational number for the predominant situations and compare them to the overall number. I did not do that stat. My suspicion is that it was enough to bump his overall number. His overall shot accuracy went way up when taking his overall number and comparing it to the situational numbers that you have posted."
Well, as you can see in the table above, Ehrhoff's Corsi percentage was actually worse when we include 4-on-4 situations. That he scored two goals in 80 or so minutes of play at 4-on-4, including a game winner, is not indicative of future success. It's not necessarily an indication - given his lower Corsi percentage at 4-on-4 - that the sample of his play we saw even represented good performance.
"As an aside, he did get significant special situations TOI relative to other players on the team, 3on5 and 4on4. I would really like to see yourself or the NHL break out special situations because although they do not occur often, they are often the make or break situations in a game. 3on5, 5on3, 3on4 and 4on3 seem to have a lot of difference between teams."
We're really talking about two different things here: observed performance and true talent. Here is the observed performance of NHL teams at different man-advantages:
| Goals For/60 | Worst | Best | % Variation | TOI |
| 2008-09 5v5 | 2 | 2.9 | 45 | 3700 |
| 2008-09 5v4 | 4.3 | 9.9 | 130 | 500 |
| 2008-09 5v3 | 4.2 | 42.4 | 910 | 20 |
| 2009-10 5v3 | 0.0 | 73.8 | Inf | 8 |
In 3700 minutes of 5-on-5 time per team, the range of observed performance is close to that of true talent. But teams with low goal-scoring rates have typically underperformed, while teams with high goal-scoring rates have overperformed. The true talent range is much smaller, as evidenced by a 30% top-to-bottom variation in shot rates.
At 5-on-3, we see massive differences in observed performance, but does this match up to a correspondingly large range of true talents? Do we believe that there are teams that would continue to score zero goals at 5-on-3? No - using eight minutes of ice time is simply not an accurate indicator of a team's abilities. When we exclude 5-on-3 from our analysis, we introduce - in the absolute worst case - 5-7% uncertainty in our results, and virtually zero uncertainty into the predictive value of our tools.
Just to give you one example: the 2007-08 Nashville Predators were 26th in the league at 5-on-3. In 2008-09, they swapped Alexander Radulov and Marek Zidlicky off the PP and replaced them with Steve Sullivan (and extra minutes from all of their D.) They were 5th overall in 5-on-3 PP performance in 2008-09. Of course, their 5-on-4 performance was in the bottom 10 in the league both seasons, and got worse when they dumped Zidlicky, who is a solid PP defenseman. There's simply no evidence that a bad PP team dumped its best player, got worse at 5-on-4, but somehow became a much better team just at 5-on-3.
0 recs |
13 comments
|
Comments
Separating them is certainly the best thing to do. Man advantage play has different lines, different strategies, and a different pace.
by ThrashersRecaps on Jan 12, 2010 9:16 AM EST reply actions
There is no doubt that seperating out 4v4 and 5v5 is the right thing to do. The 4v4 numbers alone are probably too noisy, but there would be some small marginal value to having them in order to sum a player’s entire contributions. For example, I have no problem with +/- including 4v4, while including shorthanded goals as it does now is idiotic. However, it’s inconceivable that a player’s value would hinge on his 4v4 play.
The problem with individual 4 on 4 stats is definitely the sample size. Didn’t Andrew Cogliano a couple years ago score the OT winner in 3 consecutive games or something? Even if he’s done nothing since then, he’d be riding high on the comparative 4 on 4 stats still today because of that hot streak.
There has to be some value players possess 4 on 4 that is unique to that situation, just like there is some for 5 on 4, 4 on 5, and 5 on 5. But i don’t think we can really determine that unless we accumulate the data over several years. I’m not sure even post-lockout we have enough data to make anything but undereducated guesses.
Hockey blogging can't get any flatter.
I agree with you, though I feel like the kind of player who was mediocre at 5-on-5 but excellent at 4-on-4 isn’t much more than average overall.
E.g. – let’s say 90% of his EV TOI was 5-on-5 and 10% was 4-on-4 (this is pretty extreme.) His true talent Corsi is 48% at 5-on-5 and 60% at 4-on-4. His overall Corsi is then 49.2%. So he’s still below-average. Give him credit for high-leverage 4-on-4, and he’s probably a shade above 50%.
Obviously, the kind of player who’s good at 4-on-4 is probably good at 5-on-4, too, so he would generate a lot more value there. If I was going to talk up Ehrhoff, I’d focus on his PP performance!
Obviously a player’s 4 on 4 contributions have little value overall. I guess those single points in OT are valuable, and same with shootouts, and a guy like Ehrhoff is more valuable to the Canucks for his PP contribution than 4 on 4. If he helps the Canucks go 2 for 5 on the PP in a game, than that’s more valuable than even a single goal he might help the Canucks score in OT.
What I like about 4 on 4 OT is this: It reveals what the coach thinks about the game, and nothing more. He thinks these guys give him the best chance to win, but he can’t really back it up. It’s pure gut instinct based on what he knows about the player’s skill sets.
Hockey blogging can't get any flatter.
I’ve been likewise aggravated because you haven’t included 3-on-3 data.
Bettman's Nightmare: A Blog Where Hockey Aficionados Dismantle That Mighty Empire, One Balsillie at a Time
http://bettmansnightmare.blogspot.com/
by Bettman's Nightmare on Jan 12, 2010 11:19 AM EST reply actions
Joking.
Bettman's Nightmare: A Blog Where Hockey Aficionados Dismantle That Mighty Empire, One Balsillie at a Time
http://bettmansnightmare.blogspot.com/
by Bettman's Nightmare on Jan 12, 2010 11:20 AM EST up reply actions
Re: Poll
He certainly seems like a #1 or #2 defenceman for the Canucks this season.
And hey, what about 4-on-3 time? ;)
Mitchell is quite obviously the #1 D at 5-on-5. I personally think Bieksa is used as the #2, with Ehrhoff getting offensive zone face-offs and weaker opposition. He gets lots of PP time and is either #4 or #5 on the PK.
I think Ehrhoff could just as easily be behind Mitchell, Bieksa, Edler and Salo as he could be #2.
Thanks for your insight.
Join me on the Hockey Blog Adventure! (or Twitter.) GO BRUINS! (and Wild!)
by Cornelius Hardenbergh on Jan 13, 2010 12:46 PM EST up reply actions
I am pretty sure that this comment means that Gabe is right.
Pension Plan Puppets: A Toronto Maple Leafs blog and a group therapy session.
I am pretty sure the guy posting it isn’t Jason Gregor. And PPP is correct.
by Scott Reynolds on Jan 14, 2010 3:09 PM EST up reply actions

by 






