Behind The Net: An SB Nation Community

Navigation: Jump to content areas:


Pro Quality. Fan Perspective.
Login-facebook
Around SBN: Off Tackle Empire interviews Rich Rodriguez

Why no 4-on-4 or 5-on-3 or 3-on-5?

If you've ever visited Behindthenet.ca, you'll notice that I don't lump all even-strength or man-advantage play together.  Instead, 5-on-5 play is separated from 4-on-4, and 5-on-4 and 4-on-5 are separated from 5-on-3 and 3-on-5, which I find wholly justifiable based on the vastly different shot rates at each strength, and in the case of 4-on-4, the higher leverage and random outcomes of overtime.  This has drawn the ire of some out there:

Star-divide

"[N]ote that Desjardins has issues with the way he presents his numbers. He does not include 4on4 play at all. And, he does not present numbers compiled for all situations. This severely compromised his stats with regards to Ehrhoff who excelled at 4on4. If there are other shortcomings in his approach, please let me know.

To be fair, the absurdly small sample size of 4-4 play in comparison to normal even strength play would likely have made those numbers suspect anyway.

No problem regarding the issue of sample size, but it would be incorporated if he did an all-scenarios numbers. Desjardins also omits 3on5 and 5on3. In all of these cases, there is a good case to be made for publishing the numbers despite the sample size. In Ehrhoff's case, he stands out as we ran the numbers separately. I can also see it in his play in that scenario last year and this year. Additionally, Ehrhoff got significant 4on4 TOI which mitigates the sample size issue. 5on3 shows a big deficiency on the Sharks, not singling out any player."

First, let's look at the percentage of total shots recorded at each strength last season, both league-wide and by Ehrhoff:

NHL Ehrhoff
Reg OT Reg OT
5v5 74.2 70.6
5v4/4v5 20.9 23.4
5v3/3v5 1.2 0.9
4v4 1.9 1.4 2.2 2.4
4v3/3v4 0.2 0.2 0.3 0.2
3v3 0.004 0.012 0.0 0.0

 

League-wide, 95.1% of shots were taken at 5-on-5, 5-on-4 or 4-on-5, with the other shots mostly distributed across two-man advantages and 4-on-4.  A defenseman who plays 20 minutes per game might average 20 seconds per game at 5-on-3 or 3-on-5, and at 4-on-4 in regulation and in overtime.  The NHL does not accurately record ice time at these strengths, so a 5- or 10-second error can completely distort a player's rate stats.  In addition, 20 or 30 minutes per season at these strengths has basically zero predictive value.  So, between uncertainty and high regression to the mean, I don't agree that "there is a good case to be made for publishing the numbers despite the sample size."

As for Ehrhoff, 94.0% of all shots while he was on the ice were at those first three strengths.  I don't agree with the notion that "Ehrhoff got significant 4on4 TOI" - he got 16 times as much TOI at 5-on-5 as he did at 4-on-4.  Let's look at the difference in Ehrhoff's Corsi percentage (=Shots For/[Shots For + Shots Against]) if we exclude and exclude 4-on-4 play:

 

Home Away
5v5 56.39 51.05
All EV 56.35 50.80

 

Not only is the difference negligible, but  it is also not true that "Ehrhoff...excelled at 4on4."  At least not last season!

I am willing to accept that Christian Ehrhoff could be a particularly good player at 4-on-4.  His 80 minutes at 4-on-4 last year were undistinguished, but, as I mentioned above, such a small sample size has virtually zero predictive value.  And according to the poster, "[i]n Ehrhoff's case, he stands out as we ran the numbers separately."  I'd love to see these separate numbers because I can't construct a compelling case in Ehrhoff's favor. 

Update:

From the original poster -

"Ehrhoff had at least 2 goals at 4 on 4, one a game winner. I agree that the sample size is small, but it would be interesting to see what a total stats picture, all situations would show, if you take his situational number for the predominant situations and compare them to the overall number. I did not do that stat. My suspicion is that it was enough to bump his overall number. His overall shot accuracy went way up when taking his overall number and comparing it to the situational numbers that you have posted." 

Well, as you can see in the table above, Ehrhoff's Corsi percentage was actually worse when we include 4-on-4 situations.  That he scored two goals in 80 or so minutes of play at 4-on-4, including a game winner, is not indicative of future success.  It's not necessarily an indication - given his lower Corsi percentage at 4-on-4 - that the sample of his play we saw even represented good performance.

"As an aside, he did get significant special situations TOI relative to other players on the team, 3on5 and 4on4. I would really like to see yourself or the NHL break out special situations because although they do not occur often, they are often the make or break situations in a game. 3on5, 5on3, 3on4 and 4on3 seem to have a lot of difference between teams."

We're really talking about two different things here: observed performance and true talent.  Here is the observed performance of NHL teams at different man-advantages:

 

Goals For/60 Worst Best % Variation TOI
2008-09 5v5 2 2.9 45 3700
2008-09 5v4 4.3 9.9 130 500
2008-09 5v3 4.2 42.4 910 20
2009-10 5v3 0.0 73.8 Inf 8

 

In 3700 minutes of 5-on-5 time per team, the range of observed performance is close to that of true talent.  But teams with low goal-scoring rates have typically underperformed, while teams with high goal-scoring rates have overperformed.  The true talent range is much smaller, as evidenced by a 30% top-to-bottom variation in shot rates.

At 5-on-3, we see massive differences in observed performance, but does this match up to a correspondingly large range of true talents?  Do we believe that there are teams that would continue to score zero goals at 5-on-3?  No - using eight minutes of ice time is simply not an accurate indicator of a team's abilities.  When we exclude 5-on-3 from our analysis, we introduce - in the absolute worst case - 5-7% uncertainty in our results, and virtually zero uncertainty into the predictive value of our tools.

Just to give you one example: the 2007-08 Nashville Predators were 26th in the league at 5-on-3.  In 2008-09, they swapped Alexander Radulov and Marek Zidlicky off the PP and replaced them with Steve Sullivan (and extra minutes from all of their D.)  They were 5th overall in 5-on-3 PP performance in 2008-09.  Of course, their 5-on-4 performance was in the bottom 10 in the league both seasons, and got worse when they dumped Zidlicky, who is a solid PP defenseman.  There's simply no evidence that a bad PP team dumped its best player, got worse at 5-on-4, but somehow became a much better team just at 5-on-3.

Poll
What is the right role for Christian Ehrhoff?
#1 or #2 Defenseman
18 votes
#3 or #4 Defenseman
47 votes
Power-play Specialist; Not suited for Top Even-Strength Competition
8 votes
Whatever it is, he's amazing at 4-on-4
14 votes

87 votes | Poll has closed

0 recs  |  Comment 13 comments |

Story-email Email Printer Print

Comments

Display:

Separating them is certainly the best thing to do. Man advantage play has different lines, different strategies, and a different pace.

by ThrashersRecaps on Jan 12, 2010 9:16 AM EST reply actions  

There is no doubt that seperating out 4v4 and 5v5 is the right thing to do. The 4v4 numbers alone are probably too noisy, but there would be some small marginal value to having them in order to sum a player’s entire contributions. For example, I have no problem with +/- including 4v4, while including shorthanded goals as it does now is idiotic. However, it’s inconceivable that a player’s value would hinge on his 4v4 play.

by Tom Awad on Jan 12, 2010 9:28 AM EST reply actions  

The problem with individual 4 on 4 stats is definitely the sample size. Didn’t Andrew Cogliano a couple years ago score the OT winner in 3 consecutive games or something? Even if he’s done nothing since then, he’d be riding high on the comparative 4 on 4 stats still today because of that hot streak.

There has to be some value players possess 4 on 4 that is unique to that situation, just like there is some for 5 on 4, 4 on 5, and 5 on 5. But i don’t think we can really determine that unless we accumulate the data over several years. I’m not sure even post-lockout we have enough data to make anything but undereducated guesses.

Hockey blogging can't get any flatter.

by saskhab on Jan 12, 2010 10:11 AM EST reply actions  

I agree with you, though I feel like the kind of player who was mediocre at 5-on-5 but excellent at 4-on-4 isn’t much more than average overall.

E.g. – let’s say 90% of his EV TOI was 5-on-5 and 10% was 4-on-4 (this is pretty extreme.) His true talent Corsi is 48% at 5-on-5 and 60% at 4-on-4. His overall Corsi is then 49.2%. So he’s still below-average. Give him credit for high-leverage 4-on-4, and he’s probably a shade above 50%.

Obviously, the kind of player who’s good at 4-on-4 is probably good at 5-on-4, too, so he would generate a lot more value there. If I was going to talk up Ehrhoff, I’d focus on his PP performance!

by Hawerchuk on Jan 12, 2010 1:48 PM EST up reply actions  

Obviously a player’s 4 on 4 contributions have little value overall. I guess those single points in OT are valuable, and same with shootouts, and a guy like Ehrhoff is more valuable to the Canucks for his PP contribution than 4 on 4. If he helps the Canucks go 2 for 5 on the PP in a game, than that’s more valuable than even a single goal he might help the Canucks score in OT.

What I like about 4 on 4 OT is this: It reveals what the coach thinks about the game, and nothing more. He thinks these guys give him the best chance to win, but he can’t really back it up. It’s pure gut instinct based on what he knows about the player’s skill sets.

Hockey blogging can't get any flatter.

by saskhab on Jan 12, 2010 6:17 PM EST up reply actions  

I’ve been likewise aggravated because you haven’t included 3-on-3 data.

Bettman's Nightmare: A Blog Where Hockey Aficionados Dismantle That Mighty Empire, One Balsillie at a Time

http://bettmansnightmare.blogspot.com/

by Bettman's Nightmare on Jan 12, 2010 11:19 AM EST reply actions  

Joking.

Bettman's Nightmare: A Blog Where Hockey Aficionados Dismantle That Mighty Empire, One Balsillie at a Time

http://bettmansnightmare.blogspot.com/

by Bettman's Nightmare on Jan 12, 2010 11:20 AM EST up reply actions  

Re: Poll

He certainly seems like a #1 or #2 defenceman for the Canucks this season.

And hey, what about 4-on-3 time? ;)

by skeeter_dan on Jan 12, 2010 4:58 PM EST reply actions  

Mitchell is quite obviously the #1 D at 5-on-5. I personally think Bieksa is used as the #2, with Ehrhoff getting offensive zone face-offs and weaker opposition. He gets lots of PP time and is either #4 or #5 on the PK.

I think Ehrhoff could just as easily be behind Mitchell, Bieksa, Edler and Salo as he could be #2.

by Hawerchuk on Jan 12, 2010 5:22 PM EST up reply actions  

Thanks for your insight.

Join me on the Hockey Blog Adventure! (or Twitter.) GO BRUINS! (and Wild!)

by Cornelius Hardenbergh on Jan 13, 2010 12:46 PM EST up reply actions  

I am pretty sure that this comment means that Gabe is right.

Pension Plan Puppets: A Toronto Maple Leafs blog and a group therapy session.

by PPP on Jan 13, 2010 10:27 PM EST up reply actions  

I am pretty sure the guy posting it isn’t Jason Gregor. And PPP is correct.

by Scott Reynolds on Jan 14, 2010 3:09 PM EST up reply actions  

Comments For This Post Are Closed


User Tools

Hockey Analysis and Statistics
Start posting on Behind The Net »

Join SB Nation and dive into communities focused on all your favorite teams.

Connect_with_facebook

FanPosts

Community blog posts and discussion.

Recent FanPosts

Pens_ring_small
Why The Kovalchuk Contract Is Unique
Ryan_small
Koivu's contract compared to Plekanec & Backstrom
Dsc_0572_small
Wimbledon Black Swan
Pens_ring_small
Individual PDO Numbers

+ New FanPost All FanPosts >

SBNation.com Recent Stories

PHILADELPHIA - MAY 16:  A fan of the Philadelphia Flyers holds up a sign reading "Next Goalie" behind goalie Carey Price #32 of the Montreal Canadiens in Game 1 of the Eastern Conference Finals during the 2010 NHL Stanley Cup Playoffs at Wachovia Center on May 16, 2010 in Philadelphia, Pennsylvania.  (Photo by Bruce Bennett/Getty Images)

Habs Finally Lock Up Carey Price, Sign Goalie To Two-Year Deal

National Hockey League commissioner Gary Bettman answers questions during a pre-game media availability before the Pittsburgh Penguins season opener against the New York Rangers in a NHL hockey game in Pittsburgh, Friday, Oct. 2, 2009. (AP Photo/Gene J. Puskar) +25 updates

Ultimatum? NHL Reportedly Threatens To Toss Out Kovalchuk, Luongo Deals Without NHLPA Concessions

Photo +1 updates

Report: Donald Fehr Hands NHLPA List Of Conditions On Becoming Union Leader

More from SBNation.com >


Managers

Hawerchuk_small Hawerchuk