Tuesday, November 10, 2009

Magical Yellow Flags: a Look at Penalties

If you're a regular visitor to this site, you probably could've seen this one coming.

But it's not going to go where you think it's going to.

We're simply going to be looking at the raw, inarguable stats - penalties that were called and penalty yards per game for the last nine seasons. Not how many penalties were called that shouldn't have been, not how many penalties the refs missed, not how much your team got screwed. As usual, we've gotta set the stage. Here's the first set of numbers:

General Penalty Numbers/Yards by Year
Year Games # pen. avg (ptpg) stdD # yds avg (ptpg) stdD pen diff yd diff Team A pen Team B pen Team A yds Team B yds
2000 696 9,916 7.1 3.1 84,189 60.5 28.9 3.1 26.0 5.6 8.7 45.8 75.1
2001 709 10,045 7.1 3.0 84,483 59.6 28.3 3.2 25.9 5.5 8.7 45.0 74.1
2002 772 10,529 6.8 3.0 89,162 57.7 28.4 3.0 24.7 5.3 8.3 43.5 72.0
2003 771 10,473 6.8 3.0 88,755 57.6 28.7 3.0 24.5 5.3 8.3 43.4 71.7
2004 707 9,369 6.6 2.9 78,668 55.6 27.4 3.0 24.5 5.1 8.1 41.7 69.6
2005 718 9,781 6.8 3.0 82,831 57.7 27.9 3.1 26.7 5.2 8.4 42.8 72.6
2006 792 9,219 5.8 2.7 77,396 48.9 24.8 2.8 22.8 4.4 7.2 35.9 61.9
2007 792 10,151 6.4 2.8 86,244 54.4 26.5 2.8 21.7 5.0 7.8 41.8 67.1
2008 804 9,456 5.9 2.7 81,613 50.8 25.4 2.8 23.9 4.5 7.3 37.5 64.1

So here's what we're looking at. "ptpg" refers to "per team per game", so we see that in an average game over the last nine seasons, each team has taken around 6 or 7 penalties to the tune of 55 yards per game. But that's overall - in each game, there's a penalty & yard difference (columns 9 & 10) of around 3 penalties and 25 penalty yards per game. So the last four columns show the average split of penalties in each game: Team A, the team with fewer penalties, usually averages 5 for 43 yards, while Team B usually averages 8 for 68 yards. Make sense? The two "stdD" columns represent the standard deviation of penalties and penalty yards per year. Interestingly, both the average number of penalties and penalty yards per game has been decreasing this decade, as have the standard deviations of each. That means that the averages for each individual game have been getting closer and closer to the season averages. (Click here for the Wikipedia rundown on how standard deviation works, if you need a refresher.)

All that is fine and dandy but we've gotta dig deeper and find individual outliers, or instances of a team having significantly more or less penalties/yards in an individual game. Why is that particular stat important? Well, mainly because we have to compare each team to itself. If we find an instance of a team taking 16 penalties for 135 yards, and compare it to the averages, it doesn't help because maybe that team averaged 14 penalties for 115 yards per game. So we're going to be computing each individual team's numbers and seeing what jumps out. To do all that we're going to find the numbers, averages, and standard deviations for each of the almost 1,200 team seasons this decade.

Team Penalties-Penalty Yards by year
Team 2000 2001 2002 2003 2004 2005 2006 2007 2008 Totals
Boston Coll 07.1-54.3 06.6-57.6 06.2-54.5 08.1-60.5 07.3-58.3 06.8-54.8 06.0-43.5 06.9-61.4 04.3-36.7 06.5-53.3
Clemson 08.7-78.3 08.5-72.0 06.2-59.2 06.4-56.5 05.3-45.2 04.8-40.5 04.2-36.2 05.2-43.1 05.5-47.5 06.1-53.0
Duke 09.5-74.3 06.6-53.1 05.4-44.3 06.0-44.6 05.3-38.2 07.4-63.7 06.0-47.0 06.1-52.9 04.7-43.8 06.3-51.1
Florida St 09.8-89.6 08.1-65.8 07.8-66.8 07.0-64.2 09.7-86.2 08.8-78.3 06.8-53.6 08.3-66.9 07.8-72.1 08.2-71.4
Georgia Tech 08.2-67.8 06.8-57.5 07.3-60.9 05.2-44.3 06.3-53.3 07.3-57.2 06.1-50.9 06.9-59.3 04.8-43.8 06.5-54.9
Maryland 06.0-47.0 06.6-56.8 06.0-55.3 06.3-53.6 06.2-49.8 05.1-44.1 04.3-37.2 05.6-45.3 04.7-41.2 05.6-47.8
Miami (FL) 09.0-88.4 10.1-85.8 09.5-81.2 09.5-79.0 07.9-61.3 07.3-70.1 06.8-61.9 06.5-51.8 05.7-46.5 08.0-69.5
N Carolina 05.9-50.3 08.2-65.1 07.9-66.0 05.7-48.7 05.4-42.8 08.0-66.9 06.1-52.8 06.9-55.7 04.8-42.3 06.5-54.4
NC State 08.7-75.8 07.2-61.3 07.2-62.9 07.7-69.8 09.2-70.8 07.6-61.9 07.2-58.0 06.6-54.5 05.5-42.3 07.4-61.8
Virginia 06.4-52.8 07.5-69.3 04.6-34.6 05.0-42.8 05.6-50.0 05.5-47.3 04.5-32.6 04.8-40.9 04.9-42.4 05.4-45.6
Virginia Tech 06.0-52.8 06.7-64.1 06.3-53.1 06.3-54.8 07.7-63.9 06.2-53.6 05.9-51.1 06.6-55.6 05.0-34.7 06.3-53.5
Wake Forest 06.0-49.9 06.7-58.6 05.9-52.6 05.1-43.7 06.1-58.7 06.4-62.1 04.8-44.2 05.2-47.8 04.7-48.2 05.6-51.3
Illinois 04.1-36.4 05.5-55.8 04.9-45.8 05.1-39.8 03.8-32.8 06.3-50.6 04.9-38.3 04.9-48.9 05.5-51.0 05.0-44.5
Indiana 06.5-55.6 07.0-57.1 04.8-47.1 05.1-42.3 06.7-50.0 06.7-55.0 04.9-42.1 05.8-54.5 05.3-49.3 05.8-50.2
Iowa 06.5-54.3 06.5-49.6 07.9-66.0 06.2-49.5 07.6-56.3 04.3-37.3 05.0-44.7 05.6-50.9 04.1-34.3 06.0-49.2
Michigan 05.3-46.3 05.4-40.3 05.0-38.3 04.9-39.8 05.2-45.6 04.0-31.8 04.8-43.8 05.1-44.6 04.8-41.7 04.9-41.4
Michigan St 06.8-62.6 07.7-62.3 06.7-62.4 09.5-81.5 06.3-54.0 06.2-48.5 06.8-56.0 05.0-48.4 05.1-46.2 06.7-58.0
Minnesota 07.7-67.2 06.1-46.5 05.8-44.4 05.8-50.6 05.4-38.9 05.3-50.6 05.2-43.8 05.6-41.8 06.4-53.5 05.9-48.6
Northwestern 09.3-87.7 07.5-67.3 07.3-65.3 06.0-45.6 06.6-57.4 06.2-48.5 03.3-28.0 04.9-46.9 04.7-43.6 06.2-54.2
Ohio St 08.2-73.5 05.9-48.0 05.4-40.8 07.2-61.5 05.9-44.8 05.4-48.2 04.8-43.4 05.5-44.2 05.2-43.6 05.9-49.5
Penn St 05.8-45.1 04.9-38.5 04.9-42.0 03.3-23.2 05.6-46.1 04.8-35.2 04.5-33.6 04.5-34.3 03.8-31.4 04.6-36.4
Purdue 05.9-45.5 07.8-63.4 05.6-46.0 06.5-53.6 05.9-52.3 06.6-52.6 05.3-39.1 05.9-48.3 05.0-40.3 06.0-48.8
Wisconsin 06.0-55.6 05.3-41.7 05.8-45.3 05.1-37.9 04.8-36.9 05.5-47.2 04.7-37.3 05.6-43.9 05.3-47.4 05.3-43.8
Baylor 06.4-56.1 06.6-54.0 09.2-75.5 07.8-64.8 06.3-48.3 08.1-69.6 06.4-56.5 05.8-44.3 06.7-54.7 07.0-58.2
Colorado 07.9-61.8 08.1-68.7 06.8-59.5 07.0-56.4 08.0-60.7 09.5-83.4 05.3-46.6 06.8-55.8 05.4-43.0 07.2-59.8
Iowa St 06.8-62.7 05.9-49.9 05.1-40.8 05.7-49.3 06.0-49.4 05.3-47.3 04.7-35.8 04.7-42.4 06.4-57.4 05.6-48.2
Kansas 06.8-59.0 07.0-63.5 05.1-43.8 06.5-51.2 08.0-63.5 07.3-65.9 05.6-46.2 04.1-39.1 04.8-44.3 06.1-52.5
Kansas St 08.2-69.6 08.3-63.3 07.7-58.4 06.5-48.4 06.3-45.3 08.7-75.2 06.8-57.5 08.2-75.3 05.6-45.8 07.4-59.7
Missouri 06.9-57.1 05.1-40.4 06.8-53.1 05.4-46.9 04.3-35.4 07.2-67.1 04.5-36.9 05.4-46.3 04.1-37.4 05.5-46.5
Nebraska 06.3-57.4 05.6-53.8 06.1-56.0 06.8-54.6 06.8-51.0 07.4-57.8 05.3-43.9 06.4-49.1 07.2-61.5 06.4-53.9
Oklahoma 07.4-63.8 07.6-66.2 05.5-44.1 06.1-48.1 06.5-56.4 08.5-71.7 04.9-37.2 06.9-57.5 07.3-64.6 06.7-56.2
Oklahoma St 07.9-66.1 07.0-50.7 08.9-71.6 06.8-62.5 04.4-35.4 07.5-57.5 05.7-47.2 07.2-66.6 06.5-54.3 06.9-57.0
Texas 07.9-70.0 05.2-45.0 07.2-61.5 07.7-63.2 07.7-59.3 07.6-65.5 05.5-50.8 06.2-55.4 06.4-56.8 06.8-58.5
Texas A&M 06.6-58.3 05.9-49.2 07.0-54.5 06.7-53.7 08.3-71.3 07.0-54.3 05.9-47.9 06.2-47.2 07.3-56.8 06.8-54.7
Texas Tech 09.0-72.5 06.8-59.1 06.4-51.0 07.8-74.1 09.2-75.0 09.4-83.4 07.4-64.9 07.9-71.8 07.3-60.2 07.9-67.7
Cincinnati 07.8-64.4 06.6-58.8 07.3-62.8 06.4-55.7 06.4-50.2 06.2-52.4 06.8-58.1 09.4-79.1 07.1-64.5 07.1-61.0
Connecticut 07.6-62.4 06.8-59.1 06.3-49.9 06.0-49.5 05.6-52.1 06.2-47.2 05.4-42.6 06.1-45.7 05.1-43.9 06.1-50.0
Louisville 11.2-97.8 08.7-74.5 10.3-91.7 07.5-61.0 05.6-51.9 07.7-68.0 05.0-44.8 07.8-68.2 06.3-56.8 07.8-68.3
Pittsburgh 06.8-61.4 06.8-68.0 05.9-56.0 05.3-40.2 05.8-46.7 06.3-53.9 05.7-43.9 07.3-63.5 04.4-33.8 06.0-51.7
Rutgers 06.4-55.4 09.8-72.9 08.9-67.5 06.8-53.4 07.0-54.5 07.2-60.9 04.6-37.5 07.2-59.6 04.5-38.8 06.9-55.2
S Florida - 10.0-84.3 11.6-97.8 09.4-83.0 09.5-80.9 08.8-69.3 08.0-70.5 08.6-72.1 08.5-67.8 09.2-77.7
Syracuse 07.5-61.1 08.2-64.7 05.8-46.8 06.6-55.2 07.3-63.7 06.1-50.2 05.9-46.8 07.1-58.9 04.5-38.3 06.6-54.0
West Virginia 06.4-53.6 07.5-71.4 07.1-64.5 08.0-71.1 08.9-84.0 06.8-58.1 06.8-66.7 05.5-52.8 04.5-41.2 06.8-62.3
E Carolina 05.0-48.3 06.4-50.4 04.7-37.2 06.3-51.2 05.1-39.7 05.5-46.3 04.5-39.3 08.0-63.6 05.9-53.0 05.7-47.9
Houston 08.5-74.6 08.4-67.7 06.4-56.3 08.5-72.5 07.7-60.5 07.8-69.2 06.8-58.1 07.8-67.7 06.3-58.2 07.5-64.8
Marshall 06.9-59.0 07.8-68.0 09.0-74.5 06.3-58.0 06.4-56.4 05.3-38.7 06.6-55.7 06.9-57.9 05.3-45.3 06.8-57.5
Memphis 07.7-62.7 06.7-53.5 05.8-46.4 06.2-49.5 06.4-52.7 07.4-60.3 04.3-37.3 06.6-54.8 04.5-39.9 06.2-50.6
Rice 06.5-56.6 05.7-41.4 05.5-44.5 05.3-45.3 05.6-49.6 04.9-44.2 05.8-42.8 05.6-43.7 04.9-42.5 05.5-45.5
SMU 07.3-60.9 07.0-56.0 05.5-52.1 07.3-58.2 07.0-61.1 06.9-60.8 06.5-53.5 07.7-69.4 06.2-48.8 06.8-57.8
Sou. Miss 06.5-50.9 06.9-52.6 07.4-56.6 05.7-45.8 06.9-59.4 06.2-51.3 05.4-42.1 05.5-53.8 07.6-74.8 06.4-54.1
Tulane 09.2-86.7 04.9-39.2 06.8-61.7 05.5-51.0 05.6-50.7 05.4-48.4 06.0-47.8 06.0-54.5 06.0-52.5 06.2-54.6
Tulsa 05.5-42.4 05.6-48.2 06.5-48.9 06.6-64.1 06.3-56.1 05.8-47.7 05.1-44.0 06.1-56.2 04.4-37.0 05.8-49.4
UAB 08.5-73.5 08.3-61.9 08.3-65.8 06.4-52.4 06.6-51.6 06.8-58.1 07.8-58.5 06.3-50.9 06.9-65.3 07.3-59.6
UCF 08.8-72.5 10.0-81.1 08.0-64.3 08.7-72.3 05.5-48.0 07.5-63.3 04.6-40.3 05.3-47.5 05.7-52.3 07.0-59.8
UTEP 07.3-59.6 08.0-61.5 06.6-53.7 08.4-66.5 06.2-52.6 07.0-64.1 06.1-54.3 07.2-66.4 06.1-57.3 07.0-59.6
Army 05.5-38.0 05.3-44.5 06.3-58.7 05.1-45.8 05.1-44.1 06.2-45.6 04.3-37.3 04.0-31.3 03.8-36.4 05.0-42.4
Navy 07.4-54.1 03.9-34.1 04.3-31.8 04.5-37.2 04.2-35.8 04.3-33.8 04.0-33.7 04.0-29.8 03.2-26.8 04.4-35.0
Notre Dame 06.4-55.6 06.7-56.9 06.1-53.5 06.3-51.0 05.6-45.7 06.4-55.6 06.7-53.5 06.5-57.8 05.4-49.9 06.2-53.2
Akron 07.3-70.4 05.3-43.3 07.4-67.4 06.3-56.6 05.5-47.1 07.4-62.8 09.3-74.0 07.0-52.9 05.5-46.5 06.8-58.0
Ball St 05.5-48.1 04.7-42.1 05.1-40.7 05.8-48.1 05.8-44.6 06.6-59.0 05.0-45.7 05.8-55.6 02.8-26.7 05.2-45.3
Bowl Green 05.2-47.8 05.9-54.0 06.3-56.8 05.8-46.2 06.8-54.4 05.5-47.8 05.5-48.2 06.5-56.2 06.3-53.4 06.0-51.6
Buffalo 06.0-50.5 06.2-42.5 06.1-53.3 06.1-50.3 06.2-49.5 06.9-62.6 05.8-46.3 06.4-56.4 04.7-44.9 06.0-50.6
C Michigan 04.9-37.6 06.6-54.8 04.8-38.9 05.3-50.9 07.7-65.7 08.4-77.9 05.9-50.2 05.9-59.6 05.8-56.6 06.1-54.6
E Michigan 05.9-50.1 06.5-55.5 05.4-41.1 04.3-36.0 07.3-67.2 05.7-51.8 07.3-59.1 06.3-50.3 05.4-50.0 06.0-51.0
Kent St 08.0-57.2 06.3-57.4 07.0-58.9 06.2-58.9 07.0-61.6 06.8-56.7 06.8-58.0 06.0-55.3 05.2-39.6 06.6-55.9
Miami (OH) 06.6-59.1 07.5-65.2 05.6-50.8 06.7-59.0 06.3-51.5 06.3-57.1 05.8-54.7 05.5-47.1 05.3-42.1 06.2-54.0
N Illinois 05.8-52.9 05.9-52.8 05.2-50.5 05.6-51.3 05.6-50.4 06.2-58.8 04.8-40.1 05.1-46.6 04.8-43.8 05.4-49.5
Ohio 05.9-48.7 05.5-48.7 04.4-41.8 05.8-46.8 06.8-56.8 07.5-62.5 06.6-57.4 08.1-70.5 06.6-59.0 06.4-54.8
Temple 07.7-58.7 09.1-71.2 08.3-70.6 08.4-67.9 05.8-47.7 05.2-42.0 06.3-46.6 05.9-48.5 06.8-55.3 07.1-56.6
Toledo 04.5-41.8 08.6-82.0 06.8-59.3 06.1-56.2 05.5-50.5 07.5-67.4 06.9-66.8 07.2-64.0 06.3-49.5 06.6-59.8
W Michigan 05.7-49.6 07.2-56.4 07.2-56.9 06.9-55.4 08.0-65.4 07.6-62.8 06.5-55.7 07.9-65.4 06.2-47.4 07.0-57.0
Air Force 05.3-41.2 04.7-38.6 04.2-33.9 04.2-32.8 05.2-45.4 04.9-45.9 03.9-34.0 04.8-44.2 05.6-46.3 04.8-40.2
BYU 06.9-63.1 06.9-62.0 08.3-64.9 07.3-63.8 07.5-63.8 08.3-72.5 07.2-59.2 07.0-60.2 07.8-70.2 07.5-64.3
Colorado St 03.8-32.9 05.3-43.1 03.7-34.5 04.8-41.0 04.4-35.0 06.1-50.0 04.8-38.9 05.3-43.4 04.6-42.1 04.7-40.1
New Mexico 06.1-49.4 06.5-56.7 07.2-61.1 06.9-60.2 07.8-61.8 07.4-56.2 05.0-41.8 06.6-52.9 06.8-57.8 06.7-55.3
San Diego St 05.3-44.3 05.5-51.8 06.3-52.7 06.8-61.4 08.1-74.3 06.0-47.2 05.9-51.7 06.0-50.3 06.1-51.0 06.2-53.7
TCU 08.3-75.3 10.3-85.8 07.9-67.4 08.1-72.2 08.8-82.5 08.7-79.6 07.2-60.6 06.6-57.9 08.8-76.9 08.3-72.8
UNLV 06.7-61.4 06.6-58.5 07.8-65.5 08.2-66.8 09.0-71.7 08.3-60.9 06.1-57.1 07.2-61.2 05.5-43.0 07.2-60.6
Utah 06.5-63.4 06.7-57.5 07.4-68.2 07.5-64.4 07.3-63.8 07.7-63.5 06.2-57.2 06.3-58.6 06.9-62.8 06.9-62.0
Wyoming 05.3-41.0 05.0-41.7 04.2-33.8 05.8-47.0 06.9-60.3 05.9-54.5 05.7-45.8 06.1-53.2 05.8-51.8 05.6-47.7
Arizona 08.2-68.2 07.2-64.4 07.3-58.8 07.0-64.0 05.1-42.9 06.6-52.8 05.8-48.2 06.2-53.0 04.1-35.2 06.3-53.9
Arizona St 07.8-62.8 07.2-66.1 08.1-75.3 07.9-71.1 07.4-68.6 09.5-81.8 07.9-64.2 06.2-56.8 07.8-66.8 07.8-68.2
California 08.8-69.2 09.0-82.5 07.6-69.7 05.8-46.5 05.9-56.1 05.8-51.7 05.5-47.7 07.2-62.2 05.9-49.9 06.7-58.8
Oregon 07.8-70.2 06.5-59.3 08.5-71.2 07.8-69.7 08.6-79.7 08.0-72.3 07.5-60.0 06.1-55.0 07.1-62.1 07.5-66.4
Oregon St 09.6-88.8 08.4-71.1 09.7-100.2 11.2-110.2 08.6-78.8 08.9-78.9 06.3-59.8 06.6-58.2 06.7-56.8 08.4-77.9
Stanford 05.8-42.8 05.3-40.3 08.0-64.4 07.9-69.2 06.1-51.6 05.1-40.3 05.0-35.7 05.3-50.3 06.9-61.9 06.1-50.6
UCLA 07.1-62.9 06.7-59.6 06.0-58.2 08.4-75.1 05.4-43.4 06.3-52.0 06.4-60.1 07.3-62.1 06.6-56.5 06.7-59.0
USC 09.4-81.4 07.0-60.2 07.0-58.5 05.3-48.8 05.6-46.2 07.2-63.6 06.2-50.2 08.2-74.4 07.9-72.9 07.1-61.6
Wash St 07.4-63.6 08.3-67.6 06.1-52.8 07.7-62.3 06.9-56.8 06.2-50.5 05.0-42.3 06.2-47.2 04.7-39.8 06.5-53.6
Washington 10.5-84.4 08.0-70.3 07.9-67.1 11.5-94.6 07.0-65.7 06.7-63.5 05.4-47.3 06.1-51.4 07.2-69.4 07.8-68.4
Alabama 07.5-57.8 07.9-63.1 09.3-78.8 06.1-50.4 05.8-51.2 06.2-46.8 06.0-42.8 04.5-34.8 04.1-37.1 06.3-51.1
Arkansas 06.2-50.8 06.2-49.2 08.1-71.6 06.5-54.9 05.7-41.4 07.3-58.5 05.9-53.9 06.3-54.4 06.6-48.7 06.5-54.1
Auburn 06.8-54.6 07.3-63.5 08.3-58.0 05.7-50.2 06.2-52.8 05.6-44.8 05.5-45.8 06.2-47.6 06.2-47.3 06.4-51.6
Florida 07.8-59.3 08.9-63.7 07.0-54.8 07.4-59.3 08.8-70.3 08.5-65.3 08.3-63.4 08.2-61.9 07.3-59.9 08.0-61.9
Georgia 05.9-42.9 08.3-71.3 07.2-62.8 08.5-73.7 07.8-66.3 05.9-53.6 06.0-47.0 07.0-58.5 08.6-72.2 07.3-61.1
Kentucky 08.1-65.1 08.9-69.7 08.8-69.7 06.8-56.0 07.3-55.8 04.7-41.1 06.2-52.8 06.4-55.2 05.3-43.2 06.9-56.3
LSU 07.3-63.8 06.9-59.2 07.1-56.9 07.3-60.4 06.0-45.6 08.3-69.8 06.4-50.5 08.4-62.9 06.3-49.9 07.1-57.8
Mississippi 06.6-55.8 04.9-42.3 05.6-47.7 06.2-51.6 07.0-56.9 05.5-42.2 04.9-38.7 06.4-47.6 05.1-48.0 05.8-47.9
MissSt 09.9-83.4 09.5-89.7 07.1-61.2 08.8-72.4 05.9-48.0 06.4-55.7 05.5-51.9 05.9-52.3 05.7-44.3 07.2-61.9
S Carolina 06.1-52.4 06.7-49.4 06.3-56.4 05.5-45.3 06.1-44.5 06.0-46.5 06.6-52.2 05.8-44.3 05.8-49.2 06.1-49.0
Tennessee 06.2-51.3 06.8-57.3 07.3-58.5 07.2-68.0 06.5-56.3 07.9-60.9 04.9-37.7 05.3-45.8 05.5-44.9 06.4-53.3
Vanderbilt 06.4-54.9 06.9-54.8 06.1-47.3 04.8-39.4 04.8-40.4 04.2-30.9 04.0-33.3 04.9-39.9 04.3-36.4 05.1-41.7
Arkansas St 07.9-64.9 06.4-56.3 07.6-62.0 08.9-71.2 08.6-67.5 10.1-75.9 05.8-50.8 07.0-61.2 07.0-65.0 07.7-63.9
Florida Atl - - - - - 08.3-67.0 05.8-52.7 06.5-51.8 07.4-70.4 07.4-63.8
Florida Intl - - - - - 07.7-67.3 07.3-64.1 06.1-46.4 08.8-66.6 07.4-60.1
LA-Lafayette 08.1-67.4 08.5-65.7 05.8-47.5 06.9-59.8 05.5-42.5 06.5-56.6 05.8-46.1 07.0-52.5 07.1-57.8 06.8-55.0
LA-Monroe 06.5-54.3 06.9-57.5 09.7-75.9 08.0-63.4 08.3-79.8 08.5-67.4 07.1-53.6 08.3-67.9 06.8-59.8 07.8-64.4
Mid Tenn St 07.2-65.5 08.1-69.8 07.0-62.5 07.4-68.3 07.8-69.2 08.1-73.3 05.5-42.5 06.5-55.9 05.7-50.6 07.0-61.5
North Texas 05.6-46.8 07.9-70.3 08.1-71.0 08.8-86.9 07.7-69.2 08.2-74.3 06.3-51.6 08.3-66.1 06.6-54.9 07.5-66.0
Troy - 06.9-61.9 05.4-47.4 06.8-55.3 06.3-49.8 06.5-56.0 06.1-57.7 07.2-58.1 06.8-57.8 06.5-55.5
W Kentucky - - - - - - - - 05.3-51.3 05.9-53.4
Boise St 06.2-63.2 06.0-55.7 08.2-77.2 07.2-70.1 06.4-55.9 07.5-68.5 05.8-49.8 07.1-63.7 07.2-64.5 06.9-63.4
Fresno St 08.8-73.0 09.3-76.9 08.4-76.1 07.0-66.6 07.7-72.1 08.1-72.6 05.1-39.5 06.4-54.9 04.9-41.8 07.3-64.0
Hawaii 09.7-69.2 07.8-70.3 08.7-74.4 07.5-66.4 06.0-49.8 08.4-72.7 07.4-66.4 07.0-66.2 08.7-78.4 07.9-68.2
Idaho 07.1-62.0 09.4-81.5 06.6-61.9 07.0-58.3 07.2-67.5 08.6-77.6 07.3-76.8 06.8-63.5 06.4-61.4 07.4-67.7
LA Tech 07.4-62.8 07.8-67.8 07.1-62.3 07.5-57.7 07.1-59.1 06.3-52.3 05.2-47.1 07.8-66.8 06.1-52.5 06.9-58.6
Nevada 08.9-73.7 08.7-71.0 06.9-57.7 07.2-62.4 07.7-68.4 06.1-51.2 04.2-33.6 07.2-57.2 06.8-57.9 07.0-58.9
New Mex St 09.2-74.5 08.3-68.2 06.4-55.8 06.5-56.8 08.6-78.9 05.3-41.2 07.3-73.8 05.9-46.2 05.4-45.3 06.9-59.6
San Jose St 08.3-65.3 07.6-57.2 07.5-70.9 07.3-64.5 06.3-55.6 06.3-52.2 04.8-37.8 06.4-45.8 06.8-51.9 06.8-55.6
Utah St 07.0-66.7 08.6-81.3 08.5-77.6 09.6-74.9 07.1-63.8 06.3-61.6 05.4-47.1 06.1-54.0 07.3-66.8 07.3-65.8

So there's the numbers & averages. (No room for the standard deviations - sorry.) We'll define a significant outlier as any game in which a team's penalties are more than two standard deviations away from their average (meaning we're going to be looking at around the top 5% of penalty games that deviate from the norm). For instance, if Texas' penalties per game for a season are 4,4,19,4,2,3,9,5,5,4,4,3,6, that gives them an average of 5.5 penalties per game and a standard deviation of 4.4. That 19 penalty game is well outside 2 standard deviations from the average (5.5 + 4.4 + 4.4 = 14.3) and will be a good game to include in our group of outliers.

Excluding that 19-penalty game, Texas' average dropped down to 4.4 penalties per game and a standard deviation of 1.8, a significant drop for both. Just to make sure we don't miss any other potentially good outliers, we can perform the 2 standard deviation test again using these new numbers. If we do, we see that that game when they had 9 penalties is also more than 2 standard deviations away from the adjusted average (4.4 + 1.8 + 1.8 = 8.0), so it's probably a good one to look at too. Not as good as the 19-penalty game, but still good. (Incidentally, that Texas example was a real stat - those are the Longhorn's penalties per game in 2006. What's unique about that 19 penalty game is that it's the only instance since 1999 of a team's number of penalties being more than 3 standard deviations away from it's average.)

Finding and grouping these outlier games will give us the chance to examine them more thoroughly to see what, if anything, they have in common. Why did Texas have 19 penalties in one game when they had under 10 the rest of the season? I don't think we'll be able to definitively say, but that's one of the questions we're going to be asking.

So let's look at what we've got so far. Again, we're looking at 2000-2008, which means 6,761 games. Two teams per game gives us 13,522 team-games, and if we're looking at just the most extreme cases of teams committing far more or far fewer penalties than they normally do, we end up with 725 team-games to look at. So again, we're dealing with the top 5% here. Another good thing is that we have every single D1-A team represented, averaging around 6 team-games each. Of those 725 games, 533 (nearly 75% of them) were instances in which a team was penalized more than their average, while just 172 of them were instances of a team penalized less than their average.

One of the first places we can look for signs of irregularities is in home-field advantage. We know there is one in general, (this year it's hovering at about 65%), but is there one with penalties? Just for clarity's sake, the 725 games we're focusing on we'll call the outliers, and the others we'll call the averages.

Home / Away Penalties & Yards
category games avg penalties avg pen yards more penalties more %
Home (averages) 6,029 6.3 53.8 2,362 40.1%
Away (averages) 6,059 6.6 54.6 2,855 48.5%
Home (outliers) 356 9.3 87.9 243 49.2%
Away (outliers) 326 9.9 85.7 238 48.2%

Hmmm... it doesn't appear that there's any significant difference. The home team has a slight edge in the first few columns, but nothing irregular. Something notable is that in the average games, the home team usually takes less penalties, taking more than their visitor just 40.1% of the time. However, when we're looking at the outliers, the home team takes more penalties a higher percentage of the time, 49.2% to 48.2%. This could be due to the fact that in the average population there's more visiting team-games and in the outliers there's more home team-games, but the difference is pretty small. Overall, there doesn't seem to be much evidence here for the home team having a significant edge penalty-wise.

Let's look at something else. What about any advantage given to the higher-ranked team?

Penalties & AP Rankings
category All Games Average Games Outlier Games
neither team ranked 5,596 5,286 310
same # of penalties 1,460 1,425 35
higher ranked, more penalties 3,372 3,157 215
higher more % 52.2% 51.9% 56.6%
higher ranked, less penalties 3,088 2,923 165
higher less % 47.8% 48.1% 43.4%

Well, if anything it seems that overall, the higher ranked team usually takes more penalties, and that's especially the case in the outliers. Interesting.

And that's where I'm going to stop.

Why? For a lot of different reasons. First, I'm sure you noticed that in a way, this exercise is much like trying to prove a negative. We're looking for evidence of irregularities in penalties & games, but not finding any evidence of them isn't going to convince people that bias doesn't exist. We're not going to be able to prove they're not there no matter what we do. The two categories I did look at, home-field advantage and higher-ranked advantage, are the two places where I think most people believe we would be likely to find irregularities, if there were any. We could try other categories into infinity and still not be able to prove a bias doesn't exist. In addition, not finding bias in any particular category doesn't mean that it can't or won't be found in individual games. On the other hand though, good luck proving it.

With all that said, I fully believe that there are no conspiracies afoot to call games certain ways for certain teams, that the refs are not biased, and that the fix is not in in any way whatsoever. Honestly, that's just a bunch of junk people make up to make themselves feel better about losing. Have the SEC referees botched some high-profile calls this past month? Sure. But you know who probably feels worse about it than anyone? Those SEC referees.

Think about this realistically for a second. You don't get to the level they're at without having a huge amount of respect for the game in general. No matter what school they went to or which team they personally root for, I guarantee that every college referee has more respect for the game that overrides those personal ties by far. Do you set out in the morning intentionally trying to be bad at what you do? Probably not, and you probably wouldn't get far if you did. I'm pretty firm in my belief that refs give 100% every game and try to be as impartial and fair as possible, partly because it doesn't make sense for them to be otherwise.

Do they get a call wrong every now and then? Sure. But a lot of those can easily be avoided with the use of instant replay. Sure, some calls are subjective, like holding or interference. The referees have training and years of experience calling those plays - as long as they're consistent, I see no reason not to trust them and defer to their judgment in those cases. For situations like the Georgia-LSU celebration penalties, I think the refs are handcuffed by overbearing rules that are trying to damper down the spirit of competition.

But for the non-subjective determinations, like going out-of-bounds or the ball hitting the ground on an attempted shoe-string catch, use instant replay. Get a donor to give your school money for some LCD high-def TV's, put them in the booth, and use them. Talk to the networks and make them put cameras in more strategic locations so that you can give the guys in the booth the best angles to see the plays - shoot them down the sidelines and endzones, if nothing else. The college game gets it right by reviewing every play. (The NFL knows that would lengthen their games past the mandated 3 hours, so fairness has to take a back seat.) Do whatever it takes to get the call right. I don't want to hear any crap about the refs being human or bad calls being a part of the game. For subjective calls, fine - I can accept that. But with so much riding on games nowadays, the NCAA, conferences, and schools need to be doing all they can to make sure that the black & white calls are correct. Fans won't care if it adds an extra 15 minutes to the games, or if a booth review takes a while. Just Get. The Call. Right. They'll care a whole lot more if you get the call wrong, trust me. Those are things that people besides the refs can fix, so if anything you should be just as pissed at them for letting these things slide.

So where do all of these numbers and all of this ranting leave us? Well, the idea has been bandied about that we need a national refereeing corps that aren't affiliated with any one conferences. Would that help? Well, it would certainly help with the (I believe incorrect) perception that the refs call the games for certain teams. Sure - do it. Starting to fix some of the technological and non-subjective flaws would certainly help too. But for god's sake, can we stop with all the conspiracy bullshit? Until you've walked in the refs' shoes, how about cutting them a little slack. I'm sure a simple "thank you for the 99.9% of the calls that you get right" wouldn't hurt either.

No comments: