Time for more scrutiny of rugby referees

By The Crowd / Roar Guru

Stu Dickinson’s performance on the weekend has me asking an obvious question: why is the performance of a referee not assessed more systematically? Why not put an end to the kangaroo court and make public accountability official?

Firstly, I do not want this thread to be about Dickinson.

His performance was below par but certainly not a statistical outlier – all referees, like all players have bad days. Nor do I set out to bash referees.

In general, I think they do a tremendous service to the game – they love their rugby and are as integral to its success as chalk on the goal-line.

When a referee does put in a bad performance, instead of bloiating like Alan Jones on a climate change rant, we should instead take the opportunity to have an open and frank conversation about referees.

We should ask two simple questions: what do we expect in terms of performance and accountability and how should it be implemented? Referees would of course be entitled to ask: how much extra are you going to pay me?

Here are my thoughts to get the conversation started:

As is currently the case with many other professions, referees should have their performance measured qualitatively and statistically in an open and transparent manner.

Each week, a panel of referees, coaches, players and spectators (club members perhaps) should watch the tapes from games and evaluate the referee based upon a set of predetermined questions. Some would be quantitative, like missed/wrong penalties, forward passes etc.

Others would be more subjective and qualitative, e.g. control and flow of the game, and so on. The combined results would be collated into a final score and a ranking.

The matrix of questions as well as the final outcome would be public but naturally the answers given by each participant would be secret. The ranking would be used to assist the IRB in assigning responsibilities to games.

Perhaps a system could be developed to assign relative importance to a match considering factors like bearing on the finals etc. The higher ranking referees would get the higher ranking matches and potentially more match payments to boot.

For players, this kind of evaluation is nothing new. I suspect those of us who have never seen the inside of modern, professional rugby teams would have our minds boggled at the sophistication of performance monitoring. This technology and methodology is no doubt used to plan the undoing of other teams and – not doubt referees.

Richie McCaw has admitted to ‘getting to know his referee’ and adjusting his game to suit. No doubt he would give his own starring role in Sunday’s controversies a big cross mark even if his devoted fans do not see it that way.

If referees are an important part of the game – which surely they are – more sophistication should be applied to developing and measuring their professionalism.

As spectators, we should expect and demand the highest level of performance from our referees and reward those who deliver accordingly.

The Crowd Says:

2011-06-02T13:18:44+00:00

Bakkies

Guest


The IRB refereeing needs a big tidy up. Paddy O'Brien has served his tenure time to move on. It's difficult to get any impartiality with O'Brien and the laws have changed a lot under his watch. Time for stablity get someone like Alan Lewis, Joel Jutge or Chris White in charge and mentoring the young refs. Some countries need to pull their weight with the refs. I know some of the younger refs have gone through a lot of law changes and procedures. One ref who clearly struggles with constant change is young Welsh ref James Jones ever see him ref a Magners League match for the first half he would be refereeing to 2009 interpretations and in the second half he would go to the current ones. An up and coming ref Paul Marks was banished because of one mistake it was a big one but he should get more time to improve where as experienced guys like Kaplan make a lot of mistakes and still get games. The RWC appointments were bizarre too with Kaplan picked ahead of in form Mark Lawrence. Walsh was picked but he has problems with fitness and he is a kiwi refereeing for the ARU.

2011-06-02T00:42:26+00:00

PeterK

Roar Guru


very good. Yes an invisible ref who allows the kiwi teams to get away with illegalities so that the game can flow, who cares about fair.

2011-06-01T22:54:06+00:00

arbitro storico

Guest


ABF - your comment that he failed to manage the game according to the rules is simply wrong. I accept that this is your opinion, but with the greatest respect, your opinion - and mine - doesn't count. The fact is that Dickinson refereed the game very well, in the opinion of a selection committee made up of an ex-RS14 coach, and ex-referees who between them have controlled over 100 tests and over 1000 other first class matches. Taken as a group, they provide an unbiased, objective lens through which to judge every referee's performance. Of course Dickinson made mistakes - not many as it turns out - and you rightly point out the knock-on, but that hardly warrants an inflammatory judgement that he "failed abysmally". The Crusaders have been refereed by Dickinson since the franchise was born - that's right; for 16 years. Believe me when I say that he's been ranked at or near the top of the pile by players and coaches for more than a decade of that time. The only issue you raise with any substance is that some of his decisions were "controversial". So what? Decisions made by referees are often "controversial". Controversial does not equal wrong. This goes to the tired fallacy you express at the end - that a good ref is an invisible one. Wrong; a good ref is one who knows that he must come in to the game to ensure that it is played fairly and in the spirit. The selectors knew that this was the case with Dickinson's performance last week.

2011-06-01T22:08:51+00:00

Bakkies

Guest


Another type are Richie McCaw's lapdogs

2011-06-01T14:10:17+00:00

allblackfan

Guest


He failed in one very basic, and very important, criteria. He failed to manage the game according to the rules. The rules clearly state that if an attacking team commits an infringement (ie knock the ball on, forward pass, etc) then they cannot accrue any advantage from said infringement. He failed abysmally in that regard hence the criticism. The Crusaders have lost other games, I had no qualm with the refereeing. In any case, half the players on the field on Sunday were NOT happy with his officiating so that causes problems according to your analysis. And what kind of corrosive effect would the standard of refereeing have on the tournament in regards to players, fans and TV viewers if Sunday's performance was to become commonplace? If I knew there was going to be more games with more controversial refeering decisions, I'd watch AFL (they have no knock-ons and no forward passes!!) Referees should strive for excellence, just like players. The accepted mantra of rugby refereeing is ``A good ref is an invisible one!" Dickinson was by no means an invisible ref on Sunday.

2011-06-01T10:46:39+00:00

arbitro storico

Guest


It wasn't Dickinson, it was Erikson. In 1999. England scored a hundred, and the referee sent off a Tongan prop for king-hitting someone. Hard to see how the ref had much to do with it that day - there was nearly 50 minutes of ball-in-play time; unheard of then, and rare even today.

2011-06-01T10:09:38+00:00

sledgeandhammer

Guest


Dickinson's worst ever game was England vs Tonga in the world cup in England (can't remember the year).

2011-06-01T04:35:45+00:00

LukeR

Guest


Thanks for that info about the current process - you're right, I hadn't considered that it was so robust. However, I still feeel that there would be merit in opening up the process somewhat. To involve a cross section of players and spectators - who would be chosen to review a match based upon their relative impartiality - would make it more than an exercise in peer review. I'm certainly not talking about a simple "popularity" contest. We rely on juries of ordinary punters to decide mureder trials, surely there is something to be said for having some "public" accountability for referees. At the very least, the process you described above should be more transparent.

2011-05-31T23:45:22+00:00

Tight Five

Guest


There are two types of referee the ones that ref with a police mentality and the one that refs with a facilitative style. The police mentality looks for infrinegments in everything and if in doubt blows the whistle the facilitator looks to keep the game flowing and if in doubt on a 50-/50 call lets the game go. For the sake of rugby as a spectacle the faclitator mentality needs to be fostered as in 99% of break downs something can be found to blow the whistle with. In junor rugby we need more refs to speak with the players and warn before blowing as the last option, too many refrees are blowing the whistle as their first option and the p[layers and spectators are left scratching their heads. Like players refs need regular coaching, i think each team coach and or captain should give referees a rating for each facet of their game to allow the referee to improve with direct feedback.

2011-05-31T22:30:58+00:00

PeterK

Roar Guru


I agree. The suggestion put forward has major flaws in that the majority of the panel dont actually know the law book so how can they judge correct / incorrect decisions. Also they are not impartial especially fans. Like you I am aware of the detailed assessment of each referee. What I would like and what was suggested is more transparency. I believe some of the results against the assessment measures per game shoud be released to the public, more tranparency would be useful.

2011-05-31T21:45:21+00:00

arbitro storico

Guest


Sorry Luke - this post is based on a very naive understanding of what actually already happens in the assessment of referee performance. In the RS15 every referee's performance is assessed by one of the SANZAR selectors allocated specific responsibility as "lead" assesor for that match. In a weekly conference, each "lead" man's view is challenged by the other selectors who have watched the game, and a consensus decision is made about that referee's performance. At all times, the basis of the assessment is how the referee measures up to benchmarks in (broadly speaking) set piece management, breakdown management, advantage, communication, conflict management. In 2011, a special focus on the "big 5" areas of the game was agreed after significant consultation with the administration, playng and coaching sections of the RS15 community. This is an efficient and effective assessment regime, and more than enough scrutiny. What it is not - and I suspect that this is the basis of your criticism - is an open-to-all process. It never will be, and neither should it be. In a professional game, referee performance assessment is not a popularity or beauty contest, or a Dancing with the Stars-like opportunity to vote someone off, for goodness sake. If the people who run, play and coach the tournament are happy with the referee assessment process they have constructed and constantly review, surely that's good enough. Imagine for a moment the corrosive effect on the tournament that the wrong-headed and inaccurate criticism of Dickinson's performance by the viewing public would have if there were such a public opinion driven system in place. Being a referee is about doing what's right, not what's popular, and Dickinson's performance last weekend, by all the objective and subjective methods in place, was a very good one, whether the public agrees or not.

Read more at The Roar