1 Wine Dude
The Journal of Wine Economics has just published a study authored by Robert T. Hodgson titled An Examination of Judge Reliability at a major U.S. Wine Competition. The reported findings should make the fodder for about 10,000 wine blog articles over the next few weeks.
The study tracked the ability of wine competition judges to replicate the scores that they gave to wines (during blind tasting competition) at the California State Fair. The study found that (emphasis is mine):
…judges were perfectly consistent… about 18 percent of the time. However, this usually occurred for wines that were rejected. That is, when the judges were very consistent, it was often for wines that they did not like…
Let the blood-letting commence!
I fear that the media will take hold of this and start to sound the death knell for the ability of so-called experts to taste and rate wines (again), or use it to shake up an already arguably unfavorable view that wine appreciation and competition is the height of snobbery.
Neither are true, and this study does little to bolster either point. Why? Because wine tasting is, at its heart, heart a subjective exercise.
The study is clear on its intentions, which was not to shake up the world of wine competition, but to “provide a measure of a wine judge’s ability to consistently evaluate replicate samples of an identical wine. With such a measure in hand, it should be possible to evaluate the quality of future wine competitions using consistency as well as concordance with the goal to continually improve reliability and to track improvements associated with procedural changes…”
To understand why this study doesn’t ring so true with me, I need to give you a little detail on the mechanics of the study:
When possible, triplicate samples of all four wines were served in the second flight of the day randomly interspersed among the 30 wines. A typical day’s work involves four to six flights, about 150 wines… The judges first mark the wine’s score independently, and their scores are recorded by the panel’s secretary. Afterward the judges discuss the wine. Based on the discussion, some judges modify their initial score; others do not. For this study, only the first, independent score is used to analyze an individual judge’s consistency in scoring wines.
In summary: the judges weren’t consistent when faced with tasting hundreds of wines in a day, and there revised scores (based on panel discussion – which can have a huge impact on how you would evaluate a wine) weren’t used.
If the study proves anything, I think shows that trying to judge hundreds of wines in a day is a first-class non-stop ticket to palate fatigue, even for experienced wine judges.
Now that I think about it, blind tasting is so notoriously difficult that I give the judges in this study credit for being consistent almost 20% of the time. That would be a respectable hitting percentage in baseball (not sure… I don’t follow baseball actually)…
While the media may latch onto this one, the study hinted that there is some modicum of possible salvation for the madness surrounding wine competitions in general – not by way of wine judges, but by way of the ultimate judges of wine: the Consumer.
…a recent article in Wine Business Monthly (Thach, 2008) conducted as a joint
effort by 10 global universities with specialties in wine business and marketing found that consumers are not particularly motivated by medals when purchasing wine in retail stores. If consumer confidence is to be improved, managers of wine competitions would be well advised to validate their recommendations with quantitative standards.
Interesting conclusion. And a hopeful one.
(images: legaljuice.com, wine-economics.org)
After visiting both Opus One and Penns Woods Winery, located on the Left and Right Coasts, respectively, I thought it would be interesting to host a blind tasting between the 2005 vintages of both winery’s Bordeaux-style red blends.
What would a clash of the titans like this prove?
Not much, it turns out, but it was an enlightening experience, and one that you will want to read if you appreciate differing styles of fine wines, and are interested in a bit of a litmus test on how far wines from both coasts of America have come…
Or, if you want to read the extremely geeky musings of two wine dorks.
Anyway, for this blind tasting, I was reunited with my 2WineDudes partner in crime, Jason Whiteside, who was in town taking a few of his exams for the WSET Diploma in Wine & Spirits. The wines (hereby referred to as Wine 1 and Wine 2, until such time as their true identity is revealed) were decanted a few hours before our tasting, and neither Jason nor I knew which wine was poured into which decanter. Both wines were then poured into separate (but identical) Riedel wine glasses.
Following is the uber-geeky tasting play-by-play:
There you have it. East Coast meets West Coast turns out to be more like Old World Italy meets New World California. Who’da thunk it?
Which means that the same number of you have probably encountered at least one severely drunken patron acting in a totally obnoxious way.
Which also means that the same number of you understand the phrase “suppressed the urge to do bodily harm.”
Now, I am fully aware that wine tasting room etiquette is not a novel topic, and has been covered before by several sources, including wineries themselves. Most of these sources talk about how to prepare yourself for a tasting room visit (no perfume, chewing gum, etc.) and how to taste the wine while you’re there (swirl, sniff, sip, savor, etc.).
Knowing me, it will come off as a bit of a rant, but it’s not meant to be a rant (and it’s not directed at you, dear reader – it’s directed at the small minority of wine tasting room visitors who just still don’t seem to “get it”).
And it’s a simple plea, really…
If you plan to get totally hammered on wine, and you happen to also be an obnoxious drunk, please don’t go to a winery tasting room.
By providing a tasting room, a winery is primarily trying to teach you about – and to sell you – their wine. They are not providing a place for you to drink yourself stupid, get loud, and ignore the winery staff. There are places where you can do that (within reason) – they’re called bars.
I’m not saying that you shouldn’t plan to have a great time when visiting a winery tasting room, and I’m not even saying that you should stay sober when you visit a winery tasting room (assuming you have arranged transportation, of course).
I’m just saying that you need to stay sober enough – enough to retain adequate coherence so that you can take advantage of the winery staff’s knowledge, ask them questions and engage them in conversation about their wines, and remain civil and reasonably polite to your fellow patrons.
I am saying that if you plan to get smashed and act in any way that you want when you hop on a winery tasting tour or visit a winery tasting room, then you need to stay home instead – because you’re not respecting the wine, the winery, or the the winery’s patrons.
And I don’t think that’s asking for too much.
Thus endeth Dude’s diatribe.
(images: rockstarsmommy.blogspot.com, pleasanthillwinemerchants.com, woodbridgeliving.com)