Volcanic Wine Awards | 25th anniversary events | The Jancis Robinson Story

Correlating scores and the scorers

Tuesday 18 August 2015 • 5 min read
Image

Fine-wine merchant Joss Fowler comes off the fence on the question of scoring wines. See also his earlier articles on What Bordeaux did for Barolo and Brunello and The pallet of Le Pin

After last year's great claret tasting at the little seaside town of Southwold on the UK's Suffolk coast (pictured), I came away armed with a very serious spreadsheet: the one with the scores on. Not just mine, everyone’s. There is an omertà about these and the document is not one for sharing: I could show it to you but I’d have to kill you or, at least, give up my spot on this quite brilliant panel of tasters. Not my plan. 

Who can taste and who can’t is a conversation that every wine merchant has on a fairly regular basis. The object could be a colleague, a critic, a competitor. Colleagues are generally first into the sights, as you taste with them, and the best tasters are often useful as a sounding board on a wine that you either just ‘don’t get’ (I always used to struggle with Palmer from barrel, for example) or one that has totally seduced you (is that wine really as good as I think it is?).

The critics come next, largely for commercial reasons: Mr Parker’s palate has been called into question recently over his latest appraisal of the 2005 Bordeaux vintage, largely by those who would have profited from higher scores. Conversely, other critics are derided in private for throwing high scores at pretty much anything while, at the same time, those high scores can come in handy if you have access to the wine in question.

The answer to the ‘Can he or she actually taste?’ question is generally arrived at by experience, particularly with colleagues. You can soon work out that Colleague X knows what he is doing even if he does have an almost embarrassing weakness for barrel gloss. Colleague Y is the opposite: an excellent judge of quality, though he is rather turned off by the merest hint of fruit in his claret. And colleague Z: how on earth has he got this far when he couldn’t taste the difference between tea and coffee?

With the critics and the writers it’s trickier. It’s mostly a question of comparing notes and scores. Critics A, B and C say 95 points, Critic D says 89, and I say 95, for example. But this is flawed unless the experience – principally the surroundings – is the same: it is very, very hard not to like a wine when it is being shown, direct from the barrel, by a charming host whereas it is much easier to find faults with a wine when tasting in more academic surroundings. I think it fair to say that most tasters at Southwold lean toward the miserly in their scores, partly on account of the academic surroundings, partly on account of healthy egos. [I’d second the miserly bit – JR]

At Southwold, tasting a few hundred wines blind in a closed room of 20 tasters soon separates the men from the boys and, with scores called out at the end of each flight, there is nowhere to hide. But the nature of the tasting and the panel is such that the cut has already been made in terms of onions and knowledge of them. One of the key pleasures, for me at least, is seeing what each of the group thinks about any particular wine. While it’s not about who is best, and putting one’s own judgement against them, there is an element of, if not competition, some sort of test.

I find that it is generally the old boys who know what they’re on about (this is not exclusive to wine tasting) and watching legends such as Steven Spurrier or Barry Phillips [of Four Walls Wine] make their calls is a sight and a sound to behold. Observing those whose palates one has worked with or tasted with before is equally interesting, as is the examination of those with reputation.

Armed with the numbers, though, you can go a step further. Correlation. I know that my friend Stephen Browett [Farr Vintners] likes the same beer as I do (light, hoppy) and I know what sort of wine he likes (claret, posh, preferably from a ripe vintage), but do our palates correlate in terms of our judgement of quality? I now have an answer. Having removed the names (I take this omertà seriously), I pass the spreadie to someone much, much, cleverer than I am. He does some stuff to it and sends it back. I can now see how the palates of the tasting group correlate.

There are two key bits of knowledge here. Firstly: I get some individual answers. For example, on 2010 Bordeaux, my palate and that of Mr Browett correlate to a degree of 0.61, which isn’t bad. With Jancis the figure is 0.63: even better (though Stephen and Jancis correlate by 0.54, not quite as good).

The second bit is a little more interesting. What these figures also show is the palate that is most in tune with the rest of the group (ie the palate that is most closely correlated with the others). Looking at this from the point of view of a statistician, that palate is the leader, the one that knows best. It also shows any potential renegade, the palate that the statistician would discount. This is what my clever friend explains to me – and this is where it starts to fall down.

The merits or otherwise of summing up a wine and its quality with a number have been much-discussed. I’ve written about it countless times, though without ever coming off the fence: I admire the ability to do it correctly as much as I admire the refusal to do it. And my little exercise on correlation is little more than gloating sophistry: it’s scoring in reverse, scoring the tasters – giving their palates a number rather than a description. What I want from anyone in terms of wine advice or discussion is description, not numbers. And – exactly as I want in any wine – I want character.

The lead taster, the one who happens to be most in tune with the rest of the group, happens to be someone that I admire from afar, someone that I would automatically describe as ‘knowing his kit’. The rogue? Impeccably qualified, with a reputation for irritating all-round brilliance. Moreover, he is someone with a gift for description, someone who can capture in his words a trait or character in a wine that most could not.

The simple fact is that, while some of us are seduced by a bit of what I call barrel gloss, others detest it. Some love the regal austerity of old-fashioned claret while others bemoan the lack of fruit in the same wine. And some – like me – appreciate a bit of make up in the right wine though not all of the time.

So simply looking at a score without the note, without the description, is totally flawed. Because a number, if it is to be the only way of quantifying quality, has to be totally objective. And total objectivity in tasting is impossible. Which is why you simply can’t do this wine thing by numbers.

For other articles on the subject of scoring wine, click on the tag at the top of the article.

选择方案
会员
$135
/year
每年节省超过15%
适合葡萄酒爱好者
  • 存取 289,030 条葡萄酒点评 & 15,887 篇文章
  • 存取《牛津葡萄酒指南》《世界葡萄酒地图集》
核心会员
$249
/year
 
适合收藏家
  • 存取 289,030 条葡萄酒点评 & 15,887 篇文章
  • 存取《牛津葡萄酒指南》《世界葡萄酒地图集》
  • 提前 48 小时获取最新葡萄酒点评与文章
专业版
$299
/year
供个人葡萄酒专业人士使用
  • 存取 289,030 条葡萄酒点评 & 15,887 篇文章
  • 存取《牛津葡萄酒指南》《世界葡萄酒地图集》
  • 提前 48 小时获取最新葡萄酒点评与文章
  • 可将最多 25 条葡萄酒点评与评分 用于市场宣传(商业用途)
商务版
$399
/year
供葡萄酒行业企业使用
  • 存取 289,030 条葡萄酒点评 & 15,887 篇文章
  • 存取《牛津葡萄酒指南》《世界葡萄酒地图集》
  • 提前 48 小时获取最新葡萄酒点评与文章
  • 可将最多 250 条葡萄酒点评与评分 用于市场宣传(商业用途)
Pay with
Visa logo Mastercard logo American Express logo Logo for more payment options
Join our newsletter

Get the latest from Jancis and her team of leading wine experts.

By subscribing you agree with our Privacy Policy and provide consent to receive updates from our company.

More Free for all

White wine grapes from Shutterstock
Free for all 在较为奇特的葡萄品种中备受青睐的选择。本文的简化版本,推荐较少,由金融时报 发表。 与甚至仅仅10年前相比...
Kim Chalmers
Free for all 维多利亚州查尔默斯酒庄 (Chalmers Wine) 和查尔默斯苗圃 (Chalmers Nursery) 的 金·查尔默斯 (Kim...
J&B Burgundy tasting at the IOD in Jan 2026
Free for all 在伦敦勃艮第周之后,如何看待这个特殊的年份?毫无疑问,产量很小。而且也不算完美成型。本文的一个版本由金融时报 发表。请参阅...
Australian wine tanks and grapevines
Free for all 世界上充斥着无人问津的葡萄酒。本文的一个版本由金融时报 发表。上图为南澳大利亚的葡萄酒储罐群。 读到关于 当前威士忌过剩...

More from JancisRobinson.com

Otto the dog standing on a snow-covered slope in Portugal's Douro, and the Wine news in 5 logo
Wine news in 5 此外,潮湿天气使加利福尼亚25年来首次摆脱干旱,并在杜罗河谷的葡萄园留下积雪——这让保罗·西明顿 (Paul Symington) 的狗奥托...
Stéphane, José and Vanessa Ferreira of Quinta do Pôpa
Wines of the week 如果说有一个国家在性价比葡萄酒方面表现出色,那一定是葡萄牙。这又是一款支持这一理论的葡萄酒。价格从 7欧元,11.29美元, 20英镑起...
Benoit and Emilie of Etienne Sauzet
Tasting articles 这是第 13 篇也是最后一篇进行中品鉴文章。有关此年份的更多信息,请参阅 勃艮第 2024 年份 – 我们的报道指南。 索迈兹...
Simon Rollin
Tasting articles 这是第 12 篇也是倒数第二篇进行中品鉴文章。有关这个年份的更多信息,请参阅 勃艮第 2024 年份 – 我们的报道指南。 夸尔酒庄...
Iceland snowy scene
Inside information 本月的冒险之旅中,本 (Ben) 前往北方的丹麦、瑞典和挪威。 我们抵达了一个国家,那里的北欧棱角被一层洁白的雪毯所柔化。蓝白色的...
Shaggy (Sylvain Pataille) and his dog Scoubidou
Tasting articles 13 篇进行中品鉴文章中的第 11 篇。有关此年份的更多信息,请参阅 勃艮第 2024 年份 – 我们的报道指南。 阿涅丝·帕凯酒庄...
Olivier Merlin
Tasting articles 13 篇进行中品鉴文章中的第 10 篇。有关此年份的更多信息,请参阅 勃艮第 2024 年份 – 我们的报道指南。 马真塔公爵酒庄...
Sébastien Caillat
Tasting articles 13 篇进行中品鉴文章中的第九篇。 皮埃尔·拉贝酒庄 (Pierre Labet)(博讷 (Beaune)) ...
Wine inspiration delivered directly to your inbox, weekly
Our weekly newsletter is free for all
By subscribing you're confirming that you agree with our Terms and Conditions.