Blind Tasting and Bayes' Theorem

Critics and wine gurus often recommend blind tasting as the best way to train one's palate. In addition, the major critics (Parker, Wine Spectator, Tanzer) taste blind to reassure us of their unwavering objectivity. However objectivity is not always the same as accuracy (for more on this, see an article by Eric Asimov), and it is not at all clear to me why blind tasting is a useful form of training. Here I will cast the act of blind tasting into a Bayesian decision model, and discuss possible implications.

First, I want to be clear on this point: I am not discussing the act of blind tasting with intent to subjectively evaluate. If your goal is to identify which wines give you most pleasure to drink, taste them as you drink them. If you drink them blind, taste them blind - otherwise, don't bother. Here I am concerned with the act of blind tasting to determine objective truths about the wine. I am taking the objectivity of tastes and tasting for granted. (For a discussion of this assumption, see Barry Smith's article in the book, Questions of Taste)

Given a set of objective statements A, and a set of observations B, we can consider the act of blind tasting as the informed decision whether to believe statements in A based on which observations in B we percieve. In sparser, mathematical terms, A and B are two disjunct sets of events. By Bayes' Theorem, the conditional probability of an event A (in the set A) given an observation B (in the set B), can be calculated by:

P(AB) = P(BA) * P(A) / P(B)

Where P(B) and P(A) are the a priori probabilities of A and B, and P(BA) is the conditional probability of B, given A. This equation articulates the truism that in order to assign a conditional probability of A based on information about B, you have to allow a non-zero probability for A in the first place. For example: to conclude that the wine has Shiraz characteristics, all the Shiraz smells in the world are insufficient if we do not first allow for the possibility that the wine contains Shiraz. The strength of our decision depends on the specificity and accuracy of our knowledge of each of the three terms on the right-hand side of the equation. Why then would would we choose to taste blind, and eliminate some of this information?

By tasting blind we aim to weaken our ability to determine P(A), and so we unconsciously "retreat" toward the default of least information: that all A's are equally possible. For example: not knowing the varietal, we would hopefully consider all varietals equally. In reality, we fail: naturally we expect Cabernet, Merlot, Chardonnay, and Riesling more that Duras, Gruner Veltliner, or Xarrello.

By reducing the distinguishing power of the set of P(A)'s, we tilt the equation to depend primarily on P(BA), which is directly derived from experience, and on P(B) - i.e. how unique our observation is. Naturally this reduces the strength of the decision, which is a mathematical reflection on our increased uncertainty when blind tasting. Unconsciously we try to compensate by seizing any scrap of information to make a particular P(A) stand out.

Mathematically, tasting blind reduces the precision of our decision-making (or to be slightly more correct, makes for a less favorable precision-recall curve). However it quite possibly increases our accuracy. If we wine tasters have a shared tendency to exaggerate unwarranted differences in P(A), blind tasting would improve our accuracy. As Emile Peynaud cautioned bluntly in his famous book, Le Gout de Vin (The Taste of Wine), "the wine taster is easily influenced."

However Bayes' equation makes the importance of P(BA) absolutely clear: tasting blind will only improve your ability to objectively analyze, if you possess accurate knowledge of the reverse probabilities. An example of this type of knowledge might be: "9 out of 10 Gewurztraminers have the taste of lychees." Note the distinction between this and P(AB): "9 out of 10 wines with the taste of lychees are made from Gewurztraminer." This type of knowledge only comes from experience. Tasting only a few Gewurztraminers is statistically insignificant, and thus for a wine novice, tasting blind is rather useless as a tool to improve accuracy. Instead, taste with prior knowledge of what the wine should taste like, and see how well your perceptions match up. As the esteemed Vayniac Joe G. wrote:

Once you can give an accurate tasting note of what a bottle should taste like from a region without tasting it, that is when blind tasting can be educational.
- WLTV forum discussion

It's like Jazz, folks. You gotta learn the notes before you improvise.

(Note: Thanks to all the Vayniacs who helped me crystallize my thoughts in the forum discussion of this topic.)
... Read more.

The Chateau d'Yquem of beers?

First a brief profile of my palate when it comes to beer. I am a hop-head. Some of my favorite brews are Stone's Ruination, IPA, and Arrogant Bastard. I'm no fan of sweetness (in wine or beer), which is what keeps me from listing Dogfish Head's 90-minute IPA among my favorites, despite its beautiful aromatic complexity. I see beers as relaxing entertainment, with their clear-cut, bold, easy-to-identify aromas. When I'm looking for something serious, I go for the vino.

Last Saturday I popped a beer I'd been keeping for some time, the Dogfish Head 120-Minute IPA. I was expecting an extremely hoppy, bitter brew, with more malt than suits my preference (from experience with Dogfish Head). Instead, I discovered a viscous, intense, fiery liquid that cannot be said to remotely resemble beer.

AROMATICS: This is when I knew it was going to be good, or at least interesting. Layers of caramel, wood, smoke, malt ovaltine, coffee, and the interior of a Pan de Coco (a Filipino bread). Also some dried oranges and apple cider (dried oranges in apple cider? That's how we do it at home). You can dive into this nose, layer by layer, and never come out of the bright, intense kaleidoscope of flavors. Don't get me wrong - this is nothing like a good wine. It is not subtle. The non-fruit flavors are many orders of magnitude more pronounced. But there is fruit, and it is WILD. Hints of lanzones.

FLAVOR PROFILE: Sweeeeeeet. Unctuous. Jammy. Honeyed. Syrupy. Luscious. So sweet, it osmotically burns your mucus membranes. We're talking dessert wine levels. Smoky caramel, spicy orange (even some acidity, unusual for a beer). Fine bubbles. Powerful hops finish that isn't naked like Stone's Ruination, but intermingled with layers of fruit and caramel. Holy $#!T this is good! A little lemon on the finish, along with figs, dates, and the top of a nice creme brulee. Explosive and creamy on the midpalate. The hops bear a striking resemblence to the liquor bitterness in creme brulee! The finish lasts years. Ok I exaggerate. Months. The finish lasts forever. The hops stay, the caramel stays, the orange and spice stays. At least 2 minutes on the finish.

PILLOW: One of the things I like to do when tasting beer is emulsify with air, like I would wine, and observe the "pillow" that fluffs up in the mouth. I've had some good pillows - Arrogant Bastard stands out in particular. This left them all behind. I didn't feel like a big pillow appeared in my mouth - I felt like I physically landed in a HUGE pillow. You could jump off the Empire State Building and land safely in this pillow.


This is indulgence. This is someone giving you a massage all day long. This is off the charts. If I found a 400-year-old Sauternes made by a crazed vintner and hopped like mad - this is what I might expect.

I'm no fan of dessert wines, but this dessert beer won me over completely. It blew the 2001 Filhot (Sauternes) and the 2005 Tablas Creek Vin de Paille out of the water. I recommend having it by itself as dessert - shared with two other friends as it's too sweet to finish on your own. Serve it very chilled and the nose will still be explosive. Too warm and the alcohol tears through, ripping it apart.

Warning: At $10/12 oz, 20% ABV (no that's not a typo), and 120 IBU's (International Bitter Units) this is not for everyone. Dogfish Head makes this only very rarely. If you see it in a store, buy it. It will age for many years.


(Note: Tasted a second time on 3/16/08 with consistent, if less detailed, notes!)

... Read more.