Ep. 33 | Visual Data Disasters with Alberto Cairo
Some people believe that well-visualized data will tell you exactly what you need to know. But there are many more visual data disasters than we realize out there. This week Alberto Cairo shares several examples he has discovered from weather to politics where some people really like what they see – it’s just not what the data is actually saying. How can you avoid this kind of data disaster? What should you do to avoid becoming a victim of it? This week learn the process Alberto Cairo uses to help others think clearly about data and what it should represent. Please help me spread the word about Customer Centric analytics. Rate and review my podcast on iTunes and write to Allison at info@ambitiondata.com or ambitiondata.com. Thanks for listening! Tell a friend!
Podcast Links:
“There Are Many Ways to Map Election Results. We’ve Tried Most of Them.”
Election maps are telling you big lies about small things
Ihaka lectures 2018: Visual trumpery: How charts lie — and how they make us smarter
Talking About Data Visualization in Al Jazeera
Read Full Transcript
Allison Hartsoe – 00:01 – This is the Customer Equity Accelerator, a weekly show for marketing executives who need to accelerate the customer-centric thinking at digital maturity. I’m your host, Allison Hartsoe of Ambition Data. This show features innovative guests who share quick wins on how to improve your bottom line while creating happier, more valuable customers. Ready to accelerate? Let’s go!
Allison Hartsoe – 00:30 – Welcome everyone. Today’s show is about visual data disaster is specifically the many ways we misinterpret visual data. And to help me discuss this topic is Alberto Cairo. Alberto is the fascinating and frequently funny leader of the visual trumpery tour when he is not writing books or hosting workshops. He’s a professor at the University of Miami, specifically the Knight Chair of Visual Journalism. Alberto, welcome to the show.
Alberto Cairo – 01:02 – Hi. Thanks for having me.
Allison Hartsoe – 01:03 – Now, when I was getting my journalism degree, I can tell you visual journalism was not a specialty. I had the option to choose. So could you start by telling us a little bit more about your background and how you gravitated to this topic?
Alberto Cairo – 01:18 – Sure. It was. It was not an option when I studied journalism in Spain either 20 years ago. I’m originally from Spain, and I studied journalism there. Um, it all happened by happenstance. My original intent when studying journalism was to work in radio. I actually did internships in radio stations, the equivalent of NPR in Spain, reading the news in the morning, but at some point at the end of the fourth year of my BA, I believe I did, was a professor of mine, knew that I could draw a little bit. I’m not a great artist, but I can, I can sketch things out. And she knew these about me, and she got a request from a local newspaper in Spain that was looking for a journalism student who could act or don’t work as a reporter, but at the same time who also could have an eye for design.
Alberto Cairo – 02:12 – So she recommended me for that decision, and I was hired as an intern in that newspaper with no experience whatsoever in design. I knew I didn’t know anything about design at the time, but then I started working in these, in these team, in this group, and decided educating myself about the convergence or the overlap that exists between, um, let’s say traditional storytelling or storytelling and also visual storytelling and how the two of them reinforce each other, and I have been in this field ever since, until this until today.
Allison Hartsoe – 02:47 – And just not to, not to out your age or anything, but roughly what decade was that when your boss was asking you to do more visualization work?
Alberto Cairo – 02:58 – Oh, this was 20 years ago. I am 43. I began my career when I was 21 years ago. I began my career when I was 22.
Allison Hartsoe – 03:07 – Good. So from this point where you started to get much better, you bet you self-educated, and you started to understand more about the crossover between journalism and data. How did that lead to your eventual position as the knight chair at the University of Miami?
Alberto Cairo – 03:27 – Well, that was, again, it’s a very long story, but I wouldn’t try to make it short. So when I, when I started doing graphics to inform the public, I used to focus mostly on pictorial explanations. We used to call those infographics and then to use the streets. So imagine for example, that there is an accident happening, you know, in town and you do a visual explanation of how the, how the, how the accident happened, right. You’re drawing the cars, and you drove the truck just to explain how the accident happened. We call that on the infographic in the music industry. I prefer to call it pictorial or pictorial infographics. But then when I was like, I’m ten years in my career, like this happened around 2007. No, actually before that 2005, 2006, I started getting interested in, in graphs and maps and data charts and I started educating myself a little bit about cartography, learning about statistics and analytics, etcetera.
Alberto Cairo – 04:26 – I started reading a little bit about that and also practicing teaching myself the tools of the trade and I gravitated more towards this field a little bit later, around 2008, 2009. When I started writing my first book, the functional art and also the second one, the second one mostly eroded around 2011, 2012. The truthful art, which focuses exclusively on data visualization
Allison Hartsoe – 04:51 – and I should also call out that there is a website, I believe it’s the functionalart.com. Is that right?
Alberto Cairo – 04:57 – Yeah, that’s mine. That’s my personal web log, which is devoted to visual communication in general. I tend to focus a little bit more on data visualization, but I sometimes also write about pictorial visualization. Would you something that I still teach. I still teach people how to use, for example, three d modeling and animation to tell the stories. Right. But I focus most of my career at the moment, most of my teaching on data visualization, but I teach both data visualization and pictorial visualization.
Allison Hartsoe – 05:26 – Got It. So a lot of the folks who listen to this podcast have a background in marketing and marketing analytics, and there’s a big push about pretty pictures. Tell me maybe a little bit about why should I care about what is conveyed behind those pretty pictures, you know, maybe should I just be happy that I’ve created something that’s visually pleasing and that, you know, people are starting to talk about it. I’m starting to get an uptick on the work that I’ve done. Should I care that there be visual mischief in that infographic or in that visual presentation?
Alberto Cairo – 06:02 – Absolutely. So creating a beautiful picture, it’s a worthy goal. I’m not against it. I’m a fan of, you know, nice looking maps and charts and graphs, etcetera. Although I think that that is just one of the dimensions that need to be considered when we design a database conversation. In my second book, the truthful art, I say that I have any great graphic is made of at least five different elements or should pursue five or six different goals. And the first one is one of them is that it needs to be beautiful, right? So I would like a graphic. It’s always a beautiful object that you can look at in and enjoy. Right? That’s one of the components. One of the elements of a great graphic, but the first one in the list of a thing that we should pursue that any graphic shouldn’t be truthful and by minute, by, by the meaning of truthful in there, is that the graphic should reflect our best understanding of what the truth that hides behind the data are.
Alberto Cairo – 06:58 – It shouldn’t be the best representation of those stories that sometimes hide behind numbers and he said primary goal, so a beautiful graphic that is not truthful will never be a good graphic for a graphic to be good. First of all, they need to be truthful. It needs to be honest. It needs to be deep enough to to to show us the reality is that hide behind those numbers
Allison Hartsoe – 07:21 – and what are the other elements in those five?
Alberto Cairo – 07:23 – Oh, I, I talk about many of them. So I say that a graphic needs to be truthful. The second is that it needs to be beautiful to attract people’s attention. I also say that it needs to be functional in the sense that the way that we shape the data needs to depend on the messages that we want to communicate. And I devote a lot of pages in the book to explain, for example, how to decide whether you need to use a bar graph or a lunch or a data map, etc. So each one of those, a way of representing data is better suited for a particular goal. So sometimes, for example, when you have the example that I put it, one example that I put in the book and also explain to my students is that most beginners, uh, when, when, when the started doing that on a data visualization, and they are working with a data set that has a geographical component. Let’s say, for example, you know, a state level unemployment rate, they rush to the computer, and they design a map immediately just because the data set has a geographic component.
Alberto Cairo – 08:24 – And what I recommend people is, wait for a second, stop for a second. Think about the nature of the data. And more importantly, think about what it is that you want to communicate, right? Because if the purpose of the, of the chart or of the visualization that you are doing is to show geographic patterns in the data. More unemployment here, less unemployment over there, then the map is the right solution, but if the purpose of the graphic is not to show, the geographic patterns of the data, if the purpose of your graphic is to let people rank and compare the states in the United States according to unemployment rate, then the map is not functional for that purpose. You need to do some sort of bar chart, for example, to compare the different, the different unemployment rates, so that’s what I mean, but functionally it’s like the shape of the object. It’s like the flow form follows function, right? The ruling graphic design, although it’s much more complicated than that and I spend a lot of a lot of space in the books explaining these.
Alberto Cairo – 09:21 – It all boils down to that like the the the the the form of a graphic should somehow be constrained or be guided by the purposes of the function that, that graphic. Then I also say that our good graphic visualization needs to be insightful, meaning that it needs to provide interesting insights from the data. I need to reveal a pattern and trends that are relevant and then that may go unnoticed if you don’t visualize them. And as a result of all these, uh, great visualization can be enlightening. It may be, it may change your mind about a particular topic, right? You know, something about, about, about these data set, then you visualize it, and you learn something about the data, and in that sense, the data or the visualization of the data is enlightening you. So those kinds of five elements.
Allison Hartsoe – 10:12 – Now I actually had four elements as you were talking. Did I miss one? I got truthful.
Alberto Cairo – 10:17 – It’s truthful. I made, I made me to consulting, but I believe that he was truthful, beautiful, functional, insightful and enlightening. So those are, those are the five requirements.
Allison Hartsoe – 10:30 – Great. I love it. Okay. So, uh, tell us a little bit more about what is the problem now. You know, why the need for the visual trumpery tour and, and I got to ask you, you know, the name trumpery there. It seems like there’s a political angle in that. Can you, can you tell us a little bit about the tour that you have going on?
Alberto Cairo – 10:53 – Sure, sure. When I explained at the beginning of the visual trumpery talk is that the title of the talk is a provocation because a better title for the talk would be how charts lie or how or how visualizations mislead us. Right? The thing is that I, if I titled this talk, how charts lie that is not as attractive or as eye-catching as visual trumpery now visual trumpery the title comes from, from a moment of revelation that I had after the 2016 presidential election when I wasn’t on twitter following the results of the November election. And, uh, a person who I follow on social media and social media tweeted the meaning of the word trumpery because trumpery or It’s an actual word in the English language. You said you said an old word that comes from French. And, uh, trumpery is something that lives something that deceives.
Alberto Cairo – 11:53 – So I thought this is perfect because it will help me attract more bigger audiences and it will help me also mislead them a little bit and make my first point in the talk which is a chart or by extension any piece of information will always mislead you if you don’t pay attention to it. And if you don’t read beyond the headline, if you read the headline alone, visual trumpery, you may think, well this is a highly partisan talk. Right? But then you access the content, you see the actual content of the talk, and you will notice that the talk is as saving the topic itself. It’s very political, but it is not partisan. So I believe that using charts well, it’s a political issue in the sense that charts can inform public discourse or public conversations if they are well designed, but the talk is not partisan in the sense that I have examples both from the right from the left.
Allison Hartsoe – 12:49 – Let’s talk about some of those examples. And I just. I love the name of that tour. That’s fantastic. And I think I know a fair amount of unique words, but that was one I had not been familiar with. So thank you for adding to my lexicon there. So let’s talk about that political angle, the political party side around visual trumpery and obviously there’s such a, an interesting angle that could be played from both sides. What is it that the political parties are doing that is causing us to be, you know, perhaps misled or using the data incorrectly?
Alberto Cairo – 13:26 – Well, it’s not just political parties. Each partisan people on both sides of the political spectrum. Right? So, uh, both in the talk, I mean the book that I’m writing around the talk, I explained that these, the misuse of charts is not related, uh, to your being on, on, on either end of the political spectrum. It’s more related to the fact that you are partisan and that we all like to see what we want to see. We all like to have our opinions confirmed right on corroboratory when we. Yeah, when we see our child that apparently confirmed or corroborates what we already believe, we feel really happy. Right? And when we see a chart that refutes what we believe, we tend to reject it rather than reading it carefully. Right? So I have examples from participants from both the left and the right and up and down from all over the political spectrum because this is a universal problem.
Alberto Cairo – 14:24 – A beginning on the left. For example, they have an example coming from liberal pundits who awhile ago we’re trying to defend Obamacare or the affordable care act using a chart of the job market, number of jobs created by private companies, right? If you plot the number of jobs in the private market between 2006 and 2000, I don’t remember the details, but imagine that it’s between 2000 and, and 2017. The shape of that curve will be, we’ll have the shape of a U right a U shape, meaning that jobs started, the creation of jobs started shrinking or, or, or drop in, uh, during the economic crisis. And then there is an inflection point, and then-then the job market recovered, the number of jobs just started increasing again. Right? What these pundits who are doing though are that on top of that chart showing the number of jobs created by private companies, they overlaid appointing time saying,
Alberto Cairo – 15:24 – well, this is the point in time when Obamacare was approved, when Obamacare was passed, the affordable care act and the passing of the affordable care act happen to coincide very closely to the, with the inflection point in the curve. When the curve starts to start, it starts going up again. The number of jobs, right? So what these people were implying is that the affordable care act is great for the job market.
Contrary to what Republicans say, Republicans like to set there for affordable care act is terrible for the job market because it’s hindering companies, his ability to hire people and so on because it’s so expensive to pay for healthcare. Um, contrary to that, these pundits were saying, well, that is not true. Take a look at what happens in the job market is recovering and take a look at what happened on the inflection point. The affordable care act was passed. Well, I don’t have a strong opinion about this.
Alberto Cairo – 16:19 – I’m not an economist, and I don’t have an opinion as to whether Obamacare is good or bad for the for the job market, but what I point out in the talk is that that is completely beside the point what you believe about Obamacare, whether you think that is good or bad, the chart itself that’s entailed you, anything about that because a chart, and this is a principle of good chart reading are good chart making. A chart only shows what it shows and nothing else and all that that chart is showing is that there is a coincidence in time between two different events, the inflection point in the job market curve and the passing of Obamacare, but that doesn’t mean that the Obamacare is what caused the inflection in the job market curve. They could be completely unrelated, or there could be many other factors that also contribute to the recovery of the economy. The chart is not revealing them right, so the chart doesn’t improve anything. It’s completely. I think that it’s. That particular charter was completely useless to either attack or to defend Obamacare. The chart only
Allison Hartsoe – 17:24 – We often talk about that in analytics, correlation is not causation
Alberto Cairo – 17:28 – that is the common mantra and his assistants, right, although it needs to have an extension, is to have a caveat, which is that correlation or coincidence, temporal coincidence is usually the first clue to later finding the conversation. That’s also very important to remember. It’s not that all correlations are meaningless. Correlation is very important or relationships because correlation has a very specific meaning in the statistics. Relationships between variables are usually the first clue that you need to pay attention at. Right? But the chart alone, that’s the key thing. The chart alone is often not enough to establish a caution relationship between variables. You need more, right? More information.
Allison Hartsoe – 18:11 – What percentage of the charts that you see that are displaying information but not necessarily matching the story that someone is telling about them, what percentage of them are in this camp of correlation? Not causation.
Alberto Cairo – 18:28 – Difficult to tell. I don’t know what percentage it could be, but uh, it’s, it’s, it’s quite a lot. It’s very common. It’s very common to see. And it’s not just a problem with correlations is a problem. We’ve, and again, this is another good principle of good chart making language, chart reading. Don’t read too much into a chart. That’s another thing, right? In relationship to a chart only shows what it shows on. Nothing else. You don’t read too much, too much into the into a single chart. Trying to think beyond the chart. Our chart, it’s obvious. Realization can be an extremely powerful means for communication, but only if you control yourself or you curve your own instincts to try to see too much into it or read too much into it and we all do these, right? Will you? Again, the child itself, there was nothing wrong with it. There is a coincidence in time between the affordable care act and the inflection point. That could be that perhaps it could be perhaps that Obamacare, it’s actually not that bad for the job market.
Alberto Cairo – 19:29 – it’s a possible clue to that, but again, the chart alone that’s improved that you need more information. Do you need more data to stop? That’s what I try to do. I tried to explain, but we need to jump. We tend to jump to conclusions. That’s the particularly if those conclusions confirm, what do we want?
Allison Hartsoe – 19:49 – Is there an example from the right? We’ve already taken a left to task. I imagine there’s one on the other.
Alberto Cairo – 19:56 – Yeah, there are so many. Um, the most, perhaps the most newsworthy or most current one is the way that a partisan, Republicans, particularly those who support the president, president trump very strongly tend to misread the county-level election results map, right? Just picturing your in your brain the results of the 2016 presidential election at the county level, you will imagine a map that is mostly covering red with just a few spots of blue a in urban areas and in coastal areas like an ocean of red and with few with a few islands of blue here and there. Right. Well, there’s nothing wrong with that map per se. The map is correctly designed. It’s just displaying devote at the county level. Right? Right. I’m blue for republican, a republican and democrat. There’s nothing wrong with that map, but the inferences that people make from that map are completely wrong.
Alberto Cairo – 20:56 – Right. It’s like a. Because the map, some people, particularly again on the Republican side tend to see them. That vibe is a victory by a landslide. Are they using the map to infare popular vote right? The number of people who voted for either president Trump or Hillary Clinton and say, take a look at how much red, the reason this map and how little blue, the reason this map actually see if you can calculate, which is something that I did the percent of red area on that map and the county level map and the percent of blue area on that map, it’s 80% red and 20% blue, but that is not in the popular vote was split off 46 point something percent for trump on 48% for Hillary Clinton. Trump. Trump lost the popular vote so you can not even fear that support for president trump is huge. Are based on that map, but that is what the map implies. If that is what you want to believe that president trump has had huge support and that is not. That is not true, sir.
Allison Hartsoe – 22:01 – If there’s any pronunciation there is huge, right?
Allison Hartsoe – 22:06 – Huge, huge, huge, huge support, right? It again, and the point that I make during the talk, I try to wrap up all these examples with a little bit of humor and I always perceived them with the, with a similar sentence saying what I’m saying right now is a completely, besides of what you think about a politics of the moment. So objectively speaking, this map is misleading you for a such and such reason, regardless of whether you will post trump or do you support trump? It misleads us anyway, and we need to be careful.
Allison Hartsoe – 22:40 – Let’s talk about another example. I saw this one on your talk at Berkeley, and you went through the hurricane chart in the cone of uncertainty. Will you take us through this one? This is one we see all the time, and you know, for those of us in this space, I never even thought to question it, but take us through why this one is misleading.
Alberto Cairo – 23:00 – Wow. Alright. Okay. So let’s get. Let’s get started because it’s explaining visuals in the podcast. So we figured all right, so I’m not about that particular example. It’s quite complicated, but also fascinating in the book than writing. I devote like like six or seven pages to it, but I’m going to try to be concise. So first of all, big. All right, perfect. I’m going to have an article online that we can link to where people can read about it. All right, so anyway, so big picture how hurricane forecasts are usually displayed in the media, right? So when, when-when the media or the national hurricane center, which is the the the center that produces all these maps, when they want to inform you of where a hurricane or a storm could go, they usually create a map which you can see the geographic area that may be affected by the hurricane, and then they show you the path of the hurricane surrounded by a cone of increasing size, right? We call that the cone of uncertainty.
Alberto Cairo – 24:00 – Now, the right way to read that map is to imagine that that area contained in the cone is made of, let’s say dozens or hundreds of possible paths of the storm. Basically what scientists are trying to tell you is that this line here in the middle of the cone is what we estimate that is the most probable Passover, this tour, but this storm could be a little bit to the right or a little bit to the left within the boundaries of this cone. All right, so that’s how to read. By the way, the path of the center of the storm. That’s a very important, very important thing to remember. Anyway. That’s not how many people read that map. When and this has been proven experimentally, or people have been shown these map. I’m asked, what do you see on this map? When many people see the cone of uncertainty, what they see is an area of impact.
Alberto Cairo – 24:59 – Or they imagine that the cone is showing the possible areas that may be affected by the storm, right? There’s a reason why some people down here in Florida called the cone of certainty the cone of death. If you are exactly. If you are inside the cone do are under threat. If you’re outside the cone, you are fine, but that is not how to read it, obviously, because again, the cone of uncertainty is just basically a range of possible paths of the center of the storm and the center of the storm is just a point, right? I storm is a huge object, so try to imagine, for example, that at the end the storm passes by the right edge of the, of the cone of uncertainty. It could affect, it could still affect an area very far away from the, uh, from the cone itself just because the storm, he said you chopped it, but it gets even worse. It gets even worse when you get to the nitty-gritty of how they have that cone of uncertainty is created.
Alberto Cairo – 25:55 – So the first time that I saw it, I saw the map, I saw the cone, etc. I asked myself does the cone contain all forecasts, all probable or possible paths of the storm. Right? And that was not my assumption. Right? Remember, remember, I remember it Stats 101, right?
Allison Hartsoe – 26:16 – I think it’s like 95% confidence, right?
Alberto Cairo – 26:19 – exactly. That’s what most people believe, right? That’s what if you know a little bit of a stats that will be your inference, right, and it’s completely wrong. You may, you may think that you know the cone contains 95% of possible paths, but in some strange cases, in some outlier cases, it could be five percent of the cases. This stone could be outside the boundaries of the cone of uncertainty. The actual path of the storm will be outside, but that is not true. When you read the footnotes of the map, or you go to the documentatIon of how they might be treated, the code contains only two out of three possible paths of this storm. That means that one out of three of the time, the actual path of the storm, they track the track of the storm could be will be outside the boundaries of the cone of uncertainty. Right? So is a map bad? No, it is not bad. It is only bad if you don’t know how to read it
Alberto Cairo – 27:17 – and that’s why it’s so relevant and so important that people in my profession, generalists, we learned to read charts better because if we don’t read the charts well, we will not be able to inform the public about how to read them well. I have never seen in the news media, TV casts for example. Now, newscasts. Explain someone, explain the cone of uncertainty correctly. It may happen, but I haven’t seen it. So. And we need to explain it better just because, again, you could be affected by the storm even if you are outside the, uh, the cone of uncertainty, the probability of that happening is really high
Allison Hartsoe – 27:55 – Exactly. And I Think it’s very interesting where you put the responsibility. You don’t put the responsibility on the receiver, but you put it on the communicator an on the journalists.
Alberto Cairo – 28:06 – I put it in both so, so I put it in both. It’s, that’s also another very relevant point. Well, the main responsibility is obviously on the communicator. The communicator needs to make an effort in explaining things as clearly as possible, right? That’s the primary responsibility, but, and this is very important, but there is also a responsibility on the part of the readers, right? We’ll leave in a time in which we don’t pay attention. We just bros three things very quickly. We don’t pay attention to them. We’ll take a look at our chart, and we believe we understand it, and I understand. I understand this chart right? I either need to take a look at it carefully because I have already understood it. I can move away to take a look at the next piece, the next piece of content. So there’s host responsibility on the part of the audience to educate ourselves to be more attentive, to be more careful. Again, remember what I said about the title of my talk. If you only read the title, you will be misled. You need to read beyond the title.
Alberto Cairo – 29:05 – You need to read the footnotes. You need to read the fine print to understand what the chart is showing or what the talk is about, right? So we have a responsibility as people, as leaders, as citizens, to be more attentive and to be more responsible with the way that we observe, absorb information, and we handled the information that we observed.
Allison Hartsoe – 29:29 – I’m going to push back on that for just a minute because I think there’s a natural human intent to see what you want to see. How do you know that you’re just not seeing what you want to see versus thinking critically?
Alberto Cairo – 29:40 – Well, you can put yourself in their position or thinking in a, regarding counterfactuals. Alright. So I can tell you about that. Let’s go back to the example of the affordable care act, right? Um, I am part of the audience who may be misled by the chart into thinking that Obamacare is great for the job market because I happened to be from Europe, from western Europe. I’m from Spain. We have so to speak, socialized medicine, which is a very funny term in the United States. Socialized medicine in Spain, right? Pay through taxes, and he works wonderfully. It works really, really well. Healthcare, public healthcare, universal public healthcare in Spain is fantastic. So I am, and I tend to believe that that could be a great model for the United States, right? Why don’t we have universal healthcare here in the United States? I’m open to debate, but what I’m trying to say is that I can be someone who will be misled by the chart, but I was not misled by that chart.
Alberto Cairo – 30:40 – Why? Because I thought about it carefully. I didn’t just take a look at it. Imagine in that is just a little strange. Can take a quick look at it and say, okay, there is great. Obamacare is great for the job market, and I moved away from it. I paid attention to the chart. I thought about the char. I started thinking about alternative explanations for the inflection point, right? For example, I’m a. I’m the recovery act right in which happened before the inflection point. The Obama presidency injected billions of dollars in the private market. That could be one possible explanation for the job market picking up at that particular time, even more so than Obamacare. So there are ways in which you can curb. I believed your own ideological predispositions or bias is. It can’t be done, you cannot do it 100% of the time obviously, but if you only do it say 50 or 60 or 60 or 70% of the time, that’s progress, that’s progress
Alberto Cairo – 31:42 – and there is another way. There is another way in which you can do this also in the longterm, which is to create, and that’s another recommendation that I make over and over and over and over again create a varied media diet. So I’m trying to try to identify media sources all over the ideological spectrum, um, that look trustworthy and that you can consult and that you read assuming that the people writing that content are not trying to lie to you. Right? And that’s that. That’s something that I have been done throughout the years have I have curated at least of media sources that I can consult and that I considered trustworthy both on the right and on the left and I exposed myself actively to is there, are very different to mine. It’s hard to do. I want to say that it’s easy to do because again, we all love to have our own opinions confirm, but when we read an argument against our own opinions, we need to really carefully obviously, given that their argument is well constructed and is honest,
Allison Hartsoe – 32:42 – Is it harder to have that variety and age where there are so many recommendation engines driving the next article that we see.
Alberto Cairo – 32:53 – It is harder in a sense, and again, this all comes back to the responsibility on the part of readers. It is harder in the sense that we have become our own curators of information mainly that we are now responsible for creating our own media diet. We cannot just rely on the forces above us to curate information for us. So we need to actively identify throughout time sources that are reliable, that doesn’t lie actively and use them for information in the future and only consult those sources. So I, my own, um, my own bias when I read news and social media is that if a particular piece of information comes from a source that I don’t know and that I have not vetted myself, uh, in a, in a, in a certain period, immediately, I don’t trust that piece of information. I will look more, I look deeper into it before, before sharing it in social media, before tweeting about it, I will take a look a very, very close look at what the sources and what the information. Yeah.
Allison Hartsoe – 33:58 – I personally use a rule of triangulation. If I can find three different sources saying basically the same thing, then I start to trust that piece of information. Do you have a rule of thumb like that?
Alberto Cairo – 34:10 – but you need to be. Yeah, that could be part of the process of vetting your sources, but it can also be dangerous because sources tend to link to each other. So again, at least one of those, one or two of the, uh, oh, the corners of that triangle should be sources that you already trust, that has proven to you that they don’t lie actively, right? So it cannot be just any source. Those resources can be any source. One or two of them need to be sources that can be trustworthy according to your own assessment. And again, it’s hard work because you need to follow sources throughout a particular period to see what they publish, what the orientation is, where they publish good content or bad content bias content or nonbiased content. So it’s hard work. So yeah, we need to do for our work, I believe as, as readers, as consumers of information
Allison Hartsoe – 35:01 – when you’re trying to decide what’s a valid source, how important are the retractions?
Alberto Cairo – 35:07 – Extremely important. Actually just that’s one of the things that, that are used as a, as a, as a sign for quality. So if a news organization never publishes corrections visibly. I just erase it from my list. I only have, I only include sources that public that publish a correction. Um, when the, when they screw up, we all screw up. There is a difference between lying and is screwing up everybody up. That stuff is important. But not everybody lies in news media. Right? So, and that the key difference, you can identify a when you focus, when you pay attention at corrections.
Allison Hartsoe – 35:48 – Yeah. Well these are, these are great tips. Are there other tips that people should keep in mind when they’re looking at these visualizations, and we’ve talked a lot about thinking critically. We’ve talked about reliable sources. Um, what else should they be? Yeah, if they’re, if they’re convinced they really want to think more carefully about data and the visuals that they look at. Is there a hit list or a checklist or something that they could go through?
Alberto Cairo – 36:12 – Yeah, and there was sort of things that will need to pay attention to all the tips that are given during the talk. So for instance, take obviously take a look at the source of the, of the data if you have time, take a look at the primary source of the data. So the chart, for example, is displaying the results of a poll or the results of a scientific study. You know, the vote one minute or a couple of minutes to go to the primary source and see what the, what the data is and whether the chart published in that particular source reflects the primary source. Well, so that will be the first thing. If you have the time. Obviously, we don’t always have the time to do that, but if we do, it can take us a long way in identifying faulty visualizations. The second thing that we can pay attention to is as to whether they chew the graphic is well designed or not, meaning whether the scales on our chart have been, have been distorted or things like that, or the corners of the map have been distorted to convey a particular message, etc.
Alberto Cairo – 37:15 – Topic extensively about these. Um, uh, another thing that is to ask ourselves whether the chart contains a sufficient amount of information to support the message that the chart is intended to convey. Right? And these are very, very common problem and it’s related to the principal that I explained before about when I said that a chart shows only what it shows and nothing else. Right? So is the chart providing enough data to support the claims, for example? But the title of the talk that the chart is making, right? So we need to pay attention because many charts are extremely simplified, our oversimplified and sometimes they need to include more information. Okay.
Allison Hartsoe – 38:01 – Do you also recommend that you do not look at the title first, that you look at the chart first and then the title,
Alberto Cairo – 38:07 – you know what I mean? I don’t mind. That could be one possible approach, but if you take a look at the title first, then you need to keep the title in mind and put it in a, in, in comparison, compare it to the actual content of the chart itself because the title can bias your perception of the chart, so it’s like reading the title by all means. That’s what I do, but then put it aside for one second and just focus on the messages that the chart is conveying and compare those messages to the title to see whether the title has any married or not. Right? So that could be a possible a possible strategy. Um, uh, don’t read another principle or another thing. Again, don’t read too much into a chart. That could be another good principle of the chart of chart reading and try to put yours as much as you can. Again, it’s not 100% possible, but try to put your own cultural and ideological biases aside when you, when you read a chart or when you assess a chart, try to assess the chart based on its own merits, not on what you want to see on the chart. Again, this is hard work. It sounds easy when you say it. It’s hard, but it can be done.
Allison Hartsoe – 39:17 – But I think the first step, like most biases, is being aware that it’s. That you might have a bias.
Alberto Cairo – 39:23 – Yeah, that’s perhaps the hardest part, right? I, I’m acknowledging that we all come from somewhere, right? We all have values, and we all have, and we need to assume that other people’s values also have merit and do I have reasons that exist, right? If we want to have an informed conversation,
Allison Hartsoe – 39:41 – Well, I think it’s especially hard in this industry when we’re trying to create data-driven cultures, and we’re trying to give people actionable insights. You know, there’s pressure to show that there is something you can do with the data. And so I think it’s very easy to leap into, um, the fact that something is perhaps more important than it is, but testing, which is something we also talk about on the show can be a really great avenue to say, this is an assumption. Now let’s test it and see if it’s.
Alberto Cairo – 40:13 – Yeah, yeah, yeah. Testing is really important, but I believe that there is something else that is also important which is to assume or perhaps accept that charts are not conversation stoppers, meaning a chart will not close a conversation. We need to change our mind. We need to change our frame of mind. The way that we approach charts. Charts are not the way to end conversations. Charts are means to push the conversation forward, forward to facilitate conversations. Charts alone are rarely arguments on their own when they are presented in isolation. But charts can be extremely powerful. Elements in conversations or assets in arguments about a particular topic. Right? Again, we tend to believe that our chart represents the truth that our chart is objective, that our chart, and that the data on the chart is scientific.
Alberto Cairo – 41:10 – And that is, I mean, that’s not a bad thing too to think right, but at the same time we also need to remember that charts are limited. They are limited models of reality, and therefore they cannot capture reality itself in all its complexity. They need to be putting context; they need to be putting insight, longer arguments about the topics that we need to discuss.
Allison Hartsoe – 41:32 – Fantastic point. I love that. Thank you. So now you’ve got the tour coming up. Can you talk a little bit about how would people get in touch with you or how they might find your books or how they might catch your tour?
Alberto Cairo – 41:46 – Sure. I mean, the best way to find me is um, uh, through my own weblog, which is the title of my first book, .com. So it’s like a the functional or functional thefunctionalart.com thefunctionalart.com. That’s my weblog. Also on Twitter. I’m pretty active on Twitter, and I tweet mostly about, about visualization. They, it’s my first name and last name. So it’s @albertocairo, the website of the, of the visual trumpery talk. Uh, it has not been updated for a while, so I need to work on that in the next few months. But, uh, trumperytour.com and I usually post all the dates and places of future talks in there. Yes, I’m going to Nashville for example, in September or October, I don’t remember. I need to check that out. I’m going to North Carolina in September, so I am visiting a Raleigh, Chapel Hill, a Durham and then Charlotte. So four different cities in North Carolina in September. Um, yeah. So yeah.
Allison Hartsoe – 42:58 – Now if somebody can’t get to one of those talks is there are a particular talk you’re very fond of that we could link to in our show notes.
Allison Hartsoe – 43:05 – Sure. There is a, I gave a version the trumpery talk has different versions, and I believe that one of the best ones is the one that I delivered in New Zealand, um, during the Chaka a celebration. So shake is I-H-A-K-A Dhaka. So the shake lectures is a series of lectures honoring a Ross Ihaka who is one of the creators of the R programming language. He was a professor. He was a professor in New Zealand in Auckland, in the department of statistics at the University of Auckland. He retired, he’s still around, and they created this series of lectures, and they invited me to deliver the visual trumpery talk during the Chaka lectures, and it’s available on Youtube. That’s one of my favorite versions of the trumpery talk, but it changes every, every time that I delivery it, I update the examples. I changed it a little bit. The structure of the talk doesn’t change that much, but the examples that I showcase those I change.
Allison Hartsoe – 44:06 – I, I, um, I have to say that if you, if you have the chance to catch Alberto Cairo on one of these talks, definitely go and see him. I, I caught one of them online before we spoke on this podcast. And you are just so entertaining and it’s so delightful to hear this topic which can be fairly dry, delivered in such a, a funny, entertaining way. So I, I, I think that’s fantastic. Thank you for taking up the cause.
Alberto Cairo – 44:34 – Thank you for the kind word.
Allison Hartsoe – 44:36 – Well, let’s just summarize a little bit about what we’ve heard we talked about, why should I care about visual trumpery, you know, this, this visual mischief and, and deception that’s going on and, and we came to the conclusion that there were five great elements that happen in most powerful charts are most powerful graphics from them being truthful, beautiful, functional, insightful and enlightening. Those are the five key components that we’re really after. But you know, we can marry that with what you said at the end, Alberto, which is the chart isn’t just meant to be a stopping point and I think that’s where the last piece in lightening becomes so valuable is if it is indeed in lightening, shouldn’t it provoke a conversation? Shouldn’t it cause people to say, oh, I didn’t know that. What about this? And indeed that’s what we often like to hear when people are engaging with our work is they find six different ways that they want to twist it and turn it to explore it and understand it can be a powerful way to, to get hold of the data and the story behind the data.
Alberto Cairo – 45:44 – That’s a fantastic summary. You should deliver the talk in the future.
Allison Hartsoe – 45:50 – I don’t think I could do it justice, not like you. Thank you. Um, and then we talked about the different examples. We talked about the left and the right versions in the end at the editor, sorry, the electorial map, uh, the Obamacare on the left and the electorial map on the right. And what you said here, that was really good, was it? And, and I’ve heard this before from other people that we’ve interviewed, which is to think critically, to think beyond what the data are telling you to think beyond the chart. And, and especially here, we talked a lot about pausing, set your biases aside and really think that the chart is just the chart. It’s only showing you what it has. It’s not a; it’s not designed to tell you all the answers at once unless it’s extremely well designed.
Alberto Cairo – 46:40 – I’m going to interrupt you in there, but because there was another element to that which I forgot to mention later, but I make this point in the swing, the in my, in my third book, the one that I’m writing, which is that when we think alone, we don’t reason. We rationalize. That’s a very another very relevant points, so when we only talk to ourselves or to people who are likeminded people who already think like us, we tend to basically use our reasoning skills to confirm what we already believe. It is better, and again, this is connected to the idea of charts as part of as part of our dialogue enabling process, right? So don’t you. Don’t, don’t reason about the chart on your own. Talk with other people who are not necessarily likeminded about the chart because every, every person will see something different in the chart and understanding I’m good. The reasoning may arise through the conversation about the data that is being shown to you and to that other person.
Alberto Cairo – 47:41 – We don’t think well alone. We are social creatures, and we only can reason well when we don’t think on our own or in collaboration with people who already believe what we believe. We reason better when we partner up with people who are not necessarily like us, but who are a little bit different than we are,
Allison Hartsoe – 48:00 – I love that. That that that is going to be our closing note today. Don’t, don’t reason on your own. Definitely look for those opposing opinions to come to a proper unbiased conclusion. Alberto, thank you so much for joining us today. It’s been an absolute pleasure to have you.
Alberto Cairo – 48:17 – Thanks for having me.
Allison Hartsoe – 48:19 – Links to everything we discussed are at ambitiondata.com/podcast, and that will include links to the different visuals that we talked about today and links to the video that Alberto mentioned at the end of our talk. Now, remember, when you use your data effectively, you can build customer equity. It is not magic. It’s just a very specific journey that you can follow to get results. Thank you for joining today’s show. This is Allison. Just a few things before you head out. Every Friday I put together a short bulleted list of three to five things I’ve seen that represent customer equity signal, not noise, and believe me, there’s a lot of noise out there. I actually call this email the signal things I include could be smart tools. I’ve run across articles, I’ve shared cool statistics or people and companies I think are doing amazing work, building customer equity. If you’d like to receive this nugget of goodness each week, you can sign up at ambitiondata.com, and you’ll get the very next one. I hope you enjoy the signal. See you next week on the Customer Equity Accelerator.