The COVID Behaviors Dashboard (CBD) is an analysis of the knowledge, attitudes and practices generated from the Delphi Group at Carnegie Mellon University and University of Maryland Social Data Science Center COVID-19 Trends and Impact Survey (CTIS), in collaboration with Facebook. Analysis and content on the COVID Behavior Dashboard is developed by the Johns Hopkins Center for Communication Programs and WHO’s Global Outbreak Alert and Response Network (GOARN). The Delphi Group at Carnegie Mellon University administers the US survey (
visit the website) and the University of Maryland Social Data Science Center administers the global survey (
visit the website).
Recruitment. Facebook users are invited to participate in off-platform surveys conducted by the academic partners using Qualtrics. These surveys are designed with privacy in mind. Facebook does not receive individual survey responses and the universities do not receive any identifying information. For a more complete description of the survey administration please see the survey methods. The visualizations on this dashboard present data collected through CTIS survey version 11 administered beginning on May 20, 2021. See the links above for more details regarding revisions to the survey and previous survey versions.
A comprehensive look at the survey design, methods, weights and analysis can be found in this article:The U.S. COVID-19 Trends and Impact Survey, 2020-2021: Continuous real-time measurement of COVID-19 symptoms, risks, protective behaviors, testing and vaccination. Sample size by data collection period is available here . (Please note that the actual sample size for each survey question varies, due to either the display logic for the question or non-response.)
Data Presentation. The CBD is a data utilization activity. Our goal is to provide public health decision makers with topic- and time-relevant data that will inform message development and dissemination. Achieving these goals requires several data compilation and presentation decisions by our team,These decisions are reflected in the notes below and the corresponding dashboard visualizations.
Demographic questions. Decisions were made to modify some of the demographic characterizations based on low frequency of reporting. Changes to the response options and filtering for certain questions are listed below.
Visualizing the survey. Below is a list of the survey questions used for each visualization in the dashboard. Please see the UMD and CMU surveys for additional information.
Survey modules. All survey respondents are asked the Core Module (topics include symptoms, testing, COVID-19 vaccine, behaviors). After answering these questions, survey respondents are randomly allocated and evenly distributed to Module A (topics include beliefs and norms, knowledge and information, healthcare) or Module B (topics include well-being, parenting behaviors (including schooling), specific demographic questions (i.e. cigarette use and pregnancy).
For more information about the modules, please see the questionnaire documentation from UMD and CMU.
Study Methods from the first series of KAP COVID visuals can be found here .
Survey weights. Survey weights designed and calculated by Facebook are used to improve data representation for each country or territory individually. The weights mitigate sampling biases due to survey non-response (i.e., certain people are more likely to respond than others) and sampling frame coverage biases (i.e., not everyone has or uses their Facebook account). Despite these adjustments we have found that some weighted means overestimate the desired statistic and are not presented within the dashboard. In addition, the weights are not adjusted for the relative population sizes of countries and territories globally. Read the Weights and Methodology Brief for more details.
When viewing sub-groups within the side panel for all visualizations, please note that due to missing demographic characteristics and sample size requirements, percentages may not always align perfectly with country totals. Percentages on the dashboard may not total 100 due to rounding. Below, we present the data based decisions for both the GLOBAL & REGIONAL VIEW and the SUB-NATIONAL VIEW of the Dashboard.
Among unvaccinated participants, who is most willing to accept a vaccine?
Survey question(s)
- Survey question(s)
- Question: If a vaccine to prevent COVID-19 were offered to you today, would you choose to get vaccinated?
- Response options:
-
- 1 = Yes, definitely
- 2 = Yes, probably
- 3 = No, probably not
- 4 = No, definitely not
- Side panel question filter (GLOBAL & REGIONAL VIEW only): How many children under the age of 18 are currently staying in your household?
- If >= 1, Side panel question filter: How many children under the age of 18 are currently staying in your household?:
- Side panel question filter: How many children under the age of 18 are currently staying in your household?
- Response options:
- 1=Yes, definitely, 2=Yes, probably, 3=No, probably not, 4=No, definitely not
- Only present 1 (=Yes, definitely or Yes, probably) & 2 (=No, probably not or No, definitely not) in the side panel
What are the reasons driving vaccine hesitancy?
Survey question(s)
- Filter: Have you had a COVID-19 vaccination? (answer “No”)
- Filter: If a vaccine to prevent COVID-19 were offered to you today, would you choose to get vaccinated?
- If answered “yes, probably”, “no probably not”, or “no, definitely not”, then ask: Which of the following, if any, are reasons that you wouldn’t choose or only would probably choose to get a COVID-19 vaccine? Please select all that apply.
- I am concerned about possible side effects of a COVID-19 vaccine
- I don’t know if a COVID-19 vaccine will work
- I don’t believe I need a COVID-19 vaccine
- I don’t like vaccines
- I plan to wait and see if it is safe and may get it later
- I think other people need it more than I do right now
- I am concerned about the cost of a COVID-19 vaccine
- It is against my religious beliefs
- Other
- Responses under “Don’t believe I need a COVID-19 vaccine”
- Question: Why don’t you believe you need a COVID-19 vaccine? Please select all that apply.
- I already had COVID-19
- I do not spend any time with high risk people
- I am not a member of a high risk group
- I plan to use masks or other precautions instead
- I don’t believe COVID-19 is a serious illness
- I don’t think vaccinations are beneficial
- Other
What percentage of unvaccinated participants tried to get a vaccine?
Survey question(s)
- Filters:
- Have you had a COVID-19 vaccination? (answer “No”)
- Do you have an appointment to receive a COVID-19 vaccine? (answer ≠1-yes)
- If a vaccine to prevent COVID-19 were offered to you today, would you choose to get vaccinated? (answer ≠4-No, definitely not)
- Have you had a COVID-19 vaccination? (answer ≠1 – Yes)
- Question:
- Have you tried to get a COVID-19 vaccine?
Will people choose to get a COVID-19 vaccine for their children when eligible?
Survey question(s)
- How many children under the age of 18 are currently staying in your household?
- If >= 1, then asked:
- Will you choose to get a COVID-19 vaccine for your child or children when they are eligible?
- Response options:
- 1=Yes, definitely, 2=Yes, probably, 3=No, probably not, 4=No, definitely not
- Graphic presents 1 (=Yes, definitely or Yes, probably)
- Does not present 2 (=No, probably not or No, definitely not)
What are the reported structural barriers to vaccination?
Survey question(s)
- Filter: Have you had a COVID-19 vaccination?
- yes = Vaccinated
- If no, then asked:
- If a vaccine to prevent COVID-19 were offered to you today, would you choose to get vaccinated?
- Response options: 1=Yes, definitely, 2=Yes, probably, 3=No, probably not, 4=No, definitely not
- Only present If a vaccine to prevent COVID-19 were offered to you today, would you choose to get vaccinated? or Yes, probably (= Unvaccinated but will definitely or probably get vaccinated)
- Have you tried to get a COVID-19 vaccine? (answer ≠2 – No)
- Have you tried to get a COVID-19 vaccine? (answer ≠2 – No)
- I did not meet the eligibility requirements
- There were no vaccines or vaccine appointments available
- The available appointment times did not work for me
- There were technical difficulties with the website or phone line
- I was unable to provide a required document
- Limited access to internet or phone to schedule an appointment
- Difficulty traveling to a vaccination site
- Information not available in my native language
- There is no one to provide childcare while getting the vaccine
- It was difficult to get time away from work or school
- I could not get the type of vaccine I wanted
- Side panel question filter (GLOBAL & REGIONAL VIEW only):
- Have you had a COVID-19 vaccination? (answer = 1 – Yes), or
- Have you had a COVID-19 vaccination? (answer = 2 – No), and If a vaccine to prevent COVID-19 were offered to you today, would you choose to get vaccinated? (answer ≠4 – No, definitely not), and Have you tried to get a COVID-19 vaccine? (answer ≠2 – No)
- Users can view responses by participants’s self-reported vaccination status using the dropdown menu.
How does vaccine acceptance among health workers vary across countries? (GLOBAL & REGIONAL VIEW only)
Survey question(s)
- Filter:
- US: Please select the occupational group that best fits the main kind of work you were doing in the last four weeks. (answer = 4 – Healthcare practitioners and technicians or 5- Healthcare support)
- Global: What is the main activity of the business or organization in which you work? (answer = 7 – Health)
- Question: Have you had a COVID-19 vaccination?
- If yes = Vaccinated
- If no, the asked:
- Do you have an appointment to receive a COVID-19 vaccine? (answer ≠1 – Yes)
- If a vaccine to prevent COVID-19 were offered to you today, would you choose to get vaccinated?
- Response options:
- 1 = If a vaccine to prevent COVID-19 were offered to you today, would you choose to get vaccinated?
- 2 = Yes, probably
- 3 = No, probably not
- 4 = No, definitely not
How much are you worried about catching covid-19?
Survey question(s)
- How much do you worry about catching COVID-19? [Only individuals assigned to Module A were asked. See section titled “SURVEY MODULES” below.]
- Response options:
- 1=A great deal
- 2=A moderate amount
- 3=A little
- 4=Not at all
How are prevention behaviors and norms changing?
Survey question(s)
- When out in public places in the past 7 days, how many people maintained a distance of 6 feet (US)/ 1 meter (Global) from others in public to prevent COVID-19? (answer = 4 – Most people or 5 – All of the people) (Module A only)
- When out in public places in the past 7 days, how many people would you estimate wore masks? (answer = 4 – Most people or 5 – All of the people) (Module A only)
- Thinking about people in your community, how many people have gotten a COVID-19 vaccine? (answer = 4 – Most people or 5 – All of the people) (Module A only)
- In the past 7 days, how often did you intentionally avoid contact with other people? (answer = 1 – All of the time or 2 – Most of the time)
- In the past 7 days, how often did you wear a mask when in public? (answer = 1 – All of the time or 2 – Most of the time)
How are daily prevention norms changing by country? (GLOBAL & REGIONAL VIEW only)
Survey question(s)
- In the past 24 hours, have you done any of the following? Please select all that apply.
- Gone to work or school indoors, outside the place where you are currently staying
- Gone to an indoor market, grocery store, or pharmacy
- Had a drink or meal indoors at a bar, restaurant, or cafe
- Spent time indoors with someone who isn’t currently staying with you
- Attended an indoor event with more than 10 people
- Used public transit If yes:
- Affirming that they participated in one of the daily activities, participants were then presented with a second question asking if they wore a mask while participating in this activity. This question is as follows:
- During which activities in the past 24 hours did you wear a mask? Please select all that apply.
- Gone to work or school indoors, outside the place where you are currently staying
- Gone to an indoor market, grocery store, or pharmacy
- Had a drink or meal indoors at a bar, restaurant, or cafe
- Spent time indoors with someone who isn’t currently staying with you
- Attended an indoor event with more than 10 people
- Used public transit
- Within the pop-up window on the visualization, the percentage of individuals wearing a mask during a given activity was calculated by:
- Dividing the overall number of individuals who reported wearing a mask during an activity by the overall number of individuals who reported participating in that activity.
How has knowledge about the spread of COVID-19 changed, by country? (GLOBAL & REGIONAL VIEW only)
Survey question(s)
- Please indicate whether the following statement is true or false: “Children cannot get COVID-19.” (Module A only)
- Response options: 1=Definitely false, 2=Probably false, 3=I really have no idea, 4=Probably true, 5=Definitely true
- Reverse coded into: “Children can get COVID-19.” (1,2=True, 3=Don’t know, 4,5=False)
- Please indicate whether the following statement is true or false: “COVID-19 cannot spread in hot and humid climates.” (Global only) (Module A only)
- Response options: 1=Definitely false, 2=Probably false, 3=I really have no idea, 4=Probably true, 5=Definitely true
- Reverse coded into: “COVID-19 can spread in hot and humid climates.” (1,2=True, 3=Don’t know, 4,5=False)
Which sources of COVID-19 information were most trusted and most frequently accessed in different countries? (GLOBAL & REGIONAL VIEW only)
Survey question(s)
- Survey question(s)
- Doctors or other health professionals you go to for medical care (US)/ Local health workers, clinics, and community organizations (Global)
- Scientists and other health experts
- Centers for Disease Control (CDC) (US)/ World Health Organization (WHO) (Global)
- Government health authorities or officials
- Politicians
- Journalists
- Friends and family
- Religious leaders
How much do you trust the following sources to provide accurate news and information about COVID-19? (answer=3 – Trust) (Module A only)
- Doctors or other health professionals you go to for medical care (US)/ Local health workers, clinics, and community organizations (Global)
- Scientists and other health experts
- Centers for Disease Control (CDC) (US)/ World Health Organization (WHO) (Global)
- Government health authorities or officials
- Politicians
- Journalists
- Friends and family
- Religious leaders
How does trust in sources of information vary, by country? (GLOBAL & REGIONAL VIEW only)
Survey question(s)
- How much do you trust the following sources to provide accurate news and information about COVID-19? (Module A only)
- Doctors or other health professionals you go to for medical care (US)/ Local health workers, clinics, and community organizations (Global)
- Scientists and other health experts
- Centers for Disease Control (CDC) (US)/ World Health Organization (WHO) (Global)
- Government health authorities or officials
- Politicians
- Journalists
- Friends and family
- Religious leaders
- Response options:
- 1=Do not trust, 2=Somewhat trust, 3=Trust
- Only present answer=3 – Trust in the side panel
What COVID-19 topics do people want more information about by country? (GLOBAL & REGIONAL VIEW only)
Survey question(s)
- What COVID-19 topics do you want more information about? Please select all that apply. (Module A only)
- Treatment of COVID-19
- How to get a COVID-19 vaccine
- Different types of COVID-19 vaccines
- Variants of COVID-19 (also known as coronavirus mutations)
- How to support my children’s education
- The economic impact of COVID-19 to me personally (Global only)
- How to maintain my mental health
- How to maintain my social relationships despite physical distancing
- Employment or other economic and financial issues
As far as you know, have you ever had COVID-19?
Survey question(s)
- As far as you know, have you ever had coronavirus (COVID-19)?
How are COVID-19 testing rates changing, by country? (GLOBAL & REGIONAL VIEW only)
Survey question(s)
- Have you been tested for coronavirus (COVID-19) in the past 14 days? (Yes/ No)
- If yes:
- US: You answered that you have been tested for coronavirus (COVID-19) in the past 14 days. Did this test find that you had coronavirus (COVID-19)?
- Global: Did your most recent test find that you had COVID-19?
- Response options: 1=Yes, 2=No, 3=Don’t know
Visualization Decisions Made by the COVID Behaviors Team
- We are not visualizing every question on the survey, only ones related to knowledge, attitudes and practices in addition to vaccine acceptance data. New visualizations may be added over time and this document will be updated.
- Cell sizes of less than 100 have not been visualized.
- Data are typically pooled for two time periods each month: 1st through 15th and 16th through the final day of the month. This time period of approximately 2 weeks, allows for a sizable sample to accumulate and sampling weights to be assigned.
- Sub-national data facilitates a more granular look at what is happening in a country. It also requires a larger sample size to have representative data for each of the subnational categories. As a result, we have pooled the subnational data monthly rather than twice in a month to increase the sample size.
- Some questions were not posed to audiences in the US, such as “COVID cannot be spread in hot and humid climates.”
Data request:
Global Data is through UMD: https://covidmap.umd.edu/fbsurvey/
US data through CMU/Delphi: https://delphi.cmu.edu/covidcast/surveys/
This study was implemented in collaboration between John Hopkins Bloomberg School of Public Health’s Center for Communication Programs with the Massachusetts Institute of Technology (MIT), the World Health Organization and Facebook’s Data for Good. The methodologies described in this document are a cursory overview of the data coordination and sampling methodologies that were utilized. A more robust description of those procedures is forthcoming and will be made available in this location when available.
Scope of Survey. Sixty-nine countries were identified for recruitment of Facebook users at the outset of this study. Countries were selected where Facebook usage was sufficiently widespread and could plausibly result in samples representing a range of national characteristics. Twenty countries were identified as longitudinal (wave) countries and another 49 countries were identified as cross-sectional (snapshot) countries. In the end, two countries were removed due to inadequate response rates. See the full list of countries and designation below.
Recruitment. Individuals in the focus countries responded to an advertisement within their Facebook feed that was designed and implemented directly by Facebook’s Data for Good. When clicking upon the recruitment advertisement, individuals were pushed to a survey portal operated by the team of researchers at MIT. Individuals clicking on the link were presented first with consent information and age verification questions to restrict recruitment to adults over 18 years of age. Then, if they consented, they progressed through the survey with the option of withdrawing or not responding to questions at any time. No compensation of any kind was provided to participants. The Committee on the Use of Humans as Experimental Subjects review board at MIT provided ethical approval for this study (# E-2294).
The survey went live on July 6, 2020 and data continued to be collected until at March 2021 for the wave countries. The survey was translated to 51 languages and participants in many countries could choose the language in which to take the survey. As of August 8, 2020, over 300,000 completed surveys were received from 67 countries. The full survey instrument is provided below. Target sample sizes for snapshot and wave countries was 3,000 per data collection event (wave countries 8 x 3,000 = 24,000).
Weights & Data. All of the statistics generated in this dashboard were weighted using sampling weights determined by teams of statisticians at MIT and Facebook. A full account of the decisions surrounding the creation of the sampling weights is forthcoming.
External data were used to categorize the overall severity of the epidemic in the focal countries. Data were retrieved from the COVID-19 Data Repository by the Center for Systems Science and Engineering (CSSE) at Johns Hopkins University to generate a case count and caseload trend variables. The date when case counts were retrieved coincided with the launch of the first wave or when the snapshot survey was launched. For the 47 cross-sectional countries, data reflects case counts on 7/20/2020 and for the 20 longitudinal countries it reflects 7/6/2020. The date when case counts were retrieved for the 47 cross-sectional countries, data reflects the caseload trend from 7/6/2020 to 7/20/2020, while for the 20 longitudinal countries it reflects from 6/22/2020 to 7/6/2020. Countries were classified according to which tercile it fell into (high, medium and low) according to their COVID-19 severity on both variables.
Survey. The survey content was divided into eight blocks. Every individual was presented with the first five blocks of questions which addressed: trust in information sources, knowledge, vaccine acceptability and healthcare, and demographics. In snapshot countries, all respondents are shown an information block and then three additional blocks that are randomly selected from the remaining blocks, which include: Information needs, basic knowledge about COVID-19, distancing familiarity, importance and norms, risk perceptions and locus of control, prevention behaviors in practice, behavioral measures taken, beliefs about efficacy, work, and intentions to visit locations if open and open with precautions. In multi-wave countries, respondents are shown four randomly selected blocks. By design, not every participant was asked to respond to every question in the survey.
Additional Information:
