Guide

Analyse survey data — from raw export to finished report

The responses are in. Now comes the part that eats most of the time in practice. This guide walks through the six steps of a clean analysis — and where you can skip them.

14 days free · no credit card · hosted in Germany

Survey analysis has six steps. Check and clean the raw data, count frequencies, build crosstabs by audience, summarise scales as top-2 boxes, code open-ended answers into topics and report the results. In DataLion, these steps run in the same project. The first tables and charts appear automatically as responses arrive.

  • 🇩🇪 Made in Munich
  • GDPR-compliant
  • DPA included
  • Hosted in Germany
  • 🌐 Interface in EN, DE, FR & NL

Trusted by research institutes, brands & insights teams

  • YouGov
  • Mediengruppe RTL Deutschland
  • SevenOne Media
  • Nielsen Sports
  • Spiegel Institut
  • Messe Berlin
  • Hartmann
  • 50+ interactive chart types
  • 20+ statistical methods
  • SPSS · Excel · CSV import without data loss
  • ISO 27001 certified data centers (Germany)

Fielding the survey was the easy part

  • The raw export is a 200-column table in which nobody can find the question
  • Multiple-response questions sit there as 0/1 columns and cannot simply be summed
  • Every breakdown by audience is another pivot table built by hand
  • At the end, charts are copied into PowerPoint one by one — and again next wave

Understand the raw data before you calculate anything

Every export has one row per respondent and one column per variable. A question, however, rarely matches exactly one column. A matrix question with six items becomes six variables. A multiple-choice question with eight options becomes eight 0/1 columns, one per option.

That is why analysis starts with the codebook. It records which variable belongs to which question, what the values mean and which codes stand for "no answer". Without this record, code 99 ("don't know") eventually ends up in a calculation as if it were a rating.

  • One row per respondent, one column per variable
  • Multiple response as 0/1 columns, not a single column
  • Codebook: variables, values, labels and missing codes
  • Import from Excel and CSV or SPSS including labels

Preparation: clean, recode, weight

Preparation comes before the first number. Define missing values properly, because a "don't know" is not a 3 on the scale. Collapse ages into groups, reverse negatively worded items and weight a sample that is not representative.

Repeatability matters. A second wave needs the same preparation. Manual spreadsheet steps are often neither documented nor reproducible. In DataLion, capture them as recodes and in the codebook script. The script can be applied to every later wave.

  • Define missing values instead of computing with them
  • Recode: build groups, reverse items
  • Weighting for representative results
  • Preparation as a script — reusable on every wave

Frequencies and crosstabs: where the answers are

First, inspect the frequency distribution for each question: how many answered what, in absolute numbers and percentages? Check the base. Does it include all respondents or only those who saw the question? Filters can change the result substantially. A percentage without its base size is worthless.

Next comes the crosstab. It breaks a question down by an attribute, such as satisfaction by age group, recommendation by region or purchase intent by customer segment. Defensible findings usually come from this comparison, not from an overall figure.

A significance test inside the table checks whether a difference between two groups is statistically reliable. Confidence levels range from 80 to 99 %.

  • Frequencies in absolute numbers and percentages, always with the base
  • Choose the base carefully: all respondents or only those filtered in
  • Crosstabs by audience, region, wave
  • Significance at 80–99 % directly in the table

Analysing Likert scales: top-2 box, not the mean

Scale questions ("How satisfied are you …?", 1 to 5) are common and easy to analyse badly. The usual reflex is to report the mean. A Likert scale is ordinal, so the distance between steps is not guaranteed to be equal. A mean also hides the distribution. A value of 3.0 can represent a group of undecided respondents or two opposing groups.

The top-2 box shows the share of the two agreeing steps. The bottom-2 box shows the opposite. Both are easy to communicate. In DataLion, define them once as a top/bottom box code and use them in every table and chart.

For many items side by side, use a polarity chart. Agreement and disagreement run from a shared centre in opposite directions. This makes differences between items visible.

  • Report top-2 box and bottom-2 box instead of a mean
  • Show the distribution, not just the central tendency
  • Polarity chart for many items side by side
  • Define scales once, reuse them everywhere

Open-ended answers: the why behind the numbers

Closed questions tell you where the problem is. Open-ended answers explain why. Manual coding takes time: with 800 verbatims, somebody reads for a day and assigns categories that can be difficult to reproduce later.

AI sentiment and topic analysis condenses verbatims into topics, assigns a sentiment and writes both back as new variables. Open-ended answers can then be broken down by segment in a crosstab or tracked across waves.

  • Topics and sentiment coded automatically instead of by hand
  • Results as variables — crosstabbable like any question
  • Topic frequency over time as an early indicator
  • Configurable AI endpoint, self-hostable in the EU

Reporting: a dashboard, not a slide graveyard

The final step is where most of the time disappears: moving results into a report. Charts get copied one by one, reformatted, and at the next wave it all starts over.

Build the analysis once as a dashboard. Stakeholders can filter it by segment themselves. For presentations, export the same analysis natively to PowerPoint as real, editable slides. Set up recurring studies as a tracker. Each new wave uses the same structure.

  • Interactive dashboard instead of a static deck
  • Native PowerPoint export — editable slides
  • Tracker: new wave, same analysis
  • Excel, PDF and SPSS as export formats too

What about Excel?

Excel works well for small surveys. A one-off survey with 100 responses and 15 questions is faster to analyse with pivot tables than it is to set up a tool. We would not recommend anything else.

The limit is repetition. When the same analysis is produced per segment, wave or location, the workload grows each time.

  • Excel: fine for one-off, small surveys
  • Awkward for multiple response, weighting and significance
  • Tipping point: recurring waves and many segments

See DataLion with your own data

Start free with your own raw data. Or book a personal demo of the path to a finished dashboard.

Top rated

4.5 out of 5 stars on G2 and OMR Reviews

What users say about DataLion

  • via G2
    Very professional company, attentive to the customer needs, provider of a great software and service.
    Generoso M. · CRM Analyst, Automotive
  • via G2
    The contacts at DataLion are very committed. If you have problems, you can count on help. DataLion reacts quickly to requests for new functions.
    Robert Q. · Managing Director
  • via G2
    User-friendliness, especially for market research topics. Structured backend with many customization options.
    Verified user · Market Research
  • via G2
    The embedding function allows us to generate insights of our data for our audience and customers by far less than half of the usual time needed before.
    Verified user · Leisure, Travel & Tourism
Read all 16 reviews on G2 →
We now work much more efficiently, giving us more time to take care of the derivations and insights from the data for the customers.
Jens Falkenau, Vice President of Market Research · Nielsen Sports
Read the case study →

Next

Frequently asked questions

How do you analyse a survey?
In six steps: export the raw data and make sense of it using the codebook, prepare the data (missing values, recodes, weighting if needed), count frequencies per question, break the results down by audience in crosstabs, condense open-ended answers into topics, and report the analysis as a dashboard or deck.
How do you analyse a Likert scale?
Most robustly via top-2 box and bottom-2 box: the share of the two agreeing and the two disagreeing steps. A mean is problematic on a strictly ordinal scale and above all hides the distribution — a 3.0 can mean consistent indifference or a split sample. Always show the distribution as well.
How do I analyse multiple-response questions?
Multiple-response questions arrive in the export as 0/1 columns — one column per answer option, with 1 meaning "selected". They are reported as the share of respondents who picked each option, which is why the percentages add up to more than 100 %. What matters is a consistent base: all respondents, or only those who were asked the question.
Can I analyse a survey in Excel?
Yes — for small, one-off surveys Excel with pivot tables is entirely sufficient. It becomes laborious with multiple-response questions, weighting and significance testing, and above all with repetition: as soon as the same analysis is produced per segment or per wave, the effort grows with every repetition.
How many responses do I need for a defensible analysis?
It depends on how finely you want to break the data down. An overall figure is often fine at 100 responses; for comparing subgroups, each reported group should have roughly 30 to 50 responses, otherwise the shares fluctuate too much. Anonymous employee surveys add a minimum group size of five to ten responses for anonymity reasons.
Which file formats can I import?
Excel and CSV as well as SPSS files including variable and value labels. Databases can also be connected directly and data loaded via REST API, so ongoing studies update automatically.

Your data, analysed

Upload your raw export and look at the crosstabs, dashboard and PowerPoint before you set anything up. 14 days free, no credit card.