Summary

Summary

The 'DASHBOARD' - 'Summary' tab gives an overview of the status and progress of the survey:

  • Basic info: name of the survey, type of survey, number of questions, variables, units and pages, language of the survey, who created and modified the survey and when, period of survey activity, duration of the survey, when the first and last entry was made and if there are any comments.
  • Survey redirections: number of clicks, list of redirects (from which website the respondent accessed the survey) and list of IP numbers.
  • Survey status: information on the status of the survey (partially completed, completed), how many relevant units and how many non-relevant units (how many clicks on the survey and how many clicks on the address). More >>
  • Timeline: how many surveys were completed at a given time (day, week, month, etc.).
  • Response rate: cumulative status (clicked on the intro, clicked on the survey, started, partially completed and finished), frequency and rate of these statuses. More >>
  • Response by pages: number of clicks on each page of the survey and number of clicks for the cumulative statuses mentioned above. The progress by page can be filtered by the following statuses: entered intro, entered survey, started responding, partially completed and completed.

 

<< Back to DASHBOARD

The Response Rate

In the 'DASHBOARD' tab, you can view information about your survey, survey referrals, the status of the survey, the survey’s timeline, responses by pages, as well as the response rate.

The section 'Response rate' displays the cumulative status according to the following statuses:

  • Entered intro: every click on the survey is counted, regardless of whether the survey is fully completed or if the respondent left the survey immediately after clicking on the link to it.
  • Entered first page: every respondent who clicked on 'Next page' at least once is counted.
  • Partially completed: each respondent who answered at least one question is counted.
  • Completed: each respondent who clicked on the 'End' button on the last page of the survey is counted.

If the respondent has not answered any questions before leaving the survey (either in the middle of the survey or after clicking the 'End' button), then the survey is given a status of Partially empty (5l) or Completely empty (6l), where the additional letter 'l' refers to the respondent's lurker status.

Response rates are further detailed in this DIAGRAM.

 

 

Referrals

The 'Survey redirections' section of the 'DASHBOARD' tab shows how or from where the respondents accessed the survey and how many clicks were made from a particular link or web page.

There are four categories:

  • The domain name of URL: the list of websites through which the respondents accessed the survey;
  • Direct link: includes clicks from email invitations that have been sent through the 1KA system, and all direct entries (typing or copy-pasting) of the URL of your survey;
  • 1KA Email - response: includes clicks from email invitations that have been sent through the 1KA system;
  • 1KA Email - non-response: includes the number of email invitations that have been sent through the 1KA system, where the respondent has not yet clicked on the link to the survey.

The following details are also available:

  • List of referrers: detailed URLs of websites;
  • List of IP numbers: a list of respondents' IP numbers, where it is important to note that this list is in no way linked to the survey data. As defined in our Privacy Policy, IP addresses are recorded separately and only for the purpose of counting respondents, and therefore cannot be linked to respondents' answers in the database.

 

Related content

Status of Units, Relevance, Validity and Missing Values

a) Unit nonresponse

Fully completed (status 6) or partially completed surveys (status 5) are identified as VALID SURVEYS (units) throughout the data analysis. These surveys contain at least some partial answers of the respondents, while blank surveys and survey that have only been viewed and not answered are excluded.

All other survey statuses (e.g. 0, 1, 2, 3, and 4) and surveys that don't contain responses, are identified as INVALID SURVEY (units) and are therefore excluded from the analysis by default, although they can be important in the analysis of non-response bias and the survey completion process.

Therefore, only valid survey units (fully and partially completed, status 5 and 6) are included in the data analysis by default. The 1KA tool also offers the option of including other statuses (in addition to status 5 and 6) in the analysis. To do this, navigate to the 'Filtering' option in the 'DATA' tab and click on the button 'Statuses'. The tool has elaborated statuses of units which are presented with the following values of responses:

  • E-mail – not sent: the e-mail was not sent to this person – '0';
  • E-mail – non-response: the respondent did not respond to the questionnaire, which was sent by e-mail – '1';
  • E-mail – error: an error occurred when sending the questionnaire to the e-mail address – '2';
  • Click on the introduction: the respondent only clicked on the introduction (invitation to the survey) and left the survey immediately after. Either the person did not intend to complete the survey or the introduction page was not convincing enough – '3';
  • Entered first page: the respondent only clicked on the introduction page and then on the second page of the survey. The person did not answer the first question and did not continue with the next page of questions – '4';
  • Partially completed: the respondent partially completed the survey, i.e. responded to at least one or several questions and afterwards left the survey, resulting in a break-off. Thus the person did not click on the END of the survey button – '5';
  • Partially blank: the respondent left the survey without any answers (blank survey). In this case we have a blank survey that resulted in a break-off – '5l';
  • Completed survey: the respondent completed the survey (clicked on the ‘END of the survey’ button) and answered at least one question or possibly all of the questions – '6';
  • Entirely blank: the respondent skipped all the questions without answering and clicked on the ‘END the survey’ button – '6l';
  • Unknown status of survey: survey has a certain value – 'null'.  

If the respondent only clicked through the survey and did not answer any of the questions (i.e. viewer or lurker), the survey will be marked by a survey status that is specific to the 5 and 6 statuses. If the respondent came to the end of the survey, but did not answer any of the questions, this would be marked as survey blank (marked by 6I). In the mentioned case, all respondents' answers would be assigned value '-5'. If the respondent went through only a part of the survey (making the survey partially answered with the status 5),  the ‘not answered’ questions would be assigned the value -5, and the answers after leaving the survey would be assigned '-3', and the survey is marked blank and partially (not) completed (5I).

b) Item nonresponse

If the respondent does not answer certain questions, the following values are automatically generated:

  • '-1' – the respondent completed the survey, but did not answer a specific question;
  • '-2' – the respondent did not answer a specific question because of an inserted condition, e.g. the question was intended only for women; men would therefore skip it;
  • '-3' – all questions that remained after the respondent left the survey;
  • '-4' – all questions that were added after the respondent had already completed the survey;
  • '-5'  all questions when a respondent did not answer any of the questions but only viewed the whole questionnaire or left in the middle of the survey.

c) Valid and missing responses

Missing values (as described in section b) have negative values in the database and are excluded from the analysis by default (but can also be included in the analysis). Missing values can be viewed in the Frequencies – Descriptive statistics under MISSING VALUES. Some analysis (e.g. Averages) do not take other missing responses into account. Namely, you can offer respondents the following options:

  • Do not know (-99): the person did not know the answer to the question;
  • Refusal (-98): the person refused to answer the question;
  • Invalid (-97): the person replied with an invalid answer.

Answers Do not know (-99), Refusal (-98) and Invalid (-97), together with the other missing values (indicated by negative values, e.g. -1, -2, -3, -4, -5), are invalid answers in the statistical analysis. The analysis only takes VALID VALUES (i.e. greater than zero) into account.

The importance of marking all of the aforementioned negative values is very important because such values are not taken into account in the certain analysis (e.g. Average). If you want to change the default missing values settings, you can change them in the 'EDIT' - 'Settings' - 'Missing values' tab.

You can change the typical response values of categorical variables (default values are 1, 2, 3, 4, 5 ...) before collecting data in the advanced question editor (an icon for advanced editing of individual question categories).

d) Recoding questions

Recoding is available to users of the individual 3KA package for individuals and users of business packages for groups. If you want to change the value of collected answers, do so by editing the question by clicking on the 'DATA' - 'Computations' - 'Recoding' tab by clicking on the 'Edit values' checkbox in the 'Basic' tab. A new window will open with a table where you can first select how you want to recode - into the same or a new variable, and then select the values from the drop-down lists at the bottom of the table. In addition to the valid values, the drop-down list also contains options for no answers and undefined answers. For example, if you have questions on a scale of 1-5 and you have marked the answer 'I don't know' with 8, you can subsequently mark the value 8 as the missing value 'I don't know'. This is then treated in the same way as 'I don't know' (-99), i.e. it is not taken into account in the calculation of the average.


Some of the features described are available to users of the 3KA package for individuals and users of business packages for groups.


Related content

1KA is free to use for basic users