Usable respondents
The Response Rate
In the 'DASHBOARD' tab, you can view information about your survey, survey referrals, the status of the survey, the survey’s timeline, responses by pages, as well as the response rate.
The section 'Response rate' displays the cumulative status according to the following statuses:
- Entered intro: every click on the survey is counted, regardless of whether the survey is fully completed or if the respondent left the survey immediately after clicking on the link to it.
- Entered first page: every respondent who clicked on 'Next page' at least once is counted.
- Partially completed: each respondent who answered at least one question is counted.
- Completed: each respondent who clicked on the 'End' button on the last page of the survey is counted.
If the respondent has not answered any questions before leaving the survey (either in the middle of the survey or after clicking the 'End' button), then the survey is given a status of Partially empty (5l) or Completely empty (6l), where the additional letter 'l' refers to the respondent's lurker status.
Response rates are further detailed in this DIAGRAM.
1KA Registration and Login
You can register for the 1KA online tool (create an 1KA user account) using your email address or your Google account.
You can then use this account to log in to the 1KA tool.
Status of Units, Relevance, Validity and Missing Values
a) Unit nonresponse
Fully completed (status 6) or partially completed surveys (status 5) are identified as VALID SURVEYS (units) throughout the data analysis. These surveys contain at least some partial answers of the respondents, while blank surveys and survey that have only been viewed and not answered are excluded.
All other survey statuses (e.g. 0, 1, 2, 3, and 4) and surveys that don't contain responses, are identified as INVALID SURVEY (units) and are therefore excluded from the analysis by default, although they can be important in the analysis of non-response bias and the survey completion process.
Therefore, only valid survey units (fully and partially completed, status 5 and 6) are included in the data analysis by default. The 1KA tool also offers the option of including other statuses (in addition to status 5 and 6) in the analysis. To do this, navigate to the 'Filtering' option in the 'DATA' tab and click on the button 'Statuses'. The tool has elaborated statuses of units which are presented with the following values of responses:
- E-mail – not sent: the e-mail was not sent to this person – '0';
- E-mail – non-response: the respondent did not respond to the questionnaire, which was sent by e-mail – '1';
- E-mail – error: an error occurred when sending the questionnaire to the e-mail address – '2';
- Click on the introduction: the respondent only clicked on the introduction (invitation to the survey) and left the survey immediately after. Either the person did not intend to complete the survey or the introduction page was not convincing enough – '3';
- Entered first page: the respondent only clicked on the introduction page and then on the second page of the survey. The person did not answer the first question and did not continue with the next page of questions – '4';
- Partially completed: the respondent partially completed the survey, i.e. responded to at least one or several questions and afterwards left the survey, resulting in a break-off. Thus the person did not click on the END of the survey button – '5';
- Partially blank: the respondent left the survey without any answers (blank survey). In this case we have a blank survey that resulted in a break-off – '5l';
- Completed survey: the respondent completed the survey (clicked on the ‘END of the survey’ button) and answered at least one question or possibly all of the questions – '6';
- Entirely blank: the respondent skipped all the questions without answering and clicked on the ‘END the survey’ button – '6l';
- Unknown status of survey: survey has a certain value – 'null'.
If the respondent only clicked through the survey and did not answer any of the questions (i.e. viewer or lurker), the survey will be marked by a survey status that is specific to the 5 and 6 statuses. If the respondent came to the end of the survey, but did not answer any of the questions, this would be marked as survey blank (marked by 6I). In the mentioned case, all respondents' answers would be assigned value '-5'. If the respondent went through only a part of the survey (making the survey partially answered with the status 5), the ‘not answered’ questions would be assigned the value -5, and the answers after leaving the survey would be assigned '-3', and the survey is marked blank and partially (not) completed (5I).
b) Item nonresponse
If the respondent does not answer certain questions, the following values are automatically generated:
- '-1' – the respondent completed the survey, but did not answer a specific question;
- '-2' – the respondent did not answer a specific question because of an inserted condition, e.g. the question was intended only for women; men would therefore skip it;
- '-3' – all questions that remained after the respondent left the survey;
- '-4' – all questions that were added after the respondent had already completed the survey;
- '-5' – all questions when a respondent did not answer any of the questions but only viewed the whole questionnaire or left in the middle of the survey.
c) Valid and missing responses
Missing values (as described in section b) have negative values in the database and are excluded from the analysis by default (but can also be included in the analysis). Missing values can be viewed in the Frequencies – Descriptive statistics under MISSING VALUES. Some analysis (e.g. Averages) do not take other missing responses into account. Namely, you can offer respondents the following options:
- Do not know (-99): the person did not know the answer to the question;
- Refusal (-98): the person refused to answer the question;
- Invalid (-97): the person replied with an invalid answer.
Answers Do not know (-99), Refusal (-98) and Invalid (-97), together with the other missing values (indicated by negative values, e.g. -1, -2, -3, -4, -5), are invalid answers in the statistical analysis. The analysis only takes VALID VALUES (i.e. greater than zero) into account.
The importance of marking all of the aforementioned negative values is very important because such values are not taken into account in the certain analysis (e.g. Average). If you want to change the default missing values settings, you can change them in the 'EDIT' - 'Settings' - 'Missing values' tab.
You can change the typical response values of categorical variables (default values are 1, 2, 3, 4, 5 ...) before collecting data in the advanced question editor (an icon for advanced editing of individual question categories).
d) Recoding questions
Recoding is available to users of the individual 3KA package for individuals and users of business packages for groups. If you want to change the value of collected answers, do so by editing the question by clicking on the 'DATA' - 'Computations' - 'Recoding' tab by clicking on the 'Edit values' checkbox in the 'Basic' tab. A new window will open with a table where you can first select how you want to recode - into the same or a new variable, and then select the values from the drop-down lists at the bottom of the table. In addition to the valid values, the drop-down list also contains options for no answers and undefined answers. For example, if you have questions on a scale of 1-5 and you have marked the answer 'I don't know' with 8, you can subsequently mark the value 8 as the missing value 'I don't know'. This is then treated in the same way as 'I don't know' (-99), i.e. it is not taken into account in the calculation of the average.
Some of the features described are available to users of the 3KA package for individuals and users of business packages for groups.
Simple Survey
Video tutorial shows how to create and edit a simple survey in 1KA and how to manage the obtained data.
Usable respondents
The 'DASHBOARD' - 'Advanced statuses' - 'Usable respondents' tab contains a table with data on the quality of responses (variables) according to the unit record number. The key information is calculated on the basis of the assessment of usability of individual questionnaires.
A slightly simplified explanation is that the usability measures the portion of answers of each respondent; if the value is 100%, the respondent answered all of the questions, and if the value is 0%, they did not answer any questions. Respondents or questionnaires in the table are divided into 3 groups, where table rows are shaded in different colours:
- Fully completed and fully usable (white shading): questionnaires where the respondent answered all or almost all questions are by default in this group (more than 80% of the responses are usable).
- Partially completed and partially usable (yellow shading): questionnaires with more than 50% of usable responses are by default placed in this group.
- Inadequately completed and unusable (red shading): questionnaires with less than 50% of usable responses are by default placed in this group.
You can freely adjust the width of these categories through the settings 'Bottom limit' (unusable)' and 'Top limit (usable)' by clicking the 'Data table settings' button above the table. The default values are set to 50% and 80%. This means that questionnaires with less than 50% of usable responses are classified as unusable, between 50% and 80% as partially usable, and above 80% as completely usable.
In the ‘DASHBOARD' - 'Advanced statuses' - 'Usable respondents' tab, you can also generate detailed computations of respondent usability, which is based on the key criteria of questionnaire usability.
In the same tab, you can also export the table of usable respondents in Excel, by clicking on the icon for export, located in the right corner of the menu bar.