Answer Option Randomisation

It can be beneficial to randomise or shuffle the display order of the answers to questions to reduce bias.

Randomising Answer Order

When creating or editing a question, tick the box marked "Randomise, Sort, or Flip answer choices"

You can choose from one of three options:

  • Randomise: Each time the page is loaded, the answer options will be displayed in a randomly-assigned order.
  • Alphabetically Sort: Display the answers in alphabetical order, regardless of the order they're entered in the question's settings.
  • Flip for Each Respondent: each respondent is show either the answer options in the order defined in the question editor, or the reverse of that order.

Regardless of which option is chosen, then the following setting can be toggled via the checkbox:

  • Do not randomise the last answer choice: This is useful where the last option in a list is "Other" or "None of the above" and it would not make sense for this to be included in the shuffled or flipped order.

Was this guide helpful?