Creating Your First Evaluation

Having received your login details from the Counting What Counts team, you will be able to access the Impact & Insight Toolkit at this address: https://impactandinsight.co.uk

Once here, click “Sign In” to access the Culture Counts platform.

Culture Counts Sign in page

Once you’ve logged in to your account, this guide will take you through the steps required to create a new evaluation and make your first survey.  Jump to:

What is an Evaluation?

Evaluations are folders that contain all the information for a particular event, project or place that you wish to evaluate, AKA your cultural offering. If you wish to create several related surveys to evaluate an event, they can all be grouped and organised within a single evaluation. In other words, one evaluation folder per cultural offering. The evaluation will store and present all the data collected through those surveys so that you can quickly see what your cultural offering is achieving overall.

Please note you can choose to do evaluations in addition to those that are required. When creating additional evaluations, you do not have to use Arts Council’s core questions; you can choose whichever questions you like.

 

Creating a new evaluation

Firstly, create a new evaluation for your cultural offering. This will be a new folder where you can create, manage and store surveys related to this offering; you can also download all of the data that is collected through these surveys.

To start a new evaluation, click the New evaluation orange button at the bottom left of your dashboard.

A ‘Create an Evaluation’ pop-up will appear and you will be prompted to give your evaluation a name; it should be the name of the event or offering you are evaluating.

In the Create an Evaluation pop-up you will also see a Evaluation template (optional) prompt. Here you have the option to select a pre-built template from the dropdown menu.  Each of these templates have been populated with a specific set of surveys and questions, and you will be able to use these as a starting point when building your evaluation.

If you are carrying out evaluations that you intend to submit to the Arts Council as part of your funding requirements, we recommend that you choose the template that is appropriate for your funding type; these templates have been set up to include all of the required surveys and questions. Using the right template will ensure that you fulfil all survey requirements set for you by the Arts Council.

Before you create your new evaluation using a template, you may preview the template by clicking the Preview button in the Create an Evaluation pop-up. No changes can be saved in the template preview mode; therefore, please close out of this tab before you proceed.

If you decide not to use a template, for example if you are carrying out a participatory evaluation or an evaluation that you do not intend to submit to Arts Council, you can leave the Evalation template (optional) section empty.

Once you are happy with the information in the Create an Evaluation pop-up, click Create Evaluation.

 

Developing an Evaluation from Scratch

If you have not chosen a template, you will need to create your first survey for your new evaluation by clicking on the orange Create survey button.

You will then be taken through the three main stages of survey creation:

  • Configure– to change the survey settings
  • Design – to edit, add or remove survey questions
  • Invite– to add or remove self and peer assessors

If you would like more information on adding more dimensions and custom questions you can find information and a support film* in the section entitled Designing Your Survey.

 

 

*Please note, the links above will take you away from the Impact and Insight Toolkit and to YouTube. Please ensure you are happy for this to happen before clicking and have familiarised yourself with their cookie and privacy policies.

 

Developing an Evaluation from a Template

If you have chosen to create your new evaluation from a template, you will now see the survey(s) from the chosen template in your new evaluation. From here, you may customise these surveys. We recommend customising each survey title to something that both people in your organisation and assessors will understand, like the name of the offering and the survey type: ‘Exhibition A – Public Survey’ or ‘Exhibition A – Prior Survey for Self Assessors’.

Click the name of the survey that you wish to customise and you will be taken to the survey Summary page, which shows a brief summary of the survey’s settings and inclusions. From here you can navigate to different pages in the survey builder by clicking the Manage button in the top right corner and selecting the appropriate page, or by clicking on one of the tabs in the top menu bar (dark grey). The editable pages include:

  • Configure– to change the survey settings
  • Design – to edit, add or remove survey questions
  • Invite– to add or remove self and peer assessors

Configuring Your Survey

The Configure page is where you set up the following options for your survey.

Survey Configure page on Culture Counts

Name

This is the survey name that respondents will see when they access the survey.

Start and Close Dates

The start and close dates will determine when the survey begins and stops taking entries.  It is fine to leave the start and close dates blank.  If you leave the start date blank, the survey will be available to record responses immediately, and if you leave the close date blank the survey will remain active indefinitely.  When inputting the start and close date, we advise that you include an additional one or two days either side of the official start and close dates of your event to ensure that you capture all available survey responses.

Survey Introduction

Here you can write a short optional introduction to your survey that will appear on the front page of your survey.  This introductory front page will only appear on the Online and Display survey delivery methods, as interviewers delivering the survey by using a Tablet  can verbally provide this information to respondents. This introduction is good place to provide a brief explanation to respondents, such as:

We’d love to hear what you thought. Please share your views on this event via our short survey. Your feedback will help us to understand and measure the impact of our events.

Custom Branding

Here you can upload your own logo, which will appear on the front page with the survey introduction text.

Survey Types

There are three survey types: Standard, Prior and Post.

  • Standard: The standard survey is for your general public audiences or visitors. Audiences are typically asked to complete a standard survey after experiencing an event or visiting a place, to measure the perceived impact of their experience.
  • Prior: Prior surveys allow you to record expectations of an event, to later compare with how it was actually perceived. We generally recommend that prior surveys are completed by self assessors to set up their objectives and creative intentions for the event.
  • Post: Post surveys are used to aid comparison between expectations and experience. Typically, self and peer assessors completed the post survey. Post event data can be compared with public data from the standard survey.

When creating prior and post surveys for the same respondent group within an evaluation, you could link them so that Culture Counts automatically copies any dimension questions used in one survey to the other.

If you create the prior survey first, you can complete this step when creating your post survey.  You will see a ‘Survey Link’ box to the right of your survey type input on the Configure page.  Select the correct prior survey from the Survey link dropdown list.  This will then sync your prior and post surveys so that details from the prior survey are copied across to the post survey.  To complete your post survey, click on the ‘Design’ tab and change the tense of the dimension statements from future to past from the dropdown options provided.

Delivery Types

This section allows you to choose how the survey will be delivered to the public respondents.  Culture Counts supports the following delivery types:

  • Online Survey: to be taken by respondents online via email, or on their own smart phones or devices. An online survey will only accept one response per device.
  • Interviewer: to be facilitated by an interviewer with a tablet computer. Interview surveys are resettable so that multiple responses can be recorded on one device.
  • Display: to be displayed on a device at a set location, such as a fixed podium or a library computer. Display surveys are resettable so that multiple responses can be recorded on one device.

Select all of the methods that you wish to use to deliver your survey. You can choose however many you wish.  A unique survey link will be created for each method and will be displayed clearly on the Summary page at the end of the survey builder.  For more information on the various delivery methods, please see the User Guide.

You will be presented with advanced options related to the delivery type(s) you have chosen, including:

  • A finish URL, which will redirect respondents to a specific website (e.g. your organisation’s homepage) on completion of the survey
  • A timeout, which will reset the survey if the respondent is inactive for a period of time
  • Access to survey tools, which will enable interviewers to access tools to support the interview process

Please note that all of the methods require an internet connection in order to collect data. 

*Please note, the links above will take you away from the Impact and Insight Toolkit and to YouTube. Please ensure you are happy for this to happen before clicking and have familiarised yourself with their cookie and privacy policies.

 

Go back to Support Materials

 

Continue browsing the Platform Guide by going back to the main menu or view/download a PDF version of the complete Platform Guide here.

The information on this page was last updated on 22 April, 2020.

X
X