Toolkit Checklist

tick markWelcome to the Culture Counts platform. There are a number of tasks to complete before you can begin your evaluation. View/download a PDF version with images here.

1. Choose Your Event

Choosing your event to evaluate wisely is vital to achieving useful outcomes and data.  Generally, we recommend evaluating a variety of works from your annual programme to enable comparison; however, if you’re uncertain, you are welcome to get in touch and we will discuss it with you individually.

2. Log into your Account

Access the Impact & Insight Toolkit website.  Clicking on ‘Sign in’ and, using the details provided by a member of Counting What Counts team, enter the Culture Counts platform and see your dashboard.

3. Create Your Own Evaluation

Clicking on the ‘New evaluation’ button, give a name to your own evaluation e.g. the name of the work you will be evaluating.  You can then opt to base your evaluation on a template, or create your own from scratch.  Basing an evaluation on a template is recommended if you are carrying out your evaluation to fulfil a funding requirement as, this way, you will know that the evaluation is formatted correctly. There will be several templates for you to choose from, so do select the one which is most appropriate for you and your funding arrangements.  For information on how to do this, please see the Platform Guide.

4. Add Your Evaluation Properties

To add your evaluation properties, you will need to click on the ‘Properties’ button, on the front page of your evaluation.  Scroll down the page to add details to your evaluation which will aid further analysis and help to generate insight regarding the value of different experiences.  Details include: artform(s), event location and attendance numbers.

5. Begin to Customise Your Surveys: Configuring

Clicking on a survey and selecting the ‘Configure’ tab at the top of the webpage, you can begin to customise it.  We always suggest you ensure that:

  • the title is appropriate for your work and respondents
  • your survey introduction is accurate and relevant to the work you’re evaluating
  • the delivery method(s) selected are appropriate for you and your respondents

There are further options available such as adding a logo; adding opening/closing dates; adding a redirection link for once the respondent has completed their survey. All of these options are explained in the Platform Guide.

6. Choose Your Dimensions and Custom Questions

From the ‘Design’ tab, you are able to add questions to your survey; if you have used a template you will see some pre-selected questions.  Culture Counts uses standardised metrics known as dimensions, which allow for comparison across events and across organisations nationally and internationally.  By using these dimensions in surveys, organisations contribute to an aggregate dataset which can be used for analysis and benchmarking.  Each dimension describes a different aspect of event impact so you may choose different dimensions depending on the event.  Different funding bodies and programmes may have pre-selected a set of dimensions for you.  Please check the guidance specific to your arrangement to ensure that no required dimensions are missed.

National Portfolio Organisations (Bands 2 and 3)

Creative People and Places

Museums Development Network

You can also add custom questions to surveys that reflect areas of specific interest for your organisation.  There are various question formats you can select, such as yes/no, multiple choice and free text.  You can also browse and insert additional dimensions.

Please see the User Guide for more advice on how to evaluate thoughtfully and get the most valuable data out of your surveys.

notebook writing

7. Choose and Contact Potential Assessors

The Culture Counts platform has a three-pronged evaluation process – involving peer, self and public assessors.  If the survey you’re working on is for public respondents, you can skip this section.  If the survey you’re working on is designed for peer and/or self assessors, you will need to use the Invite tab.  It is here that you will record their email addresses and generate survey links for each assessor.

A. Peer Reviewers

You will need to think about which peers you would like to engage. There is no maximum number of peers that can review you work but we recommend at least three. Peers need to be contacted in advance prior to sending them a survey. For more information, please see our resources on peer review.

B. Self Assessors

Also consider who you would like to nominate to respond to the self-assessment survey.  This can be just one person in your organisation, or, better still, a range of key individuals involved in the offering’s production or programming.  In this way, self-assessors might include the artists, curators, or education staff within your organisation.

8. Survey Delivery

On the ‘Summary’ tab, links are displayed for distribution to public respondents.   The surveys can be delivered via email using weblinks, through fixed tablets on site at your event, as well as intercept interviews and QR codes.  We suggest using a combination of methods, if feasible, to reduce particular survey biases and to maximise your sample size.  Please see the User Guide for a description of the different options.

The links for self and/or peer respondents are displayed lower down the page.  Surveys for self and peer respondents need to be delivered using the unique weblink which is generated by the system for each individual.  Please see the Platform Guide, which details how you do this to ensure your responses are categorised correctly.

9. Explore the Automated Report

Having collected your data, you will be able to see the outputs in real-time in your Reporting Dashboard.  A variety of graphs are automatically generated to assist you to understand your results.  You can also export your results in a CSV format, PDF format or as images in a zip folder.  This dashboard is always being updated and so additional graphs may be visible over time.

 

Go back to Support Materials

 

Image Credit: Glenn Carstens-Peters via Unsplash

The information on this page was last updated on 29 April, 2020.

X
X