Peer review is a large subject and so in order to direct you to the most pertinent information, please click the button below that best describes you or select an item from the table of contents.
Peer review is a vital element of the Impact & Insight Toolkit. The Toolkit works by asking audiences, participants and peer reviewers what they think of a cultural event or project and comparing this with the organisation’s original objectives for the work.
Peer review provides fresh professional perspectives from people that aren’t involved in the internal development of projects and enables organisations to understand how their work is perceived within their artform or specialist field. Organisations are interested to see how peer responses compare with the views of regular audience members and participants.
The ‘triangulation’ of self, peer and public views gives organisations a rounded appraisal of their work; it helps them to understand whether they are achieving what they set out to achieve, and how they can develop their work in the future.
Peer review is also valuable for peers themselves. It enables them to experience different types of work, and to explore how their own practice relates to what others in their field are doing. We hope that by expanding and diversifying peer review, the Impact & Insight Toolkit will help cultivate stronger professional networks across the sector, creating a supportive, challenging and stimulating environment for arts and culture to thrive.
This page provides guidance to organisations that are looking for peers to review their work and to organisations that would like to nominate staff members to act as peer reviewers. It provides an overview of the peer review process, from start to finish, and concludes with some guiding principles of peer review. For more detailed information about using the Peer Matching Resource please see our step-by-step guide. If you are an individual who is interested in becoming a peer reviewer, see our separate guide Peer Review for Professionals.
If you have an event or project that you are planning to evaluate using the Impact & Insight Toolkit, you will need to identify and invite suitable peers to review the work. You need at least one peer reviewer per event; we normally recommend that you engage three to five peers.
In a nutshell, a peer reviewer is someone whose opinion you value. You are looking for someone who you think can offer useful insight as well as a fair, informed critique of your work. You should choose individuals who are not invested in the specific work you are evaluating, and you may want to look beyond the ‘usual suspects’ to access perspectives on your work that you might not normally hear.
The type of professional who you would like to hear from will vary from event to event. For example, if you are evaluating an education performance or project involving schoolchildren, teachers observing the work may be ideal peer reviewers. A company that is evaluating a piece of physical theatre around environmental themes may want to approach a physical theatre practitioner and/or someone with expertise in communicating environmental issues to the public.
If you decide to approach multiple peer reviewers, try and choose people with a variety of expertise, experience and specialisms. Having a diversity of peers reviewing your event will offer you a well-rounded perspective of your evaluation. It is also worth considering peers’ locations when choosing; if they are far away, you will need to consider the cost of reimbursing them for their travel costs and time.
To find a suitable peer to review an event, the first place we would encourage you to look is within your own professional networks. Your networks may contain people from local arts organisations, touring companies, independent artists and academic institutions, amongst others. By engaging with your current contacts, you are acknowledging the value you place on their professional opinions of your work.
Within the Culture Counts platform, the peer matching resource allows you to search for peers. You may browse and filter a list of creative professionals who have registered their interest in participating as a peer reviewer. They may be working with an Arts Council funded organisation that is registered to use the Impact & Insight Toolkit, or they may have signed up as an external individual interested in being part of the project.
When selecting your peer reviewers, we would recommend that you engage with peers from both your own network and the new resource available to you, in order for you to achieve a well-rounded range of professional perspectives on your work.
The Culture Counts platform enables you to select a peer from the Peer Matching Resource and send them an invitation to review your event.
If you are approaching a potential peer reviewer who is not registered on the Impact & Insight Toolkit Portal, you may need to tell them a bit about the Impact & Insight Toolkit and the peer review process. You might want to share our guidance on Peer Review for Professionals which explains what the Toolkit is, the benefits of being a peer reviewer, what peer review involves and how information provided by peers will be used. You will need to explain what event you are asking them to review and provide some basic information about the event such as date and location. If a peer who is not registered on the Peer Portal agrees to review your event, you can add their email address to the Culture Counts platform using the box towards the bottom of the ‘Invite’ page of your dashboard. This will enable you to later distribute surveys to your peer.
Once a peer has agreed to review your event, you may choose to email the reviewer with further information about the event. We suggest that you provide enough information to enable peers to understand the aims and intentions behind the work, and where you see the work sitting within your overall programme. Some events may need more explanation than others; some peers – particularly those who don’t know your organisation well – may need more information than others.
It is likely that you will need to arrange a time for each peer to come and see the work and make tickets available as required.
Peers on the Peer Portal are under no obligation to accept invitations to review work; if you approach someone who is unable to review your event, we suggest that you look again within your existing networks or the Peer Portal.
Once a peer has attended your event, you will need to send a survey to capture their feedback. The ‘Summary’ page will show all the peers in the portal who have accepted the invitation to review your event, and any other peers who you have approached outside of the portal and whose email addresses you provided on the ‘Invite’ page. From the ‘Summary’ page you can email the survey to each peer using a URL specific to that individual peer.
If you are using the Impact & Insight Toolkit to evaluate a participatory project, then you will need to consider whether peer review is appropriate. If the participatory process results in a performance or exhibition, you may want that event to be reviewed by a suitable peer. Alternatively, you may find it useful to invite a peer to observe and give feedback on elements of the participatory work. However, in some cases it may not feel appropriate or useful to include an outside observer – for example if you are working with very small groups, over long time periods and/or on sensitive themes. In these instances, your participatory evaluation would include self and participant assessment only. Please contact email@example.com if you would like more advice on evaluating participatory work.
If you are a practitioner working in or with the arts and cultural sector, you are welcome to register as an Impact & Insight Toolkit peer reviewer, regardless of whether you work at an Arts Council funded organisation. To find out more, visit our guide Peer Review for Professionals.
The chart below provides a summary of the overall peer review process, distinguishing between actions for organisations and actions for peer reviewers.
Figure 1: Summary of Impact & Insight Toolkit peer review process
This final section proposes some principles of peer review that relate to everyone involved in the Impact & Insight Toolkit, including the Arts Council as funder; Counting What Counts as provider; organisations looking for peers to review their work; individuals wishing to contribute as peer reviewers.
The Impact & Insight Toolkit encourages participating organisations to select peers to review their work, providing unique and well-informed perspectives. Band 2 and Band 3 NPOs are required to nominate at least one peer reviewer from their organisation to the Peer Matching Resource database so that other participating organisations can invite them to act as peer reviewers. It is not compulsory for other Toolkit users (i.e. Band 1 NPOs, SSOs, etc.); however, they are welcome to register peers if they choose.
Being invited to review an organisation’s work means that your professional opinions are highly valued; the host organisation considers you to be an expert in your artform or specialist area and well placed to offer feedback on their work. The peer’s role is to experience the work of an organisation (for example, a show, a concert, an exhibition or a publication) and respond to an Impact & Insight Toolkit survey.
Organisations may be keen to nominate staff members to act as peer reviewers for other organisations, both to provide individual professional development opportunities and to bring learning back into the organisation. If you are a Band 2 or 3 NPO, ACE requires your organisation to be available to provide a minimum of four peer reviews per year. These assessments can be carried out by one staff member or shared out between multiple staff members. There is no limit to the number of people you can nominate from your organisation to act as peer reviewers – you may want to put forward someone from your creative team, say, and someone with education or audience development expertise.
To nominate someone from your organisation, you will need to tell them a bit about the Impact & Insight Toolkit and the peer review process. You might want to share this guide which explains the basics.
If your staff member is happy to become a peer reviewer, they will need to register their details. In your Culture Counts dashboard, open an evaluation and go to the ‘Invite’ page. Here you can register yourself or a colleague as a peer reviewer by clicking Register a Peer. If you would like your staff members to upload their own details, you can copy and share your organisation’s bespoke peer registration link.
Arts Council England suggests:
‘As a recommendation towards meeting your minimum requirements as an NPO (4 peer evaluations which can be carried out by different nominated peers from your organisation), that you accept peer evaluation requests across each year based on capacity and other commitments. You may choose to balance evaluation visits equally across the year, for example by accepting one each quarter and planning in advance when throughout the 12-month period you are available to accept requests. Provided that you have completed your minimum reviews as stated in your funding agreement, you are under no obligation to accept further requests where capacity and resource are limited. However, where peers do have capacity available, you can accept and complete a number of additional reviews for other organisations to support the initiative.’
If you would like to register as an Impact & Insight Toolkit peer reviewer and are not part of a participating organisation please contact firstname.lastname@example.org to arrange for your details to be uploaded to the Impact & Insight Toolkit Peer Matching Resource.
The information you provided will now be visible to registered users of the Impact & Insight Toolkit. From time to time you may be invited to attend and review events. When you receive an invitation, you can accept or decline at your discretion by clicking on the Manage response button. Invitations are always sent to you via email; please do not try logging in to Culture Counts unless you are an existing user of the platform.
Once you accept an invitation, you may coordinate the logistics of your visit and direct any questions to the contact person listed in your invitation. After attending the event, you will be asked to complete a short online survey. The survey will take about ten minutes to fill in, depending on how much information you wish to provide.
If you need to cancel, you can do so through the Manage response button in your invitation. You can also let them know by sending a courtesy email using the contact details provided.
You may have already been invited to attend and review events. If you have not, we recommend that you please add email@example.com to your ‘safe senders’ list within your email client and that you check your spam folder to ensure that no invitations go ignored.
If you need to change any information in your profile, or would like to be removed at any time, please contact firstname.lastname@example.org and one of our team members will gladly assist you.
Powered by BetterDocs