Allow us to introduce the Thematic Analysis Tool, ensuring you get the most out of qualitative feedback.
When you use the occasional ‘freetext’ question in your surveys, how do you analyse the results?
We know that you will all have your own methods in place. As we always say, the arts and cultural sector is anything but homogeneous!
If there are just a few responses, you could, of course, read and consider them yourself. However, if there are hundreds (or more!), it is likely that you won’t have capacity to read and analyse all of them. This can result in unintentional biases coming through your analysis or important insights being missed.
To avoid this, we know that some of you will have dabbled with artificial intelligence (AI) before now, but we also know that there may be a lack of confidence or certainty around it. We’re aware that some of you have popped responses into an AI tool and been less than impressed with the results – the reliability can leave a lot to be desired!
That’s why the team at CWC has developed the Thematic Analysis tool, designed specifically to help you confidently make sense of rich, qualitative feedback.
What does the Tool do?
The Thematic Analysis tool provides the user with:
- a summary of freetext responses
- a breakdown of themes present in them
- a chart that shows the frequency of these themes…
Furthermore, you can download this in the form of a CSV to conduct further analysis.
As you should expect of us, a lot of work has gone into the creation of this tool. We have tested it using both ‘real’ (with the owners’ permissions, of course) and erroneous data. The results of the testing are good.
We use OpenAI to conduct the analysis and it’s important to know that only a list of answers to the question you choose to analyse will be shared with OpenAI and nothing more e.g., no answers to any other questions; no information about the respondent; no information about your organisation; no information about the survey, the event etc… We will share more information about the use of AI with you when you express interest in the tool.
Can anyone use the Tool?
It’s a tool readily available to all organisations participating in the Impact & Insight Toolkit project. However, because it carefully uses AI, we haven’t turned it on by default for everyone. Instead, you need to opt in to use it.
We’d love for more organisations to benefit from this functionality.
Where to from here?
If you would like more information on the tool or to ask us to switch it on for your Toolkit account, please express your interest via [email protected]
If you would like to know more about CWC’s stance on the use of AI, please take a moment to read our short blogpost on the matter.
If you would like to see the ‘how to’, please check out the relevant guidance.
We are excited to support you obtain further insight into your offers and develop accordingly.
Image credit – NordWood Themes on Unsplash