Skip to content
Open
Changes from 2 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
80 changes: 80 additions & 0 deletions User Engagement Lead/survey_questions.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,80 @@
# Survey questions

## Readme

This survey aims at evaluating users’ experiences with ESMValTool and
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we also articulate some outcomes we want to achieve, something more specific than is in the text?

discovering users’ needs. It is meant for the users of ESMValTool in all levels
of expertise. Some criteria to design the questions:

- It does not take more than 10 (?) minutes
- It does not have overlapping questions
- It does not include questions with yes/no answers
- It does not collect personal data, but it has some profiling questions
- It covers different aspects of ESMValTool like application, usage, documentation and community

The survey can be implemented in a survey app like surveymonkey that does not
collect personal data. The owner is “user engagement team”. They will
edit/run/evaluate the survey and communicate the results to other teams if
needed.

## Survey content

Hi! We in [ESMValGroup](https://www.esmvaltool.org/), would love to hear about
your research and experiences using ESMValTool. Here, there are a few questions
which help to create your story. Your answers will help us to improve ESMValTool
and hence enhance the science that you conduct. All responses are recorded
anonymously. Let’s being:

**Describe your research/case study and challenges:**

1. Can you describe your research/case study?
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A couple of questions here: Can a user have more than one case study? I do for example. Are they allowed to mention more than one? How much detail do we expect? Is the time estimated (10 minutes )sufficient for that?
Should we provide some use cases and have an other option if theirs doesn't fit into any or all of them?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

From a survey analysis perspective, what would be learnt by asking this question? Would knowing the details about a user's specific research be useful? Would it be enough to know whether they use ESMValTool for atmosphere, ocean, etc diagnostics, or for real time model evaluation, or for creating plots for IPCC reports, etc.? Would it be worth adding multiple choice answers for this?

2. Can you underline the challenges in your research/case study?
3. How would you categorize your expertise level in using ESMValTool? (Beginner,
competent practitioner, expert)

**Software:**

ESMValTool provides many features and functions to analyze data for Earth system
models.
[Here](https://docs.esmvaltool.org/projects/esmvalcore/en/latest/recipe/preprocessor.html#preprocessor)
you can find a list of preprocessors.

4. Which features/functions in ESMValTool do you think are most useful for your
research/case study?
5. How satisfied are you with the software's:
- Ease of use (1-10)
- Development workflow (1-10)
- Reliability (1-10)

**Documentation and tutorial:**

ESMValTool [documentation](https://docs.esmvaltool.org/en/latest/) covers
different aspects of research: How the code work, how to obtain and process
data, and what are best practices in developing code. There is also an online
[tutorial](https://esmvalgroup.github.io/ESMValTool_Tutorial/) that shows not
only how to run an experiment but also how to develop your own code.
If you are familiar with documentation and tutorial, please tell us:

6. What are the most useful parts?
7. What topics are missing that you want to learn about?
8. How much do you agree with the following statements?
- It is easy to find relevant information from the documentation. (1-10)
- The instructions in the documentation and tutorial are complete and easy
to follow. (1-10)
- I can immediately apply what I learned from the tutorial. (1-10)

**Community:**

ESMValTool provides [different
platforms](https://docs.esmvaltool.org/en/latest/introduction.html#support) to
communicate with users and researchers: mailing list, github issues, discussion
page.

9. If you have used any of these, please tell us how much do you agree with
the following statements?
- I felt comfortable asking my questions using these platforms. (1-10)
- I was able to get clear answers to my questions from the community. (1-10)
10. What suggestions do you have for improvements, or any other relevant input for us?


Thank you for helping us to build the ESMValTool that you like.