Overview issue on preparing REF recipes for CMIP7

[bouweandela]

Both the recipe and diagnostic in ESMValTool need to be able to handle CMIP7 data and the code the writes the recipe in the REF need to be able to handle CMIP7 data. Therefore, it is recommended to

1. create a CMIP7 version of the recipe that can be run with (fake) CMIP7 data, e.g. fake CMIP7 data created as described in https://github.com/WCRP-CMIP/cmip7-cmor-tables/blob/main/Simple_recmorise_cmip6-cmip7.ipynb, or real CMIP7 data as the new ESGF comes online and data starts to get published
2. check the correctness of the CMIP7 recipe writing code in the REF

CMIP7 readiness checklists

Checklist for observational/reanalysis data

• If the recipe uses simulations from the historical experiment and reference data, ensure the reference data is available until 2021 (the CMIP7 historical experiment runs until 2021 instead of 2014):
  • through ESGF/obs4MIPs
  • as ESMValTool CMORized data -> this needs to be uploaded to a specific server by @bouweandela, so please let him know where the data is on Levante and which recipe needs it

Checklist for ESMValTool

• Check if the diagnostic script can handle CMIP7 data: some variables have been renamed (e.g. tasmax) by running a CMIP7 version of the recipe with ESMValTool

Checklist for the REF recipe writing code (example recipes written by this code are here):

• If the recipe specifies a timerange, check that it is correct for CMIP7. Example: https://github.com/Climate-REF/climate-ref/blob/3697968f2e31bf1e194f53c40937511f1755101a/packages/climate-ref-esmvaltool/src/climate_ref_esmvaltool/diagnostics/cloud_radiative_effects.py#L81-L84
• Check that the correct realm and branding_suffix are specified in the CMIP7 version of the recipe as generated by the REF
• Check that the correct experiments are specified in the CMIP7 version of the recipe as generated by the REF, there may be differences

Testing the REF

The ref provides 'test cases' that can be used to test with fake CMIP7 data, however, this code has various limitations. To run a ref test case, you can run the command:

ref test-cases list

to see the available test cases and e.g.

ref test-cases run --provider esmvaltool --diagnostic equilibrium-climate-sensitivity --test-case cmip7 --fetch --force-regen --clean

to run them.

To get started with the REF, follow these steps:

git clone git@github.com:Climate-REF/climate-ref.git
cd climate-ref
uv sync
. .venv/bin/activate
ref providers setup --provider esmvaltool
mkdir ~/esmvaltool_config_ref
export ESMVALTOOL_CONFIG_DIR=$HOME/esmvaltool_config_ref

more complete instructions in the REF docs

Overview of diagnostics and linked issues

diagnostic	recipe	issues	CMIP7 recipe available in ESMValTool	REF code is up to date
climate-at-global-warming-levels	recipe_calculate_gwl_exceedance_stats.yml
climate-drivers-for-fire	ref/recipe_ref_fire.yml	#4423 Climate-REF/climate-ref#670
cloud-radiative-effects	ref/recipe_ref_cre.yml	Climate-REF/climate-ref#653
cloud-scatterplots-*	ref/recipe_ref_scatterplot.yml	ESMValGroup/ESMValCore#3056
equilibrium-climate-sensitivity	recipe_ecs.yml	Climate-REF/climate-ref#647
enso-basic-climatology	ref/recipe_enso_basicclimatology.yml
ozone-*	ref/recipe_ref_ozone.yml
regional-historical-annual-cycle	ref/recipe_ref_annual_cycle_region.yml
regional-historical-timeseries	ref/recipe_ref_timeseries_region.yml
regional-historical-trend	ref/recipe_ref_trend_regions.yml	#4435
sea-ice-area-basic	ref/recipe_ref_sea_ice_area_basic.yml
sea-ice-sensitivity	recipe_seaice_sensitivity.yml
transient-climate-response	recipe_tcr.yml	Climate-REF/climate-ref#647
transient-climate-response-emissions	recipe_tcre.yml	Climate-REF/climate-ref#647
zero-emission-commitment	recipe_zec.yml