Skip to content

updating and testing the new GPCP v3.3 obs4MIPs dataset#4434

Draft
hb326 wants to merge 1 commit into
mainfrom
update_GPCP_to_v3-3
Draft

updating and testing the new GPCP v3.3 obs4MIPs dataset#4434
hb326 wants to merge 1 commit into
mainfrom
update_GPCP_to_v3-3

Conversation

@hb326
Copy link
Copy Markdown
Contributor

@hb326 hb326 commented May 11, 2026

Description

In this pull request the new obs4MIPs dataset from GPCP (v3.3) is tested so that it can be used for REF.
The adjustments are done in a REF recipe.

The new obs4MIPs data for GPCP is available on Levante here:
/work/bd0854/DATA/ESMValTool2/download/obs4MIPs/GPCP-V3.3/v20260220/

At the moment the recipe fails due to problems with the data types after the preprocessing was done.

  • Closes #issue_number
  • Link to documentation:

Before you get started

Checklist

It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the 🛠 Technical or 🧪 Scientific review.

New or updated recipe/diagnostic

New or updated data reformatting script


To help with the number of pull requests:

@hb326 hb326 requested a review from bouweandela May 11, 2026 15:36
@hb326
Copy link
Copy Markdown
Contributor Author

hb326 commented May 11, 2026

@bouweandela: here is the recipe, as discussed.

@bouweandela
Copy link
Copy Markdown
Member

The crash happens because the valid_max attribute is of dtype np.float64 after preprocessing, while the data dtype is of dtype np.float32. I suspect this is caused by the esmvalcore.preprocessor.convert_units preprocessor function.

@bouweandela
Copy link
Copy Markdown
Member

To test, you need to change the branch on this line

"ESMValCore" = { git = "https://github.com/ESMValGroup/ESMValCore.git", branch = "main" }

to drop-range-attrs and then run pixi lock and then pixi run -e esmvalcore-dev esmvaltool run ref/recipe_enso_basicclimatology.yml

@katjaweigel
Copy link
Copy Markdown
Contributor

Testing ...

@katjaweigel
Copy link
Copy Markdown
Contributor

katjaweigel commented May 13, 2026

"ESMValCore" = { git = "https://github.com/ESMValGroup/ESMValCore.git", branch = "main" }

Thanks! (I want mamba back) Actually merged drop-range-attrs into main, but I guess I forgot that I have only the main ESMValCore installed and not a custom one so I need to change that ...

@bouweandela
Copy link
Copy Markdown
Member

If you to use your local ESMValCore clone, you can follow the instructions in the docs to set that up: https://docs.esmvaltool.org/en/latest/quickstart/installation.html#using-the-development-version-of-the-esmvalcore-package

@katjaweigel
Copy link
Copy Markdown
Contributor

Yes, thanks, works now with GPCP V3.3.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants