add retries for esmf mesh creation

[mdeshotel]

Utilize the same retry function used in regrid.py for initial mesh creation in geomod.py.

https://jira.nextgenwaterprediction.com/browse/NGWPC-11202

Additions

Removals

Changes

Testing

Screenshots

Notes

Todos

Checklist

• PR has an informative and human-readable title
• Changes are limited to a single goal (no scope creep)
• Code can be automatically merged (no conflicts)
• Code follows project standards (link if applicable)
• Passes all existing automated tests
• Any change in functionality is tested
• New functions are documented (with a description, list of inputs, and expected output)
• Placeholder code is flagged / future todos are captured in comments
• Visually tested in supported browsers and devices (see checklist below 👇)
• Project documentation has been updated (including the "Unreleased" section of the CHANGELOG)
• Reviewers requested with the Reviewers tool ➡️

Testing checklist

Target Environment support

• Linux

[mxkpp]

The changes look good for intentionally retrying the ESMF.Grid and ESMF.Mesh calls, if they are intermittently failing in the environment they are running in due to temporary filesystem issues that can be overcome by simply retrying. The changes are using the appropriate dedicated retry functions for these ESMF methods that were added earlier.

I was not able to run the pytests since they are out of date relative to the recent hydrofabric and other expected test data / golden files. Soon we should update the test gpkg and golden files so that the pytests may run again.