Ionosphere burst overlap #227
Description
Describe the bug
For a small percentage of data over New Zealand, we are not able to process the ionosphere.
We get an error like this:
resampling ionosphere in azimuth
resampling burst 02 of swath 1, azimuth shift caused by ionosphere: 0.00000 azimuth lines
resampling burst 03 of swath 1, azimuth shift caused by ionosphere: 0.00000 azimuth lines
resampling burst 04 of swath 1, azimuth shift caused by ionosphere: 0.00000 azimuth lines
resampling burst 05 of swath 1, azimuth shift caused by ionosphere: 0.00000 azimuth lines
resampling burst 02 of swath 2, azimuth shift caused by ionosphere: 0.00000 azimuth lines
resampling burst 03 of swath 2, azimuth shift caused by ionosphere: 0.00000 azimuth lines
applying ESD to compensate phase error caused by residual misregistration
Traceback (most recent call last):
File "<frozen runpy>", line 198, in _run_module_as_main
File "<frozen runpy>", line 88, in _run_code
File "/opt/conda/envs/topsapp_env/lib/python3.11/site-packages/isce2_topsapp/__main__.py", line 659, in <module>
main()
File "/opt/conda/envs/topsapp_env/lib/python3.11/site-packages/isce2_topsapp/__main__.py", line 655, in main
sys.exit(process_entry_point.load()())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/topsapp_env/lib/python3.11/site-packages/isce2_topsapp/__main__.py", line 305, in gunw_slc
iono_attr = iono_processing(
^^^^^^^^^^^^^^^^
File "/opt/conda/envs/topsapp_env/lib/python3.11/site-packages/isce2_topsapp/iono_proc.py", line 132, in iono_processing
runIon.esd(topsapp, ionParam)
File "/opt/conda/envs/topsapp_env/lib/python3.11/site-packages/isce/components/isceobj/TopsProc/runIon.py", line 2406, in esd
overlapBox = get_overlap_box(reference, minBurst, maxBurst)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/topsapp_env/lib/python3.11/site-packages/isce/components/isceobj/TopsProc/runIon.py", line 2348, in get_overlap_box
raise Exception('there is not enough overlap between burst {} and burst {}\n'.format(ii-1+1, ii+1))
Exception: there is not enough overlap between burst 2 and burst 3
To Reproduce
Here are the hyp3 inputs:
{'job_id': 'f252d399-f678-4aaa-9be5-2ce223beebd3',
'logs': ['https://hyp3-a19-jpl-contentbucket-1wfnatpznlg8b.s3.us-west-2.amazonaws.com/f252d399-f678-4aaa-9be5-2ce223beebd3/f252d399-f678-4aaa-9be5-2ce223beebd3.log'],
'job_type': 'INSAR_ISCE',
'expiration_time': '2025-10-10T00:00:00+00:00',
'thumbnail_images': [],
'user_id': 'access_cloud_based_insar',
'priority': 100,
'status_code': 'FAILED',
'files': [],
'browse_images': [],
'credit_cost': 1,
'name': 'new_zealand-track125',
'job_parameters': {'unfiltered_coherence': True,
'min_frame_coverage': 0.01,
'granules': ['S1A_IW_SLC__1SDV_20250513T073047_20250513T073116_059172_07579C_B5EB'],
'compute_solid_earth_tide': True,
'weather_model': 'None',
'secondary_granules': ['S1A_IW_SLC__1SDV_20250501T073044_20250501T073114_058997_075122_AC5F'],
'goldstein_filter_power': 0.5,
'output_resolution': 90,
'dense_offsets': False,
'esd_coherence_threshold': -1,
'frame_id': 19449,
'estimate_ionosphere_delay': True},
'request_time': '2025-09-25T19:21:44+00:00'},
{'job_id': 'c024fa66-1f5a-4b7d-8990-309c477fc912',
'logs': ['https://hyp3-a19-jpl-contentbucket-1wfnatpznlg8b.s3.us-west-2.amazonaws.com/c024fa66-1f5a-4b7d-8990-309c477fc912/c024fa66-1f5a-4b7d-8990-309c477fc912.log'],
'job_type': 'INSAR_ISCE',
'expiration_time': '2025-10-10T00:00:00+00:00',
'thumbnail_images': [],
'user_id': 'access_cloud_based_insar',
'priority': 100,
'status_code': 'FAILED',
'files': [],
'browse_images': [],
'credit_cost': 1,
'name': 'new_zealand-track125',
'job_parameters': {'unfiltered_coherence': True,
'min_frame_coverage': 0.01,
'granules': ['S1A_IW_SLC__1SDV_20250525T073046_20250525T073116_059347_075DAA_2367'],
'compute_solid_earth_tide': True,
'weather_model': 'None',
'secondary_granules': ['S1A_IW_SLC__1SDV_20250501T073044_20250501T073114_058997_075122_AC5F'],
'goldstein_filter_power': 0.5,
'output_resolution': 90,
'dense_offsets': False,
'esd_coherence_threshold': -1,
'frame_id': 19449,
'estimate_ionosphere_delay': True},
'request_time': '2025-09-25T19:21:44+00:00'},
{'job_id': 'b0875927-6bbb-40b3-9459-aa76731a10e6',
'logs': ['https://hyp3-a19-jpl-contentbucket-1wfnatpznlg8b.s3.us-west-2.amazonaws.com/b0875927-6bbb-40b3-9459-aa76731a10e6/b0875927-6bbb-40b3-9459-aa76731a10e6.log'],
'job_type': 'INSAR_ISCE',
'expiration_time': '2025-10-10T00:00:00+00:00',
'thumbnail_images': [],
'user_id': 'access_cloud_based_insar',
'priority': 100,
'status_code': 'FAILED',
'files': [],
'browse_images': [],
'credit_cost': 1,
'name': 'new_zealand-track125',
'job_parameters': {'unfiltered_coherence': True,
'min_frame_coverage': 0.01,
'granules': ['S1A_IW_SLC__1SDV_20250501T073044_20250501T073114_058997_075122_AC5F'],
'compute_solid_earth_tide': True,
'weather_model': 'None',
'secondary_granules': ['S1A_IW_SLC__1SDV_20250407T073047_20250407T073116_058647_0742D9_CB3D'],
'goldstein_filter_power': 0.5,
'output_resolution': 90,
'dense_offsets': False,
'esd_coherence_threshold': -1,
'frame_id': 19449,
'estimate_ionosphere_delay': True},
'request_time': '2025-09-25T19:21:44+00:00'},
{'job_id': '6f9e9253-4877-45f9-a4d1-6e325aaa37ea',
'logs': ['https://hyp3-a19-jpl-contentbucket-1wfnatpznlg8b.s3.us-west-2.amazonaws.com/6f9e9253-4877-45f9-a4d1-6e325aaa37ea/6f9e9253-4877-45f9-a4d1-6e325aaa37ea.log'],
'job_type': 'INSAR_ISCE',
'expiration_time': '2025-10-10T00:00:00+00:00',
'thumbnail_images': [],
'user_id': 'access_cloud_based_insar',
'priority': 100,
'status_code': 'FAILED',
'files': [],
'browse_images': [],
'credit_cost': 1,
'name': 'new_zealand-track125',
'job_parameters': {'unfiltered_coherence': True,
'min_frame_coverage': 0.01,
'granules': ['S1A_IW_SLC__1SDV_20250501T073044_20250501T073114_058997_075122_AC5F'],
'compute_solid_earth_tide': True,
'weather_model': 'None',
'secondary_granules': ['S1A_IW_SLC__1SDV_20250419T073047_20250419T073116_058822_074A00_5FEC'],
'goldstein_filter_power': 0.5,
'output_resolution': 90,
'dense_offsets': False,
'esd_coherence_threshold': -1,
'frame_id': 19449,
'estimate_ionosphere_delay': True},
'request_time': '2025-09-25T19:21:44+00:00'}
Here are two granules in ASF search from the granules in the last job: https://search.asf.alaska.edu/#/?searchType=List%20Search&searchList=S1A_IW_SLC__1SDV_20250501T073044_20250501T073114_058997_075122_AC5F,S1A_IW_SLC__1SDV_20250419T073047_20250419T073116_058822_074A00_5FEC&resultsLoaded=true&granule=S1A_IW_SLC__1SDV_20250501T073044_20250501T073114_058997_075122_AC5F-SLC&zoom=6.582¢er=174.704,-47.066
There seems to be a lot of overlap in the metadata. However, between the frames (cropping data) and other potential factors, I am not sure what is happening.
Including this for easy lookup.