Skip to content

too many file open and tkinter errors for long running dashboard #56

Description

@RBhupi

Pipeline stage where the bug occurs

Dashboard — display, refresh, or layout

Adapt version

0.1.3

Radar site and data source

No response

What happened?

Error after several clicks on the line plots and dashboard running for 10+ hours.

Steps to reproduce

Long runs of Adapt dashboard.

Full error message or traceback

adapt dashboard
Failed to load lightning for 9TBLUO75WP
Traceback (most recent call last):
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/consumers/live/dashboard.py", line 2467, in _update_time_series_all
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/api/client.py", line 210, in track_lightning
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/persistence/track_store.py", line 244, in get_track_lightning
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/persistence/track_store.py", line 116, in _connect
sqlite3.OperationalError: unable to open database file
Failed to load lightning for JQ73GRE4EX



and 


Failed to load lightning for W5770Z5SRC
Traceback (most recent call last):
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/consumers/live/dashboard.py", line 2467, in _update_time_series_all
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/api/client.py", line 210, in track_lightning
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/api/client.py", line 90, in _track_store
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/api/client.py", line 86, in _catalog
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/persistence/catalog.py", line 71, in __init__
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/persistence/catalog.py", line 101, in _init_database
OSError: [Errno 24] Too many open files: '/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/configuration/schemas/radar_catalog_schema.sql'


and



Failed to load lightning for JQ73GRE4EX
Traceback (most recent call last):
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/consumers/live/dashboard.py", line 2467, in _update_time_series_all
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/api/client.py", line 210, in track_lightning
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/api/client.py", line 90, in _track_store
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/api/client.py", line 86, in _catalog
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/persistence/catalog.py", line 71, in __init__
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/persistence/catalog.py", line 101, in _init_database
OSError: [Errno 24] Too many open files: '/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/configuration/schemas/radar_catalog_schema.sql'
/Users/bhupendra/mamba/envs/adapt_env/lib/python3.14/site-packages/xarray/backends/api.py:588: RuntimeWarning: 'netcdf4' fails while guessing
/Users/bhupendra/mamba/envs/adapt_env/lib/python3.14/site-packages/xarray/backends/api.py:588: RuntimeWarning: 'h5netcdf' fails while guessing
/Users/bhupendra/mamba/envs/adapt_env/lib/python3.14/site-packages/xarray/backends/api.py:588: RuntimeWarning: 'scipy' fails while guessing
Exception in Tkinter callback
Traceback (most recent call last):
  File "/Users/bhupendra/mamba/envs/adapt_env/lib/python3.14/tkinter/__init__.py", line 2093, in __call__
  File "/Users/bhupendra/mamba/envs/adapt_env/lib/python3.14/tkinter/__init__.py", line 876, in callit
  File "/Users/bhupendra/projects/arm_adaptive_scaning/Adapt/src/adapt/consumers/live/dashboard.py", line 1789, in _nc_loop_step
  File "/Users/bhupendra/mamba/envs/adapt_env/lib/python3.14/site-packages/xarray/backends/api.py", line 588, in open_dataset
  File "/Users/bhupendra/mamba/envs/adapt_env/lib/python3.14/site-packages/xarray/backends/plugins.py", line 217, in guess_engine
ValueError: did not find a match in any of xarray's currently installed IO backends ['netcdf4', 'h5netcdf', 'scipy', 'cfradial1', 'datamet', 'furuno', 'gamic', 'hpl', 'iris', 'metek', 'nexradlevel2', 'odim', 'rainbow', 'uf']. Consider explicitly selecting one of the installed engines via the ``engine`` parameter, or installing additional IO dependencies, see:
https://docs.xarray.dev/en/stable/getting-started-guide/installing.html
https://docs.xarray.dev/en/stable/user-guide/io.html
Exception in Tkinter callback

Configuration file (redact credentials)

Environment

Mac OSX, Python3.13

Checklist

  • I checked the documentation and existing issues
  • I can reproduce this consistently
  • This occurs on the latest release

Metadata

Metadata

Assignees

Labels

bugSomething isn't workingminordoes not affect normal operations.

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions