-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Description
readme.md has
python scripts/run_pipeline.py
dvc commitBut why it can't be executed with pipelines, report an error
(re-classwise-shapley) D:\Work_Space\Python_Space\CSShapely\re-classwise-shapley [(4e55893...) +2 ~2 -0 !]> python scripts/run_pipeline.py
D:\ProgrammaLanguage\Anaconda\envs\re-classwise-shapley\lib\site-packages\pydvl\parallel\config.py:31: FutureWarning: The `ParallelConfig` class was deprecated in v0.9.0 and will be removed in v0.10.0
warnings.warn(
2025-03-24 15:06:07,199 | run_pipeline | INFO | Fetching dataset cifar10.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Preprocessing dataset cifar10.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Fetching dataset click.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Preprocessing dataset click.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Fetching dataset covertype.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Preprocessing dataset covertype.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Fetching dataset cpu.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Preprocessing dataset cpu.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Fetching dataset diabetes.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Preprocessing dataset diabetes.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Fetching dataset fmnist_binary.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Preprocessing dataset fmnist_binary.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Fetching dataset mnist_binary.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Preprocessing dataset mnist_binary.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Fetching dataset mnist_multi.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Preprocessing dataset mnist_multi.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Fetching dataset phoneme.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Preprocessing dataset phoneme.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Sample dataset cifar10 for experiment point_removal.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Sample dataset click for experiment point_removal.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Sample dataset covertype for experiment point_removal.
2025-03-24 15:06:07,202 | run_pipeline | INFO | Sample dataset cpu for experiment point_removal.
2025-03-24 15:06:07,202 | run_pipeline | INFO | Sample dataset diabetes for experiment point_removal.
2025-03-24 15:06:07,202 | run_pipeline | INFO | Sample dataset fmnist_binary for experiment point_removal.
2025-03-24 15:06:07,203 | run_pipeline | INFO | Sample dataset mnist_binary for experiment point_removal.
2025-03-24 15:06:07,203 | run_pipeline | INFO | Sample dataset mnist_multi for experiment point_removal.
2025-03-24 15:06:07,203 | run_pipeline | INFO | Sample dataset phoneme for experiment point_removal.
2025-03-24 15:06:07,203 | run_pipeline | INFO | Sample dataset cifar10 for experiment noise_removal.
2025-03-24 15:06:07,203 | run_pipeline | INFO | Sample dataset click for experiment noise_removal.
2025-03-24 15:06:07,203 | run_pipeline | INFO | Sample dataset covertype for experiment noise_removal.
2025-03-24 15:06:07,204 | run_pipeline | INFO | Sample dataset cpu for experiment noise_removal.
2025-03-24 15:06:07,204 | run_pipeline | INFO | Sample dataset diabetes for experiment noise_removal.
2025-03-24 15:06:07,204 | run_pipeline | INFO | Sample dataset fmnist_binary for experiment noise_removal.
2025-03-24 15:06:07,204 | run_pipeline | INFO | Sample dataset mnist_binary for experiment noise_removal.
2025-03-24 15:06:07,204 | run_pipeline | INFO | Sample dataset mnist_multi for experiment noise_removal.
2025-03-24 15:06:07,204 | run_pipeline | INFO | Sample dataset phoneme for experiment noise_removal.
2025-03-24 15:06:07,204 | run_pipeline | INFO | Render plots for point_removal and logistic_regression.
2025-03-24 15:06:07,204 | render_plots | INFO | Starting plotting of data valuation experiment
2025-03-24 15:06:07,779 | render_plots | INFO | Starting experiment with id `1.
2025-03-24 15:06:08,423 | render_plots | INFO | Flatten parameters & upload to mlflow.
2025-03-24 15:06:08,972 | render_plots | INFO | Record datasets in mlflow.
Traceback (most recent call last):
File "D:\Work_Space\Python_Space\CSShapely\re-classwise-shapley\scripts\run_pipeline.py", line 198, in <module>
run_pipeline()
File "D:\ProgrammaLanguage\Anaconda\envs\re-classwise-shapley\lib\site-packages\click\core.py", line 1157, in __call__
return self.main(*args, **kwargs)
File "D:\ProgrammaLanguage\Anaconda\envs\re-classwise-shapley\lib\site-packages\click\core.py", line 1078, in main
rv = self.invoke(ctx)
File "D:\ProgrammaLanguage\Anaconda\envs\re-classwise-shapley\lib\site-packages\click\core.py", line 1434, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "D:\ProgrammaLanguage\Anaconda\envs\re-classwise-shapley\lib\site-packages\click\core.py", line 783, in invoke
return __callback(*args, **kwargs)
File "D:\Work_Space\Python_Space\CSShapely\re-classwise-shapley\scripts\run_pipeline.py", line 187, in run_pipeline
_render_plots(experiment_name, model_name)
File "D:\Work_Space\Python_Space\CSShapely\re-classwise-shapley\scripts\render_plots.py", line 96, in _render_plots
Accessor.datasets(
File "D:\Work_Space\Python_Space\CSShapely\re-classwise-shapley\src\re_classwise_shapley\io.py", line 214, in wrapped_walk_product_space
row = fn(*folder_instance)
File "D:\Work_Space\Python_Space\CSShapely\re-classwise-shapley\src\re_classwise_shapley\io.py", line 410, in datasets
with open(base_path / "val_set.pkl", "rb") as file:
FileNotFoundError: [Errno 2] No such file or directory: 'output\\sampled\\point_removal\\cifar10\\val_set.pkl'
Metadata
Metadata
Assignees
Labels
No labels