Skip to content

Why can't scripts/run_pipeline.py be executed with pipelines #12

@931671499

Description

@931671499

readme.md has

python scripts/run_pipeline.py
dvc commit

But why it can't be executed with pipelines, report an error

(re-classwise-shapley) D:\Work_Space\Python_Space\CSShapely\re-classwise-shapley [(4e55893...) +2 ~2 -0 !]> python scripts/run_pipeline.py
D:\ProgrammaLanguage\Anaconda\envs\re-classwise-shapley\lib\site-packages\pydvl\parallel\config.py:31: FutureWarning: The `ParallelConfig` class was deprecated in v0.9.0 and will be removed in v0.10.0   
  warnings.warn(
2025-03-24 15:06:07,199 | run_pipeline | INFO | Fetching dataset cifar10.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Preprocessing dataset cifar10.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Fetching dataset click.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Preprocessing dataset click.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Fetching dataset covertype.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Preprocessing dataset covertype.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Fetching dataset cpu.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Preprocessing dataset cpu.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Fetching dataset diabetes.
2025-03-24 15:06:07,200 | run_pipeline | INFO | Preprocessing dataset diabetes.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Fetching dataset fmnist_binary.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Preprocessing dataset fmnist_binary.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Fetching dataset mnist_binary.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Preprocessing dataset mnist_binary.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Fetching dataset mnist_multi.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Preprocessing dataset mnist_multi.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Fetching dataset phoneme.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Preprocessing dataset phoneme.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Sample dataset cifar10 for experiment point_removal.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Sample dataset click for experiment point_removal.
2025-03-24 15:06:07,201 | run_pipeline | INFO | Sample dataset covertype for experiment point_removal.
2025-03-24 15:06:07,202 | run_pipeline | INFO | Sample dataset cpu for experiment point_removal.
2025-03-24 15:06:07,202 | run_pipeline | INFO | Sample dataset diabetes for experiment point_removal.
2025-03-24 15:06:07,202 | run_pipeline | INFO | Sample dataset fmnist_binary for experiment point_removal.
2025-03-24 15:06:07,203 | run_pipeline | INFO | Sample dataset mnist_binary for experiment point_removal.
2025-03-24 15:06:07,203 | run_pipeline | INFO | Sample dataset mnist_multi for experiment point_removal.
2025-03-24 15:06:07,203 | run_pipeline | INFO | Sample dataset phoneme for experiment point_removal.
2025-03-24 15:06:07,203 | run_pipeline | INFO | Sample dataset cifar10 for experiment noise_removal.
2025-03-24 15:06:07,203 | run_pipeline | INFO | Sample dataset click for experiment noise_removal.
2025-03-24 15:06:07,203 | run_pipeline | INFO | Sample dataset covertype for experiment noise_removal.
2025-03-24 15:06:07,204 | run_pipeline | INFO | Sample dataset cpu for experiment noise_removal.
2025-03-24 15:06:07,204 | run_pipeline | INFO | Sample dataset diabetes for experiment noise_removal.
2025-03-24 15:06:07,204 | run_pipeline | INFO | Sample dataset fmnist_binary for experiment noise_removal.
2025-03-24 15:06:07,204 | run_pipeline | INFO | Sample dataset mnist_binary for experiment noise_removal.
2025-03-24 15:06:07,204 | run_pipeline | INFO | Sample dataset mnist_multi for experiment noise_removal.
2025-03-24 15:06:07,204 | run_pipeline | INFO | Sample dataset phoneme for experiment noise_removal.
2025-03-24 15:06:07,204 | run_pipeline | INFO | Render plots for point_removal and logistic_regression.
2025-03-24 15:06:07,204 | render_plots | INFO | Starting plotting of data valuation experiment
2025-03-24 15:06:07,779 | render_plots | INFO | Starting experiment with id `1.
2025-03-24 15:06:08,423 | render_plots | INFO | Flatten parameters & upload to mlflow.
2025-03-24 15:06:08,972 | render_plots | INFO | Record datasets in mlflow.
Traceback (most recent call last):
  File "D:\Work_Space\Python_Space\CSShapely\re-classwise-shapley\scripts\run_pipeline.py", line 198, in <module>
    run_pipeline()
  File "D:\ProgrammaLanguage\Anaconda\envs\re-classwise-shapley\lib\site-packages\click\core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "D:\ProgrammaLanguage\Anaconda\envs\re-classwise-shapley\lib\site-packages\click\core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "D:\ProgrammaLanguage\Anaconda\envs\re-classwise-shapley\lib\site-packages\click\core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "D:\ProgrammaLanguage\Anaconda\envs\re-classwise-shapley\lib\site-packages\click\core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "D:\Work_Space\Python_Space\CSShapely\re-classwise-shapley\scripts\run_pipeline.py", line 187, in run_pipeline
    _render_plots(experiment_name, model_name)
  File "D:\Work_Space\Python_Space\CSShapely\re-classwise-shapley\scripts\render_plots.py", line 96, in _render_plots
    Accessor.datasets(
  File "D:\Work_Space\Python_Space\CSShapely\re-classwise-shapley\src\re_classwise_shapley\io.py", line 214, in wrapped_walk_product_space
    row = fn(*folder_instance)
  File "D:\Work_Space\Python_Space\CSShapely\re-classwise-shapley\src\re_classwise_shapley\io.py", line 410, in datasets
    with open(base_path / "val_set.pkl", "rb") as file:
FileNotFoundError: [Errno 2] No such file or directory: 'output\\sampled\\point_removal\\cifar10\\val_set.pkl'

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions