Installation

Install dattri and torch>2.0.0

Section 3

IF

Please refer to

python IF/if.py --help

TracIn

Please refer to

python TracIn/tracin.py --help

TRAK

Please refer to

python trak/cifar.py --help
python trak/mnist.py --help

Section 4

Training

Please train groundtruth and models for experiments with scripts in surrogate-indicator/train_scripts

LDS benchmark of surrogate indicator

Please run files in surrogate-indicator/benchmark. For example,

cd surrogate-indicator
python -m benchmark.benchmark_mnist_lr --attributor IFFIM --use_baselines

Note here that the WikiText2+GPT2 setting is more complex and should be run differently. Please refer to surrogate-indicator/benchmark/wikitext2-gpt2/README.md for more detail.

Downstream tasks

Please run files in surrogate-indicator/downstream. For example,

cd surrogate-indicator
python -m downstream.mnist_data_cleaning --attributor IFFIM --remove_ratio 0.3

Empirical assessment of constants in assumptions

Please run files in surrogate-indicator/assumptions. For example,

cd surrogate-indicator
python -m assumptions.assum_cifar2_resnet9