Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 12 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ envs/*
*__pycache__
*.log
.DS_Store
*.bak
*.ckpt
*.db
*.tar.gz
Expand All @@ -34,7 +35,13 @@ envs/*
/docs/searchindex.js
/docs/objects.inv
/docs/*.rst

/docs/source/*.pickle
/docs/source/api
/docs/source/*.doctree
/docs/source/*.inv
/docs/source/__intersphinx_cache__
/docs/source/nbsphinx
/docs/_downloads/*

# scripts
on_start_kaggle.sh
Expand All @@ -43,3 +50,7 @@ workflow_guide.md
pytest.ini
SkiNet/ML/configs/data_configs/isic2017dataset_config/__init__.py
.bash_history

# coding assistants
.claude/*

4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ ISIC-2017 per-image averaging. The threshold is the untuned default τ = 0.5 (se
### How it compares to the ISIC 2017 leaderboard

<p align="center">
<img src="docs/assets/leaderboard.png" width="700" alt="ISIC 2017 Task 1 leaderboard with SkiNet highlighted">
<img src="docs/assets/leaderboard.svg" width="700" alt="ISIC 2017 Task 1 leaderboard with SkiNet highlighted">
</p>

| Rank | Team | IoU (Jaccard) |
Expand Down Expand Up @@ -63,7 +63,7 @@ saturates the GPU (≥ 80 % util) while staying on the throughput plateau and we
[Notebook ›](source/E0-batch-size-sweep-analysis-unet2d-isic2017.ipynb)

<p align="center">
<img src="docs/assets/batchsize_sweep.png" width="560" alt="E0 batch-size throughput and GPU utilisation sweep">
<img src="docs/assets/batchsize_sweep.svg" width="560" alt="E0 batch-size throughput and GPU utilisation sweep">
</p>

### E2 — Architecture tie-break (10 seeds)
Expand Down
19 changes: 16 additions & 3 deletions SkiNet/Utils/analysis/reporting.py
Original file line number Diff line number Diff line change
Expand Up @@ -82,7 +82,13 @@ def _ci(lo: float, hi: float) -> str:
display(pd.DataFrame(data, index=index))


def show_comparison_table(results: pd.DataFrame) -> None:
def show_comparison_table(
results: pd.DataFrame,
*,
label_a: str = "AG",
label_b: str = "HE2",
delta_label: str | None = None,
) -> None:
"""Display a compact paired-comparison table from :func:`build_comparison_table` output.

Formats Δ and BCa CI as signed strings; collapses the two CI columns into
Expand All @@ -94,7 +100,14 @@ def show_comparison_table(results: pd.DataFrame) -> None:
DataFrame produced by :func:`build_comparison_table` (generic column
names: ``a_mean``, ``b_mean``, ``delta_a_minus_b``, ``boot_lo``,
``boot_hi``, ``wilcoxon_p``, ``bonferroni_sig``, ``cohen_dz``).
label_a, label_b:
Column headers for the two arms (arch_a / arch_b). Default to the E2
tie-break labels ``"AG"`` / ``"HE2"``.
delta_label:
Header for the Δ column. Defaults to ``"Δ ({label_a}−{label_b})"``.
"""
if delta_label is None:
delta_label = f"Δ ({label_a}−{label_b})"
rows = [
{
"a_mean": r["a_mean"],
Expand All @@ -110,8 +123,8 @@ def show_comparison_table(results: pd.DataFrame) -> None:
]
_display_paired_table(
rows, list(results.index),
label_a="AG", label_b="HE2",
delta_label="Δ (AG−HE2)",
label_a=label_a, label_b=label_b,
delta_label=delta_label,
)


Expand Down
Loading
Loading