diff --git a/playbooks/supplemental/pytorch-finetuning/README.md b/playbooks/supplemental/pytorch-finetuning/README.md index 1e035e06..bfa3df93 100644 --- a/playbooks/supplemental/pytorch-finetuning/README.md +++ b/playbooks/supplemental/pytorch-finetuning/README.md @@ -32,8 +32,8 @@ This tutorial provides step-by-step examples for fine-tuning a large language mo ### 1. Setup #### Create a Virtual Environment - + ```bash sudo apt update @@ -42,37 +42,32 @@ python3 -m venv finetune-venv --system-site-packages source finetune-venv/bin/activate ``` - - ```powershell python -m venv finetune-venv --system-site-packages finetune-venv\Scripts\activate ``` - + - - + ```powershell python -m venv finetune-venv finetune-venv\Scripts\activate ``` - - ```bash sudo apt update @@ -81,14 +76,13 @@ python3 -m venv finetune-venv source finetune-venv/bin/activate ``` - + #### Installing Basic Dependencies - #### Additional Dependencies @@ -197,6 +191,7 @@ r = subprocess.run([sys.executable, "train_full_finetuning.py"], timeout=600) sys.exit(r.returncode) ``` + --- ## Understanding the Techniques @@ -259,7 +254,13 @@ Below is a summary of the available training methods. Each method links to its s | [`train_full_finetuning.py`](assets/train_full_finetuning.py) | **Full Fine-tuning** | Updates all model parameters. Maximum quality; highest memory and compute usage. | 40GB+ | Maximum quality; research; large VRAM | + > **Note:** Full fine-tuning (`train_full_finetuning.py`) may require more than 64GB of system RAM and may not be feasible on this device. Consider using LoRA or QLoRA instead. + + + +> **Note:** Full fine-tuning (`train_full_finetuning.py`) may require more than 64GB of system RAM and may not be feasible on this device. Consider using LoRA instead. + Simply select your preferred `Training method`, download the corresponding script and execute it using the command keeping your virtual environment activated: