Transformers - Hugging Face Library
🥥 Table of Content
Basic Components
- 01 - Overview & Libraries
- 02 - Model
- 04 - Datasets
Parameter-Efficient Fine-Tuning(PEFT)
- 01 - Prompt-Tuning
- 02 - P-Tuning
- 03 - Prefix-Tuning
- 04 - LoRA
- 05 - IA3
- 06 - Advanced PEFT Operations
🥑 Get Started!
Basic Components
01 - Overview & Environments
Step 1: Create a environment
conda create -n transformers python==3.9.16 -y
Step 2: Activate environment
conda activate transformers
Step 3: Install libraries
pip install transformers datasets peft
Parameter-Efficient Fine-Tuning(PEFT)
Resource 1: In-depth guide to fine-tuning LLMs with LoRA and QLoRA | Mercity
Resource 2: 手把手带你实战HuggingFace Transformers | Bilibili