Model Fine-tuning

Fine-tune Resources

• Fine-tune a pre-trained model on HuggingFace
• Fine-tune documentation on OpenAI
• StackLLaMA: A hands-on guide to train LLaMA with RLHF
• Parameter-Efficient Fine-Tuning (PEFT) -- An efficient fine-tuning approach to reduce computational resources and time cost
  • Blog
  • Github

Fine-tune time estimation (Based on previous Hackathon feedback)

• Fine-tuning ESM-2 model with 35M parameter takes ~4.5 hours
• Fine-tuning ESM-2 model with 8M parameter takes ~2.5 hours