Main Page: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
Initialize the model finetune page |
||
| Line 35: | Line 35: | ||
<div style="float: left; width: 50%;"> | <div style="float: left; width: 50%;"> | ||
</div> | </div> | ||
<div style="float: left; margin-right: 1%; width: 49%;"> | |||
; [[Model Fine-tuning]]: Resources available for LLM model fine-tuning on HPC resources | |||
</div> | |||
<div style="clear: both;"></div> | <div style="clear: both;"></div> | ||
Revision as of 22:07, 3 August 2023
Welcome to the Language Technologies Institute HPC wiki!
General
- Connecting to the Cluster
- How to request access, login, and interact with the various HPC resources.
- Slurm
- Beginner's guide to the Slurm workload manager. How to submit, manage, monitor job status, and interact with the Slurm job queue.
- Monitoring
- the basics of monitoring cluster activities such as jobs, compute resources, and disk usage. Learn about essential techniques and tools for effective cluster monitoring.
- HPC Software
- A general list of sotware available on all clusters / nodes.
- HPC Terminology
- An overview of commonly used terms and concepts in High-Performance Computing (HPC).
- Efficiency
- Exploring the concept, importance and practicality of GPU power efficiency.
- Tips & Tricks
- Useful notes for specific scenarios.
Generative-AI Hackathon
- Training Material
- An instruction for Generative-AI Hackathon participants to access and clusters and deploy/tune models on clusters
- Model Fine-tuning
- Resources available for LLM model fine-tuning on HPC resources
Cluster Specific
- BABEL
- Let's not let this one tip over.
- TIR
- Info about the Tir cluster.
- BOSTON
- Info about the Boston cluster.
- ATLAS
- Info about the Atlas cluster.
Models and Datasets
- ClueWeb
- A large-scale web corpus consisting of billions of web pages collected from the World Wide Web.
Misc
- External Resources
- Links to useful tools.
- Other communities
- Some links to other communities.
- Forum etiquette
- Guidelines for forum members.
Help
- Help:Searching
- for search tricks.
- Help:Editing
- Short tutorial on editing and contributing to the wiki.