Main Page: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
| (32 intermediate revisions by 6 users not shown) | |||
| Line 1: | Line 1: | ||
__NOTOC__ __NOEDITSECTION__ | |||
'''Welcome to the [https://lti.cs.cmu.edu Language Technologies Institute] HPC Wiki!''' | |||
== | This wiki provides resources and documentation for the LTI's High-Performance Computing (HPC) clusters, tools, and workflows. Explore the sections below to get started! | ||
== HPC Assets == | |||
<div style="float: left; margin-right: 1%; width: 49%;"> | |||
==== HPC Clusters ==== | |||
; [[BABEL]] | |||
: Let's not let this one tip over. | |||
; [[BOSTON]] | |||
: Info about the Boston cluster. | |||
</div> | |||
<div style="float: left; width: 50%;"> | |||
==== Babel Sub-groups ==== | |||
; [[CXCSCMU_GroupWiki]] | |||
: Chenyan Xiong's group pages. | |||
; [[FLAME]] | |||
: Notes and walk-throughs related to the FLAME Center nodes. | |||
</div> | |||
<div style="clear: both;"></div> | |||
== General == | |||
<div style="float: left; margin-right: 1%; width: 49%;"> | |||
; [[SSH|Connecting to the Cluster]] | |||
: How to request access, log in, and interact with HPC resources. | |||
; [[Slurm]] | |||
: Beginner's guide to the Slurm workload manager—submit, manage, and monitor jobs. | |||
; [[Monitoring]] | |||
: Basics of monitoring jobs, compute resources, and disk usage with essential tools. | |||
</div> | |||
<div style="float: left; width: 50%;"> | |||
; [[HPC Software]] | |||
: List of software available across all clusters and nodes. | |||
; [[HPC Terminology]] | |||
: Overview of common HPC terms and concepts. | |||
; [[Tips & Tricks]] | |||
: Useful notes for specific scenarios. | |||
</div> | |||
<div style="clear: both;"></div> | |||
== Models and Datasets == | |||
<div style="float: left; margin-right: 1%; width: 49%;"> | |||
; [[ClueWeb]] | |||
: A large-scale web corpus with billions of pages from the World Wide Web. | |||
</div> | |||
<div style="float: left; width: 50%;"> | |||
; [[Hugging_Face]] | |||
: Intro to setting up your environment and using Hugging Face (HF) models and datasets on Babel HPC. | |||
</div> | |||
<div style="clear: both;"></div> | |||
== Misc == | |||
<div style="float: left; margin-right: 1%; width: 49%;"> | |||
; [[Efficiency]] | |||
: Exploring GPU power efficiency—concepts and practical tips. | |||
</div> | |||
<div style="float: left; width: 50%;"> | |||
; [[Forum etiquette]] | |||
: Guidelines for forum members. | |||
</div> | |||
<div style="clear: both;"></div> | |||
== Help == | |||
<div style="float: left; margin-right: 1%; width: 49%;"> | |||
; [[Help:Searching]] | |||
: Tips and tricks for effective searching. | |||
</div> | |||
<div style="float: left; width: 50%;"> | |||
; [[Help:Editing]] | |||
: Short tutorial on editing and contributing to the wiki. | |||
</div> | |||
<div style="clear: both;"></div> | |||
Latest revision as of 14:37, 20 February 2025
Welcome to the Language Technologies Institute HPC Wiki!
This wiki provides resources and documentation for the LTI's High-Performance Computing (HPC) clusters, tools, and workflows. Explore the sections below to get started!
HPC Assets
Babel Sub-groups
- CXCSCMU_GroupWiki
- Chenyan Xiong's group pages.
- FLAME
- Notes and walk-throughs related to the FLAME Center nodes.
General
- Connecting to the Cluster
- How to request access, log in, and interact with HPC resources.
- Slurm
- Beginner's guide to the Slurm workload manager—submit, manage, and monitor jobs.
- Monitoring
- Basics of monitoring jobs, compute resources, and disk usage with essential tools.
- HPC Software
- List of software available across all clusters and nodes.
- HPC Terminology
- Overview of common HPC terms and concepts.
- Tips & Tricks
- Useful notes for specific scenarios.
Models and Datasets
- ClueWeb
- A large-scale web corpus with billions of pages from the World Wide Web.
- Hugging_Face
- Intro to setting up your environment and using Hugging Face (HF) models and datasets on Babel HPC.
Misc
- Efficiency
- Exploring GPU power efficiency—concepts and practical tips.
- Forum etiquette
- Guidelines for forum members.
Help
- Help:Searching
- Tips and tricks for effective searching.
- Help:Editing
- Short tutorial on editing and contributing to the wiki.