Main Page: Difference between revisions

Latest revision as of 14:37, 20 February 2025

Welcome to the Language Technologies Institute HPC Wiki!

This wiki provides resources and documentation for the LTI's High-Performance Computing (HPC) clusters, tools, and workflows. Explore the sections below to get started!

HPC Assets

HPC Clusters

BABEL: Let's not let this one tip over.
BOSTON: Info about the Boston cluster.

Babel Sub-groups

CXCSCMU_GroupWiki: Chenyan Xiong's group pages.
FLAME: Notes and walk-throughs related to the FLAME Center nodes.

General

Connecting to the Cluster: How to request access, log in, and interact with HPC resources.
Slurm: Beginner's guide to the Slurm workload manager—submit, manage, and monitor jobs.
Monitoring: Basics of monitoring jobs, compute resources, and disk usage with essential tools.

HPC Software: List of software available across all clusters and nodes.
HPC Terminology: Overview of common HPC terms and concepts.
Tips & Tricks: Useful notes for specific scenarios.

Models and Datasets

ClueWeb: A large-scale web corpus with billions of pages from the World Wide Web.

Hugging_Face: Intro to setting up your environment and using Hugging Face (HF) models and datasets on Babel HPC.

Misc

Efficiency: Exploring GPU power efficiency—concepts and practical tips.

Forum etiquette: Guidelines for forum members.

Help

Help:Searching: Tips and tricks for effective searching.

Help:Editing: Short tutorial on editing and contributing to the wiki.

@@ Line 1: / Line 1: @@
 __NOTOC__ __NOEDITSECTION__
-[[Category:English]]
-'''Welcome to the [[vos-wiki:About|Language Technologies Institute Wiki]]!'''
+'''Welcome to the [https://lti.cs.cmu.edu Language Technologies Institute] HPC Wiki!'''
-==General==
+This wiki provides resources and documentation for the LTI's High-Performance Computing (HPC) clusters, tools, and workflows. Explore the sections below to get started!
+== HPC Assets ==
 <div style="float: left; margin-right: 1%; width: 49%;">
-; [[Connecting to the Cluster]]: How to request access, login, and interact with the various HPC resources.
+==== HPC Clusters ====
+; [[BABEL]]
-; [[Slurm]]: Beginner's guide to the Slurm workload manager.  How to submit, manage, monitor job status, and interact with the Slurm job queue.
+: Let's not let this one tip over.
+; [[BOSTON]]
-; [[Monitoring]]: the basics of monitoring cluster activities such as jobs, compute resources, and disk usage. Learn about essential techniques and tools for effective cluster monitoring.
+: Info about the Boston cluster.
 </div>
 <div style="float: left; width: 50%;">
-; [[HPC Software]]: A general list of sotware available on all clusters / nodes.
+==== Babel Sub-groups ====
+; [[CXCSCMU_GroupWiki]]
-; [[HPC Terminology]]: An overview of commonly used terms and concepts in High-Performance Computing (HPC).
+: Chenyan Xiong's group pages.
+; [[FLAME]]
-; [[Tips & Tricks]]: Useful notes for specific scenarios.
+: Notes and walk-throughs related to the FLAME Center nodes.
 </div>
+<div style="clear: both;"></div>
-<div style="clear: both;">
+== General ==
-==Generative-AI Hackathon ==
 <div style="float: left; margin-right: 1%; width: 49%;">
+; [[SSH|Connecting to the Cluster]]
-[[Index.php?title=Training Material|'''Training Material''']]
+: How to request access, log in, and interact with HPC resources.
+; [[Slurm]]
-An instruction for Generative-AI Hackathon participants to access and clusters and deploy/tune models on clusters
+: Beginner's guide to the Slurm workload manager—submit, manage, and monitor jobs.
+; [[Monitoring]]
+: Basics of monitoring jobs, compute resources, and disk usage with essential tools.
+</div>
+<div style="float: left; width: 50%;">
+; [[HPC Software]]
+: List of software available across all clusters and nodes.
+; [[HPC Terminology]]
+: Overview of common HPC terms and concepts.
+; [[Tips & Tricks]]
+: Useful notes for specific scenarios.
 </div>
+<div style="clear: both;"></div>
-== Cluster Specific==
+== Models and Datasets ==
 <div style="float: left; margin-right: 1%; width: 49%;">
+; [[ClueWeb]]
-;[[BABEL]]:Let's not let this one tip over.
+: A large-scale web corpus with billions of pages from the World Wide Web.
-;[[TIR]]:Info about the Tir cluster.
-;[[BOSTON]]: Info about the Boston cluster.
-; [[ATLAS]]:Info about the Atlas cluster.
 </div>
 <div style="float: left; width: 50%;">
+; [[Hugging_Face]]
-;[[Shire]]:Carolyn P Rose's nodes.
+: Intro to setting up your environment and using Hugging Face (HF) models and datasets on Babel HPC.
-; [[DMortens]]:David Mortensen's nodes.
 </div>
 <div style="clear: both;"></div>
-==Misc==
+== Misc ==
 <div style="float: left; margin-right: 1%; width: 49%;">
+; [[Efficiency]]
-;[[External Resources]]:Links to useful tools.
+: Exploring GPU power efficiency—concepts and practical tips.
-; [[Other communities]]:Some links to other communities.
 </div>
 <div style="float: left; width: 50%;">
+; [[Forum etiquette]]
-; [[Forum etiquette]]:Guidelines for forum members.
+: Guidelines for forum members.
-;[[Help:Editing]]:Short tutorial on editing and contributing to the wiki.
 </div>
+<div style="clear: both;"></div>
-<div style="clear: both;"></div>
+== Help ==
-==Help==
 <div style="float: left; margin-right: 1%; width: 49%;">
+; [[Help:Searching]]
-See [[Help:Searching]] for other tricks.
+: Tips and tricks for effective searching.
+</div>
+<div style="float: left; width: 50%;">
+; [[Help:Editing]]
+: Short tutorial on editing and contributing to the wiki.
 </div>
+<div style="clear: both;"></div>

Main Page: Difference between revisions

Latest revision as of 14:37, 20 February 2025

HPC Assets

HPC Clusters

Babel Sub-groups

General

Models and Datasets

Misc

Help

Navigation menu

Search