Main Page

From CMU -- Language Technologies Institute -- HPC Wiki
Jump to navigation Jump to search


Welcome to the Language Technologies Institute HPC Wiki!

This wiki provides resources and documentation for the LTI's High-Performance Computing (HPC) clusters, tools, and workflows. Explore the sections below to get started!

HPC Assets

HPC Clusters

BABEL
Let's not let this one tip over.
BOSTON
Info about the Boston cluster.

Babel Sub-groups

CXCSCMU_GroupWiki
Chenyan Xiong's group pages.
FLAME
Notes and walk-throughs related to the FLAME Center nodes.

General

Connecting to the Cluster
How to request access, log in, and interact with HPC resources.
Slurm
Beginner's guide to the Slurm workload manager—submit, manage, and monitor jobs.
Monitoring
Basics of monitoring jobs, compute resources, and disk usage with essential tools.
HPC Software
List of software available across all clusters and nodes.
HPC Terminology
Overview of common HPC terms and concepts.
Tips & Tricks
Useful notes for specific scenarios.

Models and Datasets

ClueWeb
A large-scale web corpus with billions of pages from the World Wide Web.
Hugging_Face
Intro to setting up your environment and using Hugging Face (HF) models and datasets on Babel HPC.

Misc

Efficiency
Exploring GPU power efficiency—concepts and practical tips.
Forum etiquette
Guidelines for forum members.

Help

Help:Searching
Tips and tricks for effective searching.
Help:Editing
Short tutorial on editing and contributing to the wiki.