Main Page: Difference between revisions

From CMU -- Language Technologies Institute -- HPC Wiki
Jump to navigation Jump to search
← Older edit
VisualWikitext
No edit summary
No edit summary
 
(30 intermediate revisions by 6 users not shown)
Line 1: Line 1:
__NOTOC__ __NOEDITSECTION__
__NOTOC__ __NOEDITSECTION__
[[Category:English]]


'''Welcome to the [[vos-wiki:About|Language Technologies Institute Wiki]]!'''
'''Welcome to the [https://lti.cs.cmu.edu Language Technologies Institute] HPC Wiki!'''


==General==
This wiki provides resources and documentation for the LTI's High-Performance Computing (HPC) clusters, tools, and workflows. Explore the sections below to get started!


== HPC Assets ==
<div style="float: left; margin-right: 1%; width: 49%;">
<div style="float: left; margin-right: 1%; width: 49%;">
==== HPC Clusters ====
; [[BABEL]]
: Let's not let this one tip over.
; [[BOSTON]]
: Info about the Boston cluster.
</div>
<div style="float: left; width: 50%;">
==== Babel Sub-groups ====
; [[CXCSCMU_GroupWiki]]
: Chenyan Xiong's group pages.
; [[FLAME]]
: Notes and walk-throughs related to the FLAME Center nodes.
</div>
<div style="clear: both;"></div>


; [[Connecting to the Cluster]]: How to request access, login, and interact with the various HPC resources.
== General ==
 
<div style="float: left; margin-right: 1%; width: 49%;">
; [[Slurm]]: Beginner's guide to the Slurm workload manager.  How to submit, manage, monitor job status, and interact with the Slurm job queue.
; [[SSH|Connecting to the Cluster]]
 
: How to request access, log in, and interact with HPC resources.
; [[Slurm]]
: Beginner's guide to the Slurm workload manager—submit, manage, and monitor jobs.
; [[Monitoring]]
: Basics of monitoring jobs, compute resources, and disk usage with essential tools.
</div>
</div>
<div style="float: left; width: 50%;">
<div style="float: left; width: 50%;">
; [[HPC Software]]: A general list of sotware available on all clusters / nodes.
; [[HPC Software]]
 
: List of software available across all clusters and nodes.
; [[HPC Terminology]]: An overview of commonly used terms and concepts in High-Performance Computing (HPC).
; [[HPC Terminology]]
 
: Overview of common HPC terms and concepts.
; [[Tips & Tricks]]: Useful notes for specific scenerios.
; [[Tips & Tricks]]
: Useful notes for specific scenarios.
</div>
</div>
<div style="clear: both;"></div>
<div style="clear: both;"></div>


==Cluster Specific==
== Models and Datasets ==
 
<div style="float: left; margin-right: 1%; width: 49%;">
<div style="float: left; margin-right: 1%; width: 49%;">
 
; [[ClueWeb]]
; [[BABEL]]: A list of service servers and what they do.
: A large-scale web corpus with billions of pages from the World Wide Web.
 
; [[TIR]]: a myriad of support answeres.
 
; [[BOSTON]]: A list of our In-House scripts, what they do, and how to use them.
 
; [[ATLAS]]: What constitutes '''abuse''' or '''abuse.urgent''' and what to do when you encounter an issue.
 
</div>
</div>
<div style="float: left; width: 50%;">
<div style="float: left; width: 50%;">
 
; [[Hugging_Face]]
; [[Shire]]: Carolyn P Rose's nodes.
: Intro to setting up your environment and using Hugging Face (HF) models and datasets on Babel HPC.
 
; [[DMortens]]: David Mortensen's nodes.
 
</div>
</div>
<div style="clear: both;"></div>
<div style="clear: both;"></div>


== Misc ==
== Misc ==
<div style="float: left; margin-right: 1%; width: 49%;">
<div style="float: left; margin-right: 1%; width: 49%;">
 
; [[Efficiency]]
; [[External Resources]]: Links to useful tools.
: Exploring GPU power efficiency—concepts and practical tips.
 
; [[Other communities]]: Some links to other communities.
 
</div>
</div>
<div style="float: left; width: 50%;">
<div style="float: left; width: 50%;">
 
; [[Forum etiquette]]
; [[Forum etiquette]]: Guidelines for forum members.
: Guidelines for forum members.
 
; [[Help:Editing]]: Short tutorial on editing and contributing to the wiki.
 
</div>
</div>
<div style="clear: both;"></div>


<div style="clear: both;"></div>
== Help ==
== Help ==
<div style="float: left; margin-right: 1%; width: 49%;">
<div style="float: left; margin-right: 1%; width: 49%;">
 
; [[Help:Searching]]
See [[Help:Searching]] for other tricks.
: Tips and tricks for effective searching.
</div>
<div style="float: left; width: 50%;">
; [[Help:Editing]]
: Short tutorial on editing and contributing to the wiki.
</div>
</div>
<div style="clear: both;"></div>

Latest revision as of 14:37, 20 February 2025


Welcome to the Language Technologies Institute HPC Wiki!

This wiki provides resources and documentation for the LTI's High-Performance Computing (HPC) clusters, tools, and workflows. Explore the sections below to get started!

HPC Assets

HPC Clusters

BABEL
Let's not let this one tip over.
BOSTON
Info about the Boston cluster.

Babel Sub-groups

CXCSCMU_GroupWiki
Chenyan Xiong's group pages.
FLAME
Notes and walk-throughs related to the FLAME Center nodes.

General

Connecting to the Cluster
How to request access, log in, and interact with HPC resources.
Slurm
Beginner's guide to the Slurm workload manager—submit, manage, and monitor jobs.
Monitoring
Basics of monitoring jobs, compute resources, and disk usage with essential tools.
HPC Software
List of software available across all clusters and nodes.
HPC Terminology
Overview of common HPC terms and concepts.
Tips & Tricks
Useful notes for specific scenarios.

Models and Datasets

ClueWeb
A large-scale web corpus with billions of pages from the World Wide Web.
Hugging_Face
Intro to setting up your environment and using Hugging Face (HF) models and datasets on Babel HPC.

Misc

Efficiency
Exploring GPU power efficiency—concepts and practical tips.
Forum etiquette
Guidelines for forum members.

Help

Help:Searching
Tips and tricks for effective searching.
Help:Editing
Short tutorial on editing and contributing to the wiki.
Retrieved from "https://wiki.babel.cs.cmu.edu/index.php?title=Main_Page&oldid=419"