Virtual Clusters on Jetstream2¶
A Virtual Cluster is a computer cluster that is made up of a single head node which runs the Slurm system, as well as a number of compute nodes. The head node is responsible for controlling the compute nodes. A large filesystem can be shared between all of the nodes. The head node is accessible to users via a public IP address and the compute nodes are created on-demand as jobs are submitted to the queue.
Info
Slurm is a resource management system that helps organize and manage computer resources. It allocates resources to different tasks or jobs, making sure that everything runs as smoothly as possible.
Options to create your own virtual cluster on Jetstream2¶
- Exosphere’s push-button cluster feature (easy, less configurable)
- Magic Castle using CACAO (easy and more configurable)
- On the command-line, running shell scripts (trickier, more flexible). See the XCRI Toolkit Docs for more information.