Data Analysis and Visualisation in Python on ARCHER2

Key Points

Overview of the ARCHER2 system
  • ARCHER2 consists of high performance login nodes, compute nodes, storage systems and interconnect.

  • There is a wide range of software available on ARCHER2.

  • The system is based on standard Linux with command line access.

Preparing Python for data analysis on ARCHER2
  • The cray-python module provides an enhanced Python installation on ARCHER2.

  • Many numerical packages are already provided in this installation.

  • Further packages can be added to it using pip.

Running jobs on the ARCHER2 data analysis nodes
  • Access to resources on a cluster is often governed by a scheduler like Slurm.

  • Batch systems try to provide fair access to resources to users on the system.

  • A job is run automatically once it is run on available resources.

What now?
  • Perform large tasks on ARCHER2 by running jobs on the back end.

  • Any files you generate should be transferred to your own local storage and backed up.