Research Computing and Data

Upcoming Maintenance for Summer 2023

The RCD team has planned a scheduled maintenance window for the Palmetto Cluster between Monday, July 10th and Friday, July 14th, 2023. Users should expect the cluster to be unavailable during this time, and any jobs running when maintenance begins will be canceled.

We’ll be working on:

  • Introducing a new mini-cluster as a test for the SLURM scheduler, which will replace PBS on Palmetto during a future maintenance window.
  • Updating configuration on compute nodes to improve I/O performance to the Indigo data lake.
  • Preparing for the end-of-life for /scratch1 and /fastscratch, which is planned for July of 2024.
  • Upgrading infiniband drivers to improve stability and NVIDIA drivers to support newer versions of CUDA.

RCD Town Hall on June 20th, 2023

The Research Computing and Data (RCD) group held a town hall on Tuesday, June 20, 2023, from 2-3 p.m. via Zoom. We shared with the community that:

  • The condominium model is alive and well. Palmetto will remain available for everyone at Clemson to use at no charge, and faculty can purchase nodes for priority use.
  • We reviewed new services launched by RCD since the last town hall, including our new documentation, GitLab, Mattermost, XDMoD, and our beta Kubernetes service.
  • We have started a new user group, the REDCAT Advisory Body, to help facilitate conversations between faculty and RCD.
  • We covered our progress on the infrastructure refresh announced at the last town hall.
  • We announced the upcoming maintenance period for Palmetto between July 10th and 14th and provided details about what work will be completed.
  • We discussed the future of job scheduling on Palmetto 2 with SLURM and our plans to assist researchers transitioning from PBS.
  • We announced our new Indigo Data Lake storage system backed by VAST with all NVMe flash media and discussed the future of research storage purchases.
  • We let everyone know that our team will be attending the PEARC 23 conference and expect delays in response to support tickets between July 22nd and July 28th.

For more details, please review the slide deck and webinar recording of the town hall (Clemson login required).

RCDE Announces Summer 2023 Workshop Series

The RCDE team is excited to announce our Summer 2023 workshop series! We have 12 workshops planned, which are offered for free to any interested Clemson University students, faculty, or staff members.

Our series will cover various high-performance computing, machine learning, and software development topics. Here’s a summary of what we’ll cover:

  • Introduction to Linux
  • Introduction to Research Computing on Palmetto
  • Advanced Research Computing on Palmetto
  • Introduction to Python Programming
  • Data Processing and Visualization in Python
  • Introduction to R Programming
  • Introduction to Big Data Analytics using Spark and Python
  • Introduction to Git Version Control with GitLab
  • Machine learning in Python (sklearn)
  • Machine learning in R (caret)
  • Introduction to Deep Learning in PyTorch
  • Advanced Deep Learning in PyTorch

You can learn more about the details of each workshop, the schedule, and registration links on the upcoming live training sessions page of our documentation site.

Register today through our online system to secure your spot!

You may register up to three weeks in advance, but we ask that you cancel your registration if you can’t attend since space is limited. We also encourage you to join us in person for the best interactive experience, but some workshops have virtual attendance options if you need to join us remotely.

New Executive Director for RCD Infrastructure

Scott Groel was named the new Executive Director for Research Computing and Data, Infrastructure (RCDI) on May 1st, 2023. This follows the retirement of Corey Ferrier, who served at Clemson for 25 years, and operated the Palmetto Cluster since its inception in 2008.

Scratch Storage Update

An issue with the metadata servers caused an outage for /scratch1 and /fastscratch, starting on March 16th, 2023. Our storage architects have worked diligently this afternoon to re-initialize the /scratch1 and /fastscratch file systems.

While working on this issue, we have also brought our new /scratch storage system online. This is a new all-flash storage system that will be the new primary scratch storage space for Palmetto for the forseeable future.

All scratch file systems are now back online and available for use across the cluster.

However, we encourage users to continue using /scratch for their temporary storage needs. We plan to retire /scratch1 and /fastscratch during a future maintenance period, but no definitive retirement date has been set.

New RCD Documentation

On March 8th, 2023, the RCDE team deployed our new documentation site, which is hosted at docs.rcd.clemson.edu. This site will permanently replace the old documentation at palmetto.clemson.edu.

The new site was developed to make information easier to find and keep the information accurate. We hope you enjoy the modern appearance and vastly improved documentation search.

New GitLab Service

We have created a new GitLab instance at git.rcd.clemson.edu. This service will help researchers with code storage, version control, continuous integration, and continuous delivery needs.

If you want to learn more and get started, review our GitLab documentation.