Research Computing and Data

RCD Town Hall on October 22nd, 2024

The Research Computing and Data (RCD) team held a Town Hall event on October 22nd, 2024 at 3 PM to share some important updates with the community. 

Below is a summary of what we discussed:

  • People
    • New People in RCD
    • ReDCAT
    • Internship Openings
    • Supercomputing 2024 (SC24)
  • Palmetto
    • Palmetto 1 End of Life
    • New Onboarding Training
    • Globus Maintenance
    • Upcoming Improvements to Palmetto 2
    • Upgrades to Indigo Backup
    • Winter 2024 Maintenance
    • Updates to Compute Node Purchasing
    • Condominium Model
    • Wall Time
  • Other Updates
    • New Specialized Workshop Series
    • Anaconda Transition
    • ColdFront Improvements
    • Account Status Check Tool
    • Cloud Beta
  • Open Discussion and Q&A

If you are interested in learning more about these topics, you can watch the recording or review the slide deck. 
Note: you must sign in with your Clemson account to view these resources, which will be available until November 23rd, 2024.

Feel free to reach out to us by submitting a support ticket, scheduling an office hours meeting, or sending a message on our chat server if you have questions or want to discuss anything from the Town Hall.

RCD Town Hall on December 6th, 2023

The Research Computing and Data (RCD) team plans to hold a town hall event on Wednesday, December 6th, 2023 from 2-3 p.m. via Zoom. Join us to hear updates about:

  • An introduction to new members of the RCD team.
  • An introduction to the new Indigo Data Lake storage system.
  • The upcoming beta period for the new cluster using the SLURM scheduler.
    • Including training opportunities.
  • Our plans for modernizing the hardware in the cluster and improving hardware stability.
  • Reminder about the upcoming decommission of /scratch1 and /fastscratch in Summer 2024.
  • … and more!

Any current student or employee is welcome to participate.

Update: Did you miss the Town Hall? You can watch the recording or view the slides online.
Note: Users must log in with through Clemson SSO to view these resources, which will be available until January 31st, 2024.

RCD Town Hall on June 20th, 2023

The Research Computing and Data (RCD) group held a town hall on Tuesday, June 20, 2023, from 2-3 p.m. via Zoom. We shared with the community that:

  • The condominium model is alive and well. Palmetto will remain available for everyone at Clemson to use at no charge, and faculty can purchase nodes for priority use.
  • We reviewed new services launched by RCD since the last town hall, including our new documentation, GitLab, Mattermost, XDMoD, and our beta Kubernetes service.
  • We have started a new user group, the REDCAT Advisory Body, to help facilitate conversations between faculty and RCD.
  • We covered our progress on the infrastructure refresh announced at the last town hall.
  • We announced the upcoming maintenance period for Palmetto between July 10th and 14th and provided details about what work will be completed.
  • We discussed the future of job scheduling on Palmetto 2 with SLURM and our plans to assist researchers transitioning from PBS.
  • We announced our new Indigo Data Lake storage system backed by VAST with all NVMe flash media and discussed the future of research storage purchases.
  • We let everyone know that our team will be attending the PEARC 23 conference and expect delays in response to support tickets between July 22nd and July 28th.

For more details, please review the slide deck and webinar recording of the town hall (Clemson login required).

RCDE Announces Summer 2023 Workshop Series

The RCDE team is excited to announce our Summer 2023 workshop series! We have 12 workshops planned, which are offered for free to any interested Clemson University students, faculty, or staff members.

Our series will cover various high-performance computing, machine learning, and software development topics. Here’s a summary of what we’ll cover:

  • Introduction to Linux
  • Introduction to Research Computing on Palmetto
  • Advanced Research Computing on Palmetto
  • Introduction to Python Programming
  • Data Processing and Visualization in Python
  • Introduction to R Programming
  • Introduction to Big Data Analytics using Spark and Python
  • Introduction to Git Version Control with GitLab
  • Machine learning in Python (sklearn)
  • Machine learning in R (caret)
  • Introduction to Deep Learning in PyTorch
  • Advanced Deep Learning in PyTorch

You can learn more about the details of each workshop, the schedule, and registration links on the upcoming live training sessions page of our documentation site.

Register today through our online system to secure your spot!

You may register up to three weeks in advance, but we ask that you cancel your registration if you can’t attend since space is limited. We also encourage you to join us in person for the best interactive experience, but some workshops have virtual attendance options if you need to join us remotely.

RCD Town Hall on December 15, 2022

The Research Computing and Data (RCD) group held a town hall on Thursday, December 15, 2022 from 2-3 p.m via Zoom. We shared with the community our new team structure, new node additions to Palmetto, new flash storage system, and our future goals.

Resulting from the community’s input, we have made the following changes:

  • The units named “CITI” (user support) and “ACI” (infrastructure support) have been eliminated.
  • The newly formed “Research Computing and Data” (RCD) division in CCIT combines RCD Engagement (formerly CITI) and RCD Infrastructure (formerly ACI) into one group to better serve the research community and to streamline operations.
  • RCD Infrastructure (RCDI) is led by Corey Ferrier and is responsible for installing, operating, and maintaining the research computing hardware infrastructure, including the Palmetto HPC cluster and data storage.
  • RCD Engagement (RCDE) is led by Jill Gemmill and is responsible for research computing user support including training, application installation, and one-on-one help with using the research computing facilities. RCDE also includes the Center for Geospatial Technologies.
  • RCD is expanding the Palmetto HPC support team and adding new support services for Cloud Computing, Machine Learning, Data Science, and regulated data such as PHI and CUI.
  • Clemson has invested $6M for a new data lake storage system, new Palmetto nodes, improved hardware for ArcGIS software, specialized machine learning nodes, and systems for secure use and analysis of regulated research data (such as PHI/HIPAA and Controlled Unclassified Information).

For more details, please review the slide deck and webinar recording of the town hall (Clemson login required).