April 22, 2025

Sciserver’s Storage capacity reached

We have reached storage capacity and need to clear old files. Please take the following actions:

a) Delete any files that are no longer in use. Try to keep your personal storage under 1 TB, if you need more than that reach out to me (see some tips below).

b) For group/team leads. Please double check with your team for any leftover data from the past that was forgotten/abandoned/no-longer-necessary. There is no mechanism to check for data that has been processed or intermediate data from you or your team’s calculations. reach out to me for further help/analysis

c) I’ll be sending out emails to individual users that seem to have accumulated a disproportionate amount disk usage. If you get an email please follow the instructions and or reach out to me for further help/analysis.

Analyze your personal data

For analyzing your personal data open the terminal in any container and run the commands to get a summary of your folders taking the most space. You’ll then be able to see the total disk usage plus get a hint of which folders are hosting the most data:

# for Storage folder
du -h --max-depth 2 ~/workspace/Storage/*/ > storage-$(date +'%d%m%Y-%H%M%S').log

# for Temporary folder
du -h --max-depth 2 ~/workspace/Temporary/*/ > temporary-$(date +'%d%m%Y-%H%M%S').log

These might take a while depending on how much data you have. Once they’re ready you’ll be able to see the size of your top folders.

New container images deployed

Container images for X-ray and eSASS have been updated: the latest version should automatically run whenever you create a new container. Existing containers continue to run with the old version.

  • The new xray and esass images have the latest version of a diverse set of software used by different groups. Expect inconsistencies and help me fix it by reporting problems with as much detail as possible.

Also, mamba is now the default program to replace conda, both are available, but we strongly encourage to start using to mamba.

  • A non-exhaustive list of new software version are:

    • ubuntu 24.04

    • nice default utilities (bat, nvim, starship)

    • conda/mamba latest

    • heasoft 6.35.1

    • ciao 4.17

    • fermi 2.2.0

    • spex 3.08.1

    • xmmsas 22.1.0

    • JS9 (available to fill in for DS9)

    • pimms 4.15

    • simput 2.6.4

    • sixte 3.0.7

    • esass eSASSusers_240410