[2020-01-29 15:20:03]
         fs1  fs3  fs5  fs6
1  Gig   UP   UP   UP   UP 
10 Gig   n/a  UP   UP   UP 
IB       n/a  UP   UP   UP 
[2020-01-29 15:20:03]

 | 1-11|     MAINT  | 1-21|     MAINT  | 1-31|     MAINT  | 1-41|     MAINT  | 1-51|     MAINT 
 | 1-12|     MAINT  | 1-22|     MAINT  | 1-32|     MAINT  | 1-42|     MAINT  | 1-52|     MAINT 
 | 1-13|     MAINT  | 1-23|     MAINT  | 1-33|     MAINT  | 1-43|     MAINT  | 1-53|     MAINT 
 | 1-14|     MAINT  | 1-24|     MAINT  | 1-34|     MAINT  | 1-44|     MAINT  | 1-54|     MAINT 
 | 1-15|     MAINT  | 1-25|     MAINT  | 1-35|     MAINT  | 1-45|     MAINT  | 1-55|     MAINT 
 | 1-16|     MAINT  | 1-26|     MAINT  | 1-36|     MAINT  | 1-46|     MAINT  | 1-56|     MAINT 
 | 1-17|     MAINT  | 1-27|     MAINT  | 1-37|     MAINT  | 1-47|     MAINT  | 1-57|     MAINT 
 | 1-18|     MAINT  | 1-28|     MAINT  | 1-38|     MAINT  | 1-48|     MAINT  | 1-58|     MAINT 


 | 3-11|   OOOOOOOO | 3-21|   OOOOOOOO | 3-31|   OOOOOOOO | 3-41|   OOOOOO.. | 3-51|   OOOOOOO. | 3-61|   OOOOOOOO | 3-71|   OOOOOOO.
 | 3-12|   OOOOOOOO | 3-22|   OOOOOOOO | 3-32|   OOOOOOOO | 3-42|   OOOOOOO. | 3-52|   OOOOOOO. | 3-62|   OOOOOOO. | 3-72|   OOOOOOO.
 | 3-13|   OOOOOO.. | 3-23|   OOOOOOO. | 3-33|   OOOOOOOO | 3-43|   OOOOOOOO | 3-53|   OOOOOOO. | 3-63|   OOOOOOOO | 3-73|   OOOOOOO.
 | 3-14|   OOOOOOO. | 3-24|   OOOOOOOO | 3-34|   OOOOOOOO | 3-44|   OOOOOOOO | 3-54|   OOOOOOO. | 3-64|   OOOOOOOO | 3-74|   OOOOOOO.
 | 3-15|   OOOOOOO. | 3-25|   OOOOOOOO | 3-35|   OOOOOOOO | 3-45|   OOOOOOOO | 3-55|   OOOO.... | 3-65|   OOOO.... | 3-75|   OOOOOOOO
 | 3-16|   OOOOOOO. | 3-26|   OOOOOO.. | 3-36|   OOOOOOO. | 3-46|   OOOOOOO. | 3-56|   OOOOOOO. | 3-66|   OOO..... | 3-76|   OOO.....
 | 3-17|   OOOOOOOO | 3-27|   OOOOOOOO | 3-37|   OOOOOOO. | 3-47|   OOOOOOO. | 3-57|   OOOOOOO. | 3-67|   OOOOOOO. | 3-77|   OOO.....
 | 3-18|   OOOOOOO. | 3-28|   OOOOOOOO | 3-38|   OOOOOOO. | 3-48|   OOOOOOO. | 3-58|   OOOOOOOO | 3-68|   OOOOOO.. | 3-78|   O.......


 | 4-11|   OOOOOOO. | 4-21|     DOWN   | 4-31|   OOO..... | 4-41|   OOOOOOO. | 4-51|   OOOOOO.. | 4-61|   OOOOO... | 4-71|   OOOOO... | 4-81|   OOOOOOO. | 4-91|   OOOOOOOO
 | 4-12|   OOOOOOO. | 4-22|   OOO..... | 4-32|   OOOOOO.. | 4-42|   OOOOOOO. | 4-52|   OOOOO... | 4-62|   OOOOOO.. | 4-72|   OOOOO... | 4-82|   OOOOOOO. | 4-92|   OOOO....
 | 4-13|   OOOOOOO. | 4-23|   OO...... | 4-33|   OOOOOOO. | 4-43|   OOOOOOO. | 4-53|   OOOOOO.. | 4-63|   OOOOOOO. | 4-73|   OOO..... | 4-83|   OO......
 | 4-14|   OOOOOOO. | 4-24|   OOOOO... | 4-34|   OOOOOOO. | 4-44|     DOWN   | 4-54|   OOO..... | 4-64|   OOOOOOO. | 4-74|   OOOOOOO. | 4-84|   OOOOOOO.


 | 5- 1|   OOOOOOO. | 5-11|   OOOOO... | 5-21|   OOOOOOO.
 | 5- 2|   OOOOOOO. | 5-12|   OOOOO... | 5-22|   OOOOOOOO
 | 5- 3|   OOOOOOO. | 5-13|   OOOOOOO. | 5-23|   OOOOOOOO
 | 5- 4|   OO...... | 5-14|   OOO..... | 5-24|   OOOOOOO.
 | 5- 5|   OOOOOOOO | 5-15|   OOOOOOO. | 5-25|   OOOOOOO.
 | 5- 6|   OOOOOOO. | 5-16|   OOOOOO.. | 5-26|   OOO.....
 | 5- 7|   OOOOOOO. | 5-17|   OOOOOOOO | 5-27|   OOOOOOO.
 | 5- 8|   OOOOOOOO | 5-18|   OOOOOOO. | 5-28|   OOOOOOOO
 | 5- 9|   OOOOOOO. | 5-19|   OOOOOOO. | 5-29|   OOOOOOO.
 | 5-10|   OOO..... | 5-20|   OOOOOOO. | 5-30|   OOOOOOO.


 | 9- 1|   ........
 | 9- 2|   ........
 | 9- 3|   ........


 |10- 1|   OOOOOOOO
 |10- 2|   O.......


Totals:
Total cores: 3576 
Total memory: 35.50 TiB 

Down:
Down cores: 48 (  1.34%) 
Down memory: 0.50 TiB (  1.41%) 

Used:
Used cores: 1800 ( 50.34%) 
Used memory: 16.99 TiB ( 47.86%) 

Utilization excluding down
CPU utilization:  51.02% (global)  47.80% (average per node)
Memory utilization:  48.54% (global)  45.88% (average per node)

Average per node utilization (excluding down):  62.61% 

[2020-01-29 15:20:03]
s04n21 Not responding 
s04n44 Not responding 

[2020-01-29 15:20:04]
[store03 s94n01] Controller 0
[store03 s94n01] VD: 0
[store03 s94n01] Virtual Drive  0 - RAID1 -  - Optimal
[store03 s94n01] 
[store03 s94n02] Controller 0
[store03 s94n02] VD: 0
[store03 s94n02] Virtual Drive  0 - RAID1 -  - Optimal
[store03 s94n02] 
[store03 s95n01] Controller 0
[store03 s95n01] VD: 0
[store03 s95n01] Virtual Drive  0 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n01] Virtual Drive  1 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n01] Virtual Drive  2 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n01] Virtual Drive  3 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n01] Virtual Drive  4 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n01] Virtual Drive  5 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n01] Virtual Drive  6 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n01] Controller 1
[store03 s95n01] VD: 0
[store03 s95n01] Virtual Drive  0 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n01] Virtual Drive  1 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n01] Virtual Drive  2 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n01] Virtual Drive  3 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n01] Virtual Drive  4 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n01] Virtual Drive  5 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n01] Virtual Drive  6 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n01] 
[store03 s95n02] Controller 0
[store03 s95n02] VD: 0
[store03 s95n02] Virtual Drive  0 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n02] Virtual Drive  1 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n02] Virtual Drive  2 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n02] Virtual Drive  3 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n02] Virtual Drive  4 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n02] Virtual Drive  5 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n02] Virtual Drive  6 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n02] Virtual Drive  7 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n02] Virtual Drive  8 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n02] Virtual Drive  9 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n02] Virtual Drive 10 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n02] Virtual Drive 11 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n02] Virtual Drive 12 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n02] Virtual Drive 13 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s95n02] 
[store03 s96n01] Controller 0
[store03 s96n01] VD: 7
[store03 s96n01] Virtual Drive  7 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n01] Virtual Drive  8 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n01] Virtual Drive  9 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n01] Virtual Drive 10 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n01] Virtual Drive 11 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n01] Virtual Drive 12 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n01] Virtual Drive 13 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n01] Controller 1
[store03 s96n01] VD: 0
[store03 s96n01] Virtual Drive  0 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n01] Virtual Drive  1 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n01] Virtual Drive  2 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n01] Virtual Drive  3 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n01] Virtual Drive  4 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n01] Virtual Drive  5 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n01] Virtual Drive  6 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n01] 
[store03 s96n02] Controller 0
[store03 s96n02] VD: 0
[store03 s96n02] Virtual Drive  0 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n02] Virtual Drive  1 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n02] Virtual Drive  2 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n02] Virtual Drive  3 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n02] Virtual Drive  4 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n02] Virtual Drive  5 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n02] Virtual Drive  6 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n02] Virtual Drive  7 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n02] Virtual Drive  8 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n02] Virtual Drive  9 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n02] Virtual Drive 10 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n02] Virtual Drive 11 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n02] Virtual Drive 12 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n02] Virtual Drive 13 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s96n02] 
[store03 s97n01] Controller 0
[store03 s97n01] VD: 0
[store03 s97n01] Virtual Drive  0 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n01] Virtual Drive  1 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n01] Virtual Drive  2 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n01] Virtual Drive  3 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n01] Virtual Drive  4 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n01] Virtual Drive  5 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n01] Virtual Drive  6 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n01] Controller 1
[store03 s97n01] VD: 0
[store03 s97n01] Virtual Drive  0 - RAID1 -  - Optimal
[store03 s97n01] Controller 2
[store03 s97n01] VD: 0
[store03 s97n01] Virtual Drive  0 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n01] Virtual Drive  1 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n01] Virtual Drive  2 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n01] Virtual Drive  3 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n01] Virtual Drive  4 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n01] Virtual Drive  5 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n01] Virtual Drive  6 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n01] 
[store03 s97n02] Controller 0
[store03 s97n02] VD: 0
[store03 s97n02] Virtual Drive  0 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n02] Virtual Drive  1 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n02] Virtual Drive  2 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n02] Virtual Drive  3 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n02] Virtual Drive  4 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n02] Virtual Drive  5 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n02] Virtual Drive  6 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n02] Controller 1
[store03 s97n02] VD: 0
[store03 s97n02] Virtual Drive  0 - RAID1 -  - Optimal
[store03 s97n02] Controller 2
[store03 s97n02] VD: 0
[store03 s97n02] Virtual Drive  0 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n02] Virtual Drive  1 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n02] Virtual Drive  2 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n02] Virtual Drive  3 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n02] Virtual Drive  4 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n02] Virtual Drive  5 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n02] Virtual Drive  6 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s97n02] 
[store03 s98n01] Controller 0
[store03 s98n01] VD: 0
[store03 s98n01] Virtual Drive  0 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n01] Virtual Drive  1 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n01] Virtual Drive  2 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n01] Virtual Drive  3 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n01] Virtual Drive  4 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n01] Virtual Drive  5 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n01] Virtual Drive  6 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n01] Controller 1
[store03 s98n01] VD: 0
[store03 s98n01] Virtual Drive  0 - RAID1 -  - Optimal
[store03 s98n01] Controller 2
[store03 s98n01] VD: 0
[store03 s98n01] Virtual Drive  0 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n01] Virtual Drive  1 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n01] Virtual Drive  2 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n01] Virtual Drive  3 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n01] Virtual Drive  4 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n01] Virtual Drive  5 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n01] Virtual Drive  6 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n01] 
[store03 s98n02] Controller 0
[store03 s98n02] VD: 0
[store03 s98n02] Virtual Drive  0 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n02] Virtual Drive  1 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n02] Virtual Drive  2 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n02] Virtual Drive  3 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n02] Virtual Drive  4 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n02] Virtual Drive  5 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n02] Virtual Drive  6 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n02] Controller 1
[store03 s98n02] VD: 0
[store03 s98n02] Virtual Drive  0 - RAID1 -  - Optimal
[store03 s98n02] Controller 2
[store03 s98n02] VD: 0
[store03 s98n02] Virtual Drive  0 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n02] Virtual Drive  1 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n02] Virtual Drive  2 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n02] Virtual Drive  3 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n02] Virtual Drive  4 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n02] Virtual Drive  5 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n02] Virtual Drive  6 - RAID6 - UUUUUUUUUUUU - Optimal
[store03 s98n02] 
[2020-01-29 15:15:05]
    NodeID   TargetID         Pool           Total            Used            Free   Use% Usage Bar                    ITotal        IFree     %
    ======   ========         ====           =====            ====            ====   ==== =========                    ======        =====     =
      9501       3001       normal       80008.1GB       33484.0GB       46524.1GB    42% [########            ]      1490.3M      1488.5M  100%
      9501       3002       normal       80008.1GB       35563.2GB       44444.8GB    44% [#########           ]      1490.3M      1488.5M  100%
      9501       3003       normal       80008.1GB       34092.6GB       45915.4GB    43% [#########           ]      1490.3M      1488.5M  100%
      9501       3004       normal       80008.1GB       34925.8GB       45082.3GB    44% [#########           ]      1490.3M      1488.5M  100%
      9501       3005       normal       80008.1GB       37733.2GB       42274.9GB    47% [#########           ]      1490.3M      1488.5M  100%
      9501       3006       normal       80008.1GB       34486.4GB       45521.7GB    43% [#########           ]      1490.3M      1488.5M  100%
      9501       3007       normal       80008.1GB       32337.1GB       47671.0GB    40% [########            ]      1490.3M      1488.7M  100%
      9501       3008       normal       80008.1GB       40824.2GB       39183.9GB    51% [##########          ]      1490.3M      1488.5M  100%
      9501       3009       normal       80008.1GB       35955.9GB       44052.2GB    45% [#########           ]      1490.3M      1488.5M  100%
      9501       3010       normal       80008.1GB       34552.8GB       45455.3GB    43% [#########           ]      1490.3M      1488.5M  100%
      9501       3011       normal       80008.1GB       36342.3GB       43665.7GB    45% [#########           ]      1490.3M      1488.5M  100%
      9501       3012       normal       80008.1GB       36909.4GB       43098.7GB    46% [#########           ]      1490.3M      1488.5M  100%
      9501       3013       normal       80008.1GB       35746.0GB       44262.1GB    45% [#########           ]      1490.3M      1488.5M  100%
      9502       3014       normal       80008.1GB       36864.4GB       43143.7GB    46% [#########           ]      1490.3M      1488.5M  100%
      9502       3015       normal       80008.1GB       36828.4GB       43179.6GB    46% [#########           ]      1490.3M      1488.5M  100%
      9502       3016       normal       80008.1GB       32852.2GB       47155.8GB    41% [########            ]      1490.3M      1488.6M  100%
      9502       3017       normal       80008.1GB       35673.3GB       44334.7GB    45% [#########           ]      1490.3M      1488.5M  100%
      9502       3018       normal       80008.1GB       36777.4GB       43230.7GB    46% [#########           ]      1490.3M      1488.5M  100%
      9502       3019       normal       80008.1GB       35320.2GB       44687.9GB    44% [#########           ]      1490.3M      1488.5M  100%
      9502       3020       normal       80008.1GB       35689.5GB       44318.6GB    45% [#########           ]      1490.3M      1488.5M  100%
      9601       3021       normal       80008.1GB       34116.2GB       45891.8GB    43% [#########           ]      1490.3M      1488.5M  100%
      9601       3022       normal       80008.1GB       37923.0GB       42085.1GB    47% [#########           ]      1490.3M      1488.5M  100%
      9601       3023       normal       80008.1GB       35780.0GB       44228.1GB    45% [#########           ]      1490.3M      1488.5M  100%
      9601       3024       normal       80008.1GB       35544.2GB       44463.9GB    44% [#########           ]      1490.3M      1488.5M  100%
      9601       3025       normal       80008.1GB       36067.3GB       43940.8GB    45% [#########           ]      1490.3M      1488.5M  100%
      9601       3026       normal       80008.1GB       34568.9GB       45439.2GB    43% [#########           ]      1490.3M      1488.5M  100%
      9601       3027       normal       80008.1GB       34684.4GB       45323.6GB    43% [#########           ]      1490.3M      1488.5M  100%
      9601       3028       normal       80008.1GB       38066.8GB       41941.3GB    48% [##########          ]      1490.3M      1488.5M  100%
      9601       3029       normal       80008.1GB       35603.1GB       44404.9GB    44% [#########           ]      1490.3M      1488.5M  100%
      9601       3030       normal       80008.1GB       35343.4GB       44664.7GB    44% [#########           ]      1490.3M      1488.5M  100%
      9601       3031       normal       80008.1GB       36086.2GB       43921.9GB    45% [#########           ]      1490.3M      1488.5M  100%
      9601       3032       normal       80008.1GB       34811.7GB       45196.4GB    44% [#########           ]      1490.3M      1488.5M  100%
      9601       3033       normal       80008.1GB       34182.2GB       45825.9GB    43% [#########           ]      1490.3M      1488.5M  100%
      9601       3034       normal       80008.1GB       36535.3GB       43472.8GB    46% [#########           ]      1490.3M      1488.5M  100%
      9602       3035       normal       80008.1GB       37285.9GB       42722.1GB    47% [#########           ]      1490.3M      1488.5M  100%
      9602       3036       normal       80008.1GB       35972.2GB       44035.9GB    45% [#########           ]      1490.3M      1488.5M  100%
      9602       3037       normal       80008.1GB       35481.6GB       44526.5GB    44% [#########           ]      1490.3M      1488.5M  100%
      9602       3038       normal       80008.1GB       35390.1GB       44618.0GB    44% [#########           ]      1490.3M      1488.6M  100%
      9602       3039       normal       80008.1GB       37146.3GB       42861.8GB    46% [#########           ]      1490.3M      1488.5M  100%
      9602       3040       normal       80008.1GB       36001.3GB       44006.8GB    45% [#########           ]      1490.3M      1488.5M  100%
      9602       3041       normal       80008.1GB       33704.4GB       46303.7GB    42% [########            ]      1490.3M      1488.5M  100%
      9701       3042          low      119987.9GB       89421.9GB       30565.9GB    75% [###############     ]      2235.0M      2226.1M  100%
      9701       3043          low      119987.9GB       87247.8GB       32740.1GB    73% [###############     ]      2235.0M      2226.1M  100%
      9701       3044          low      119987.9GB       91771.6GB       28216.3GB    76% [###############     ]      2235.0M      2226.1M  100%
      9701       3045          low      119987.9GB       89281.4GB       30706.4GB    74% [###############     ]      2235.0M      2226.1M  100%
      9701       3046          low      119987.9GB       90489.6GB       29498.3GB    75% [###############     ]      2235.0M      2226.1M  100%
      9701       3047          low      119987.9GB       87590.9GB       32397.0GB    73% [###############     ]      2235.0M      2226.1M  100%
      9701       3048          low      119987.9GB       89978.3GB       30009.5GB    75% [###############     ]      2235.0M      2226.1M  100%
      9701       3049          low      119987.9GB       88304.5GB       31683.3GB    74% [###############     ]      2235.0M      2226.1M  100%
      9701       3050          low      119987.9GB       89824.5GB       30163.4GB    75% [###############     ]      2235.0M      2226.1M  100%
      9701       3051          low      119987.9GB       90052.3GB       29935.6GB    75% [###############     ]      2235.0M      2226.1M  100%
      9701       3052          low      119987.9GB       90207.6GB       29780.2GB    75% [###############     ]      2235.0M      2226.1M  100%
      9701       3053          low      119987.9GB       88652.8GB       31335.1GB    74% [###############     ]      2235.0M      2226.1M  100%
      9701       3054          low      119987.9GB       89501.9GB       30486.0GB    75% [###############     ]      2235.0M      2226.1M  100%
      9701       3055          low      119987.9GB       90567.2GB       29420.6GB    75% [###############     ]      2235.0M      2226.1M  100%
      9702       3056          low      119987.9GB       89630.4GB       30357.4GB    75% [###############     ]      2235.0M      2226.1M  100%
      9702       3057          low      119987.9GB       88205.1GB       31782.7GB    74% [###############     ]      2235.0M      2226.1M  100%
      9702       3058          low      119987.9GB       90048.6GB       29939.2GB    75% [###############     ]      2235.0M      2226.1M  100%
      9702       3059          low      119987.9GB       89490.9GB       30497.0GB    75% [###############     ]      2235.0M      2226.1M  100%
      9702       3060          low      119987.9GB       88606.9GB       31380.9GB    74% [###############     ]      2235.0M      2226.1M  100%
      9702       3061          low      119987.9GB       90116.4GB       29871.5GB    75% [###############     ]      2235.0M      2226.1M  100%
      9702       3062          low      119987.9GB       88306.4GB       31681.5GB    74% [###############     ]      2235.0M      2226.1M  100%
      9702       3063          low      119987.9GB       90570.7GB       29417.2GB    75% [###############     ]      2235.0M      2226.1M  100%
      9702       3064          low      119987.9GB       88372.9GB       31614.9GB    74% [###############     ]      2235.0M      2226.1M  100%
      9702       3065          low      119987.9GB       87831.8GB       32156.1GB    73% [###############     ]      2235.0M      2226.1M  100%
      9702       3066          low      119987.9GB       92247.9GB       27740.0GB    77% [###############     ]      2235.0M      2226.1M  100%
      9702       3067          low      119987.9GB       89906.7GB       30081.2GB    75% [###############     ]      2235.0M      2226.1M  100%
      9702       3068          low      119987.9GB       88798.3GB       31189.6GB    74% [###############     ]      2235.0M      2226.1M  100%
      9702       3069          low      119987.9GB       87542.4GB       32445.4GB    73% [###############     ]      2235.0M      2226.1M  100%
      9801       3070          low      119987.9GB       87827.1GB       32160.7GB    73% [###############     ]      2235.0M      2226.1M  100%
      9801       3071          low      119987.9GB       72172.2GB       47815.7GB    60% [############        ]      2235.0M      2229.1M  100%
      9801       3072          low      119987.9GB       89139.1GB       30848.7GB    74% [###############     ]      2235.0M      2226.1M  100%
      9801       3073          low      119987.9GB       89449.9GB       30537.9GB    75% [###############     ]      2235.0M      2226.1M  100%
      9801       3074          low      119987.9GB       90167.1GB       29820.7GB    75% [###############     ]      2235.0M      2226.1M  100%
      9801       3075          low      119987.9GB       88260.2GB       31727.7GB    74% [###############     ]      2235.0M      2226.1M  100%
      9801       3076          low      119987.9GB       87104.0GB       32883.9GB    73% [###############     ]      2235.0M      2226.1M  100%
      9801       3077          low      119987.9GB       90565.5GB       29422.3GB    75% [###############     ]      2235.0M      2226.1M  100%
      9801       3078          low      119987.9GB       89095.6GB       30892.3GB    74% [###############     ]      2235.0M      2226.1M  100%
      9801       3079          low      119987.9GB       88070.1GB       31917.8GB    73% [###############     ]      2235.0M      2226.1M  100%
      9801       3080          low      119987.9GB       73278.5GB       46709.3GB    61% [############        ]      2235.0M      2229.0M  100%
      9801       3081          low      119987.9GB       90021.7GB       29966.2GB    75% [###############     ]      2235.0M      2226.1M  100%
      9801       3082          low      119987.9GB       88589.0GB       31398.9GB    74% [###############     ]      2235.0M      2226.1M  100%
      9801       3083          low      119987.9GB       91058.2GB       28929.7GB    76% [###############     ]      2235.0M      2226.1M  100%
      9802       3084          low      119987.9GB       89180.1GB       30807.8GB    74% [###############     ]      2235.0M      2226.1M  100%
      9802       3085          low      119987.9GB       90365.2GB       29622.7GB    75% [###############     ]      2235.0M      2226.1M  100%
      9802       3086          low      119987.9GB       89746.9GB       30241.0GB    75% [###############     ]      2235.0M      2226.1M  100%
      9802       3087          low      119987.9GB       87922.4GB       32065.4GB    73% [###############     ]      2235.0M      2226.1M  100%
      9802       3088          low      119987.9GB       89848.6GB       30139.2GB    75% [###############     ]      2235.0M      2226.1M  100%
      9802       3089          low      119987.9GB       90733.9GB       29254.0GB    76% [###############     ]      2235.0M      2226.1M  100%
      9802       3090          low      119987.9GB       87482.8GB       32505.0GB    73% [###############     ]      2235.0M      2226.1M  100%
      9802       3091          low      119987.9GB       88130.1GB       31857.8GB    73% [###############     ]      2235.0M      2226.1M  100%
      9802       3092          low      119987.9GB       88493.4GB       31494.5GB    74% [###############     ]      2235.0M      2226.1M  100%
      9802       3093          low      119987.9GB       87967.7GB       32020.2GB    73% [###############     ]      2235.0M      2226.1M  100%
      9802       3094          low      119987.9GB       89421.8GB       30566.0GB    75% [###############     ]      2235.0M      2226.1M  100%
      9802       3095          low      119987.9GB       88574.8GB       31413.1GB    74% [###############     ]      2235.0M      2226.1M  100%
      9802       3096          low      119987.9GB       89708.4GB       30279.4GB    75% [###############     ]      2235.0M      2226.1M  100%
      9802       3097          low      119987.9GB       89419.7GB       30568.2GB    75% [###############     ]      2235.0M      2226.1M  100%
      9502       3098       normal      119993.9GB       36419.4GB       83574.5GB    30% [######              ]      2235.1M      2233.3M  100%
      9502       3099       normal      119993.9GB       36551.5GB       83442.4GB    30% [######              ]      2235.1M      2233.3M  100%
      9502       3100       normal      119993.9GB       35516.6GB       84477.3GB    30% [######              ]      2235.1M      2233.3M  100%
      9502       3101       normal      119993.9GB       36349.0GB       83644.9GB    30% [######              ]      2235.1M      2233.3M  100%
      9502       3102       normal      119993.9GB       34529.9GB       85463.9GB    29% [######              ]      2235.1M      2233.3M  100%
      9502       3103       normal      119993.9GB       36538.4GB       83455.5GB    30% [######              ]      2235.1M      2233.3M  100%
      9502       3104       normal      119993.9GB       36951.9GB       83042.0GB    31% [######              ]      2235.1M      2233.3M  100%
      9602       3105       normal      119993.9GB       36865.6GB       83128.3GB    31% [######              ]      2235.1M      2233.3M  100%
      9602       3106       normal      119993.9GB       35165.2GB       84828.6GB    29% [######              ]      2235.1M      2233.3M  100%
      9602       3107       normal      119993.9GB       35620.6GB       84373.2GB    30% [######              ]      2235.1M      2233.3M  100%
      9602       3108       normal      119993.9GB       36191.1GB       83802.8GB    30% [######              ]      2235.1M      2233.3M  100%
      9602       3109       normal      119993.9GB       37645.7GB       82348.2GB    31% [######              ]      2235.1M      2233.3M  100%
      9602       3110       normal      119993.9GB       35267.7GB       84726.2GB    29% [######              ]      2235.1M      2233.3M  100%
      9602       3111       normal      119993.9GB       34790.9GB       85203.0GB    29% [######              ]      2235.1M      2233.3M  100%

Total size of /faststorage             11679565.5 GB
Total used space on /faststorage        6932017.8 GB
Total free space on /faststorage        4747547.6 GB

                                 Use%   59.35%

2020-01-29 15:21:08.069637244 +01:00
   SSSSSSSSSSSSSSS                                            iiii
 SS:::::::::::::::S                                          i::::i
S:::::SSSSSS::::::S                                           iiii
S:::::S     SSSSSSS
S:::::S            uuuuuu    uuuuuuvvvvvvv           vvvvvvviiiiiii
S:::::S            u::::u    u::::u v:::::v         v:::::v i:::::i
 S::::SSSS         u::::u    u::::u  v:::::v       v:::::v   i::::i
  SS::::::SSSSS    u::::u    u::::u   v:::::v     v:::::v    i::::i
    SSS::::::::SS  u::::u    u::::u    v:::::v   v:::::v     i::::i
       SSSSSS::::S u::::u    u::::u     v:::::v v:::::v      i::::i
            S:::::Su::::u    u::::u      v:::::v:::::v       i::::i
            S:::::Su:::::uuuu:::::u       v:::::::::v        i::::i
SSSSSSS     S:::::Su:::::::::::::::uu      v:::::::v        i::::::i
S::::::SSSSSS:::::S u:::::::::::::::u       v:::::v         i::::::i
S:::::::::::::::SS   uu::::::::uu:::u        v:::v          i::::::i
 SSSSSSSSSSSSSSS       uuuuuuuu  uuuu         vvv           iiiiiiii

                                        FreeBSD - The Power to Serve
[2020-01-29 11:12:02] s01n37 resumed
[2020-01-29 11:12:02] s01n36 resumed
[2020-01-29 11:12:02] s01n32 resumed
[2020-01-29 10:54:02] s01n44 resumed
[2020-01-29 10:46:02] s01n44 now marked for drain: sanity-check: /faststorage not available 
[2020-01-29 10:46:02] s01n37 now marked for drain: sanity-check: /faststorage not available 
[2020-01-29 10:46:02] s01n36 now marked for drain: sanity-check: /faststorage not available 
[2020-01-29 10:46:02] s01n32 now marked for drain: sanity-check: /faststorage not available 
[2020-01-29 10:44:02] s01n58 resumed
[2020-01-29 10:44:02] s01n57 resumed
[2020-01-29 10:44:02] s01n56 resumed
[2020-01-29 10:44:02] s01n54 resumed
[2020-01-29 10:44:02] s01n53 resumed
[2020-01-29 10:44:02] s01n48 resumed
[2020-01-29 10:44:02] s01n47 resumed
[2020-01-29 10:44:02] s01n46 resumed
[2020-01-29 10:44:02] s01n45 resumed
[2020-01-29 10:44:02] s01n44 resumed
[2020-01-29 10:44:02] s01n43 resumed
[2020-01-29 10:44:02] s01n42 resumed
[2020-01-29 10:44:02] s01n41 resumed
[2020-01-29 10:44:02] s01n38 resumed
[2020-01-29 10:44:02] s01n37 resumed
[2020-01-29 10:44:02] s01n36 resumed
[2020-01-29 10:44:02] s01n35 resumed
[2020-01-29 10:44:02] s01n34 resumed
[2020-01-29 10:44:02] s01n33 resumed
[2020-01-29 10:44:02] s01n32 resumed
[2020-01-29 10:44:02] s01n31 resumed
[2020-01-29 10:44:02] s01n15 resumed
[2020-01-29 09:30:02] s01n55 resumed
[2020-01-29 09:22:02] s01n21 resumed
[2020-01-29 09:16:02] s01n52 resumed
[2020-01-29 09:16:02] s01n51 resumed
[2020-01-29 09:16:02] s01n28 resumed
[2020-01-29 09:16:02] s01n26 resumed
[2020-01-29 09:16:02] s01n25 resumed
[2020-01-29 09:16:02] s01n24 resumed
[2020-01-29 09:16:02] s01n22 resumed
[2020-01-29 09:16:02] s01n18 resumed
[2020-01-29 09:16:02] s01n17 resumed
[2020-01-29 09:16:02] s01n16 resumed
[2020-01-29 09:16:02] s01n14 resumed
[2020-01-29 09:16:02] s01n12 resumed
[2020-01-29 09:16:02] s01n11 resumed
[2020-01-29 08:20:03] s01n27 resumed
[2020-01-29 08:16:03] s01n27 now marked for drain: sanity-check: can't ping gfs3 
[2020-01-29 07:44:03] s01n52 now marked for drain: sanity-check: /faststorage not available 
[2020-01-29 07:44:03] s01n26 now marked for drain: sanity-check: /faststorage not available 
[2020-01-29 07:44:03] s01n25 now marked for drain: sanity-check: /faststorage not available 
[2020-01-29 07:44:03] s01n22 now marked for drain: sanity-check: /faststorage not available 
[2020-01-29 15:00:03]
Backup on    fs1  finished 0-07:33:48 ago
Backup on    fs2 initiated 3-21:15:01 ago
Backup on    fs3  finished 0-10:11:02 ago
Backup on    fs5 initiated 30-17:00:01 ago
Backup on    fs6  finished 2-10:15:14 ago
Backup on s95n01  finished 3-06:41:38 ago
[2020-01-29 15:20:03]
################
# RUNNING JOBS #
################
Count  USER      MIN_CPUS  MIN_MEMORY  TIMELIMIT
-----  ----      --------  ----------  ---------
1      anbt      16        164G        12:00:00
1      aslakkh   1         256G        1-00:00:00
1      aslakkh   4         128G        4:00:00
1      belen     28        120G        20:00:00
1      cactus    12        2G          4-04:00:00
1      cactus    4         512M        2-02:00:00
1      clara     24        256G        2-00:00:00
1      dario     4         99G         3-00:55:00
1      doug      1         35G         12:00:00
1      elivee    1         4G          6:00:00
1      gualpo    1         128G        8:00:00
1      igrove    1         64G         3-03:00:00
1      inhs      1         120G        12:00:00
1      jinren    8         16G         2-02:01:00
1      jjduan    1         50G         2-00:00:00
1      jrouv     12        256G        12:00:00
1      kalle     1         128G        4-04:00:00
1      lefa      24        124G        3-18:00:00
1      leh       4         64G         2-12:00:00
1      lucie     1         100G        1-16:00:00
1      lucie     1         10G         10:00:00
1      lucie     1         10G         50:00
1      lucie     1         110G        2-02:00:00
1      michaelk  2         16G         4:00:00
1      mtv       1         18G         11:45:00
1      mtxellrb  1         200G        4:00:00
1      noor      12        384G        4-00:00:00
1      samuele   4         20G         8:00:00
1      sla       8         128G        12:00:00
2      doug      4         35G         12:00:00
2      michaelk  1         8G          1:00:00
2      mtxellrb  1         200G        3-00:00:00
2      samuele   4         100G        8:00:00
3      andyb     8         64G         1-00:00:00
3      b960499   1         32G         4:00:00
3      dario     4         99G         3-23:55:00
3      lucie     1         10G         20:00:00
3      mhc       1         20G         10:00:00
3      michaelk  1         8G          4:00:00
4      anksi     1         30G         4:00:00
4      clara     16        128G        1-00:00:00
4      daniel    1         8G          12:00:00
4      elivee    8         32G         12:00:00
4      michaelk  1         8G          12:00:00
5      elivee    8         32G         3-00:00:00
7      sla       16        128G        12:00:00
9      doug      1         35G         15:00:00
10     rohde     1         30G         2-02:00:00
23     juraj     1         8G          12:00:00
30     michaelk  4         8G          2:00:00
46     jossti    1         7G          8:00:00
308    il        1         30G         1-00:00:00
776    joern     1         1G          4:00:00
###############
# QUEUED JOBS #
###############
Count  USER      MIN_CPUS  MIN_MEMORY  TIMELIMIT
-----  ----      --------  ----------  ---------
1      cactus    10        12G         5-00:00:00
1      il        1         24G         12:00:00
1      joern     1         64G         10:00
1      leandro   16        64G         6-16:00:00
1      leandro   8         32G         5-00:00:00
1      lefa      2         124G        12:00:00
1      michaelk  1         8G          1:00:00
1      mschrodl  1         4G          10-00:00:00
1      sla       16        128G        12:00:00
2      il        8         32G         12:00:00
2      joern     1         64G         8:00:00
4      lucie     16        64G         20:00:00
4      marichim  10        32G         7-00:00:00
5      il        1         30G         1-00:00:00
5      lucie     1         100G        8-08:00:00
23     echs      1         4G          4-00:00:00
30     michaelk  4         8G          2:00:00
96     igrove    1         64G         3-03:00:00
385    joern     1         1G          4:00:00
431    belen     28        120G        20:00:00
734    jossti    1         7G          8:00:00
878    samuele   4         32G         12:00:00
891    andyb     8         64G         1-00:00:00
1060   lucie     1         100G        1-16:00:00
 
#################
# CPUs per User #
#################
NCPUs  USER      QOS
-----  ----      ---
1      aslakkh   bumped
1      gualpo    bumped
1      igrove    qos2
1      inhs      bumped
1      jjduan    bumped
1      kalle     qos1
1      mtv       bumped
1      mtxellrb  bumped
2      mtxellrb  qos1
3      b960499   bumped
3      lucie     bumped
3      mhc       bumped
4      anksi     bumped
4      aslakkh   basic
4      daniel    bumped
4      leh       bumped
4      lucie     qos1
4      samuele   qos1
8      jinren    bumped
8      samuele   bumped
8      sla       bumped
10     rohde     bumped
12     jossti    bumped
12     jrouv     bumped
12     noor      bumped
16     anbt      bumped
16     cactus    bumped
16     dario     qos1
18     doug      qos1
23     juraj     bumped
24     andyb     bumped
24     lefa      bumped
28     belen     bumped
34     jossti    basic
73     elivee    qos1
88     clara     qos1
112    sla       basic
131    michaelk  qos1
308    il        qos1
776    joern     basic
########################
# QUEUED CPUs per User #
########################
NCPUs  USER      QOS
-----  ----      ---
1      lucie     bumped
1      mschrodl  basic
2      joern     bumped
2      lefa      basic
5      igrove    bumped
10     cactus    bumped
10     marichim  bumped
16     sla       basic
22     il        qos1
23     echs      bumped
24     leandro   bumped
30     marichim  basic
91     igrove    qos2
121    michaelk  qos1
386    joern     basic
734    jossti    basic
1128   lucie     qos1
3512   samuele   qos1
7128   andyb     qos1
12068  belen     basic
[2020-01-28 17:02:03]
### Node diagnostics (experimental) ###