send a mail to the customer to inform him that i have monitored the system and the below are evidence :
svc_dt v1.0.33 (svc_tools v2.11.1) Started 2023-05-19 08:39:33

Date Total DT Unknown # Unready # RIS Fail # Dump Fail # Check type Time since check Check successful

2023-05-19 08:39:44 2176 0 0 0 0 Manual Check 0m 6s True
2023-05-19 08:38:43 2176 0 0 0 0 AutoCheck 1m 7s True
2023-05-19 08:37:33 2176 0 0 0 0 AutoCheck 2m 17s True
2023-05-19 08:36:22 2176 0 0 0 0 AutoCheck 3m 28s True
2023-05-19 08:35:12 2176 0 0 0 0 AutoCheck 4m 38s True
2023-05-19 08:34:02 2176 0 0 0 0 AutoCheck 5m 48s True
2023-05-19 08:32:51 2176 0 0 0 0 AutoCheck 6m 59s True
2023-05-19 08:31:41 2176 0 0 0 0 AutoCheck 8m 9s True
2023-05-19 08:30:30 2176 0 0 0 0 AutoCheck 9m 20s True
2023-05-19 08:29:20 2176 0 0 0 0 AutoCheck 10m 30s True


BR1 BR2 CT1 CT2 ET0 LS0 MA0 MR0 OB0 PR1 PR2 RR0 RT0 SS1 SS2 TT0
Date Unk Unr|Unk Unr|Unk Unr|Unk Unr|Unk Unr|Unk Unr|Unk Unr|Unk Unr|Unk Unr|Unk Unr|Unk Unr|Unk Unr|Unk Unr|Unk Unr|Unk Unr|Unk Unr|

2023-05-19 08:39:44 0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |
2023-05-19 08:38:43 0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |
2023-05-19 08:37:33 0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |
2023-05-19 08:36:22 0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |
2023-05-19 08:35:12 0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |
2023-05-19 08:34:02 0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |
2023-05-19 08:32:51 0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |
2023-05-19 08:31:41 0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |
2023-05-19 08:30:30 0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |
2023-05-19 08:29:20 0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |0 0 |

svc_node v1.2.16 (svc_tools v2.11.1) Started 2023-05-19 08:39:51


Total Restarts on each node (all services) from 7 hours ago to now:

Node Hostname # Service Restarts
--------------------------------------------------------
r1n1 dc2presecs01.es.ad.adp.com 0
r1n2 dc2presecs02.es.ad.adp.com 0
r1n3 dc2presecs03.es.ad.adp.com 0
r1n4 dc2presecs04.es.ad.adp.com 0
r1n5 dc2presecs05.es.ad.adp.com 0
r1n6 dc2presecs06.es.ad.adp.com 0
r1n7 dc2presecs17.es.ad.adp.com 0
r1n8 dc2presecs18.es.ad.adp.com 0
r1n9 dc2presecs19.es.ad.adp.com 0
r1n10 dc2presecs20.es.ad.adp.com 0
r2n1 dc2presecs07.es.ad.adp.com 18
r2n2 dc2presecs08.es.ad.adp.com 0
r2n3 dc2presecs09.es.ad.adp.com 0
r2n4 dc2presecs10.es.ad.adp.com 0
r2n5 dc2presecs11.es.ad.adp.com 0
r2n6 dc2presecs12.es.ad.adp.com 0
r2n7 dc2presecs13.es.ad.adp.com 0
r2n8 dc2presecs14.es.ad.adp.com 0
r3n1 dc2presecs21.es.ad.adp.com 0
r3n2 dc2presecs22.es.ad.adp.com 0
r3n3 dc2presecs23.es.ad.adp.com 0
r3n4 dc2presecs24.es.ad.adp.com 0
r3n5 dc2presecs25.es.ad.adp.com 0
r3n6 dc2presecs26.es.ad.adp.com 0

Aggregate restarts on nodes ‘all’:

Time blbsvc cm crdsvc datahd dtq evntsv georcv metrng objctl portal rm rsrcsv sr ss ssm stat trform vnest
----------------------------------------------------------------------------------------------------------------------------------------------------------------
2023-05-19 01:xx 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
2023-05-19 02:xx 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
2023-05-19 03:xx 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
2023-05-19 04:xx 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
2023-05-19 05:xx 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
2023-05-19 06:xx 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
2023-05-19 07:xx 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
2023-05-19 08:xx 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0


For detailed, per-node restart data, add the ‘-detail’ param.

svc_exec v1.0.6 (svc_tools v2.11.1) Started 2023-05-19 08:40:06

Output from node: r1n1 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 439G 242G 197G 56% /

Output from node: r1n2 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 439G 223G 216G 51% /

Output from node: r1n3 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 439G 231G 208G 53% /

Output from node: r1n4 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 439G 211G 228G 49% /

Output from node: r1n5 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 439G 215G 224G 50% /

Output from node: r1n6 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 439G 171G 268G 39% /

Output from node: r1n7 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 886G 154G 733G 18% /

Output from node: r1n8 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 886G 154G 733G 18% /

Output from node: r1n9 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 886G 153G 733G 18% /

Output from node: r1n10 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 886G 153G 733G 18% /

Output from node: r2n1 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 439G 165G 274G 38% /

Output from node: r2n2 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 439G 164G 275G 38% /

Output from node: r2n3 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 439G 164G 276G 38% /

Output from node: r2n4 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 439G 163G 277G 37% /

Output from node: r2n5 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 439G 195G 245G 45% /

Output from node: r2n6 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 439G 164G 276G 38% /

Output from node: r2n7 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 439G 163G 276G 38% /

Output from node: r2n8 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 439G 163G 276G 38% /

Output from node: r3n1 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 886G 153G 733G 18% /

Output from node: r3n2 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 886G 153G 733G 18% /

Output from node: r3n3 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 886G 153G 733G 18% /

Output from node: r3n4 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 886G 153G 733G 18% /

Output from node: r3n5 retval: 0
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ECS-LVRoot 886G 153G 733G 18% /