08/12/2025 12:58:50 PM UTC [INFO] Looking for nodes with lapsed holdoff...
08/12/2025 12:58:50 PM UTC [INFO] Press Ctrl-C to stop.
/home/kernelci/pipeline/src/timeout.py:119: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC).
  'holdoff__lt': datetime.isoformat(datetime.utcnow()),
08/12/2025 01:10:50 PM UTC [DEBUG] 689b3a93ba8128e17f68e5a4 RUNNING: 21
08/12/2025 01:10:50 PM UTC [DEBUG] 689b3a93ba8128e17f68e5a4 HOLDOFF
08/12/2025 01:20:51 PM UTC [DEBUG] 689b3aebba8128e17f68e5cb RUNNING: 1
08/12/2025 01:20:51 PM UTC [DEBUG] 689b3aebba8128e17f68e5cb HOLDOFF
08/12/2025 01:24:51 PM UTC [DEBUG] 689b3b10ba8128e17f68e5ed RUNNING: 0
08/12/2025 01:24:51 PM UTC [DEBUG] 689b3b10ba8128e17f68e5ed RUNNING (recursive): 0
08/12/2025 01:24:51 PM UTC [DEBUG] 689b3b10ba8128e17f68e5ed DONE
08/12/2025 01:25:51 PM UTC [DEBUG] 689b3ae4ba8128e17f68e5c5 RUNNING: 28
08/12/2025 01:25:51 PM UTC [DEBUG] 689b3ae4ba8128e17f68e5c5 HOLDOFF
08/12/2025 01:27:51 PM UTC [DEBUG] 689b3aceba8128e17f68e5b0 RUNNING: 0
08/12/2025 01:27:51 PM UTC [DEBUG] 689b3aceba8128e17f68e5b0 RUNNING (recursive): 0
08/12/2025 01:27:51 PM UTC [DEBUG] 689b3aceba8128e17f68e5b0 DONE
08/12/2025 01:28:51 PM UTC [DEBUG] 689b3ae0ba8128e17f68e5c2 RUNNING: 0
08/12/2025 01:28:51 PM UTC [DEBUG] 689b3ae0ba8128e17f68e5c2 RUNNING (recursive): 0
08/12/2025 01:28:51 PM UTC [DEBUG] 689b3ae0ba8128e17f68e5c2 DONE
08/12/2025 01:29:51 PM UTC [DEBUG] 689b3ad5ba8128e17f68e5b9 RUNNING: 0
08/12/2025 01:29:51 PM UTC [DEBUG] 689b3ad5ba8128e17f68e5b9 RUNNING (recursive): 0
08/12/2025 01:29:51 PM UTC [DEBUG] 689b3adcba8128e17f68e5bf RUNNING: 0
08/12/2025 01:29:51 PM UTC [DEBUG] 689b3adcba8128e17f68e5bf RUNNING (recursive): 0
08/12/2025 01:29:51 PM UTC [DEBUG] 689b3ad5ba8128e17f68e5b9 DONE
08/12/2025 01:29:51 PM UTC [DEBUG] 689b3adcba8128e17f68e5bf DONE
08/12/2025 01:31:51 PM UTC [DEBUG] 689b3b04ba8128e17f68e5e4 RUNNING: 0
08/12/2025 01:31:51 PM UTC [DEBUG] 689b3b04ba8128e17f68e5e4 RUNNING (recursive): 0
08/12/2025 01:31:51 PM UTC [DEBUG] 689b3b04ba8128e17f68e5e4 DONE
08/12/2025 01:33:52 PM UTC [DEBUG] 689b3ae7ba8128e17f68e5c8 RUNNING: 0
08/12/2025 01:33:52 PM UTC [DEBUG] 689b3ae7ba8128e17f68e5c8 RUNNING (recursive): 0
08/12/2025 01:33:52 PM UTC [DEBUG] 689b3ae7ba8128e17f68e5c8 DONE
08/12/2025 01:34:52 PM UTC [DEBUG] 689b3af6ba8128e17f68e5d4 RUNNING: 23
08/12/2025 01:34:52 PM UTC [DEBUG] 689b3af6ba8128e17f68e5d4 HOLDOFF
08/12/2025 01:35:52 PM UTC [DEBUG] 689b3ad2ba8128e17f68e5b6 RUNNING: 0
08/12/2025 01:35:52 PM UTC [DEBUG] 689b3ad2ba8128e17f68e5b6 RUNNING (recursive): 0
08/12/2025 01:35:52 PM UTC [DEBUG] 689b3ad2ba8128e17f68e5b6 DONE
08/12/2025 01:41:52 PM UTC [DEBUG] 689b3af2ba8128e17f68e5d1 RUNNING: 0
08/12/2025 01:41:52 PM UTC [DEBUG] 689b3af2ba8128e17f68e5d1 RUNNING (recursive): 0
08/12/2025 01:41:52 PM UTC [DEBUG] 689b3b08ba8128e17f68e5e7 RUNNING: 1
08/12/2025 01:41:52 PM UTC [DEBUG] 689b3b08ba8128e17f68e5e7 HOLDOFF
08/12/2025 01:41:52 PM UTC [DEBUG] 689b3af2ba8128e17f68e5d1 DONE
08/12/2025 01:43:52 PM UTC [DEBUG] 689b3aceba8128e17f68e5b3 RUNNING: 0
08/12/2025 01:43:52 PM UTC [DEBUG] 689b3aceba8128e17f68e5b3 RUNNING (recursive): 0
08/12/2025 01:43:52 PM UTC [DEBUG] 689b3aceba8128e17f68e5b3 DONE
08/12/2025 01:51:52 PM UTC [DEBUG] 689b3af9ba8128e17f68e5d7 RUNNING: 0
08/12/2025 01:51:52 PM UTC [DEBUG] 689b3af9ba8128e17f68e5d7 RUNNING (recursive): 0
08/12/2025 01:51:52 PM UTC [DEBUG] 689b3af9ba8128e17f68e5d7 DONE
08/12/2025 01:55:52 PM UTC [DEBUG] 689b3aeeba8128e17f68e5ce RUNNING: 0
08/12/2025 01:55:52 PM UTC [DEBUG] 689b3aeeba8128e17f68e5ce RUNNING (recursive): 0
08/12/2025 01:55:52 PM UTC [DEBUG] 689b3aeeba8128e17f68e5ce DONE
08/12/2025 01:56:53 PM UTC [DEBUG] 689b3ad8ba8128e17f68e5bc RUNNING: 0
08/12/2025 01:56:53 PM UTC [DEBUG] 689b3ad8ba8128e17f68e5bc RUNNING (recursive): 0
08/12/2025 01:56:53 PM UTC [DEBUG] 689b3ad8ba8128e17f68e5bc DONE
08/12/2025 02:01:53 PM UTC [DEBUG] 689b3afdba8128e17f68e5da RUNNING: 0
08/12/2025 02:01:53 PM UTC [DEBUG] 689b3afdba8128e17f68e5da RUNNING (recursive): 0
08/12/2025 02:01:53 PM UTC [DEBUG] 689b3afdba8128e17f68e5da DONE
08/12/2025 02:17:53 PM UTC [DEBUG] 689b3b0cba8128e17f68e5ea RUNNING: 0
08/12/2025 02:17:53 PM UTC [DEBUG] 689b3b0cba8128e17f68e5ea RUNNING (recursive): 0
08/12/2025 02:17:53 PM UTC [DEBUG] 689b3b0cba8128e17f68e5ea DONE
08/12/2025 02:24:53 PM UTC [DEBUG] 689b3b00ba8128e17f68e5e1 RUNNING: 0
08/12/2025 02:24:53 PM UTC [DEBUG] 689b3b00ba8128e17f68e5e1 RUNNING (recursive): 0
08/12/2025 02:24:53 PM UTC [DEBUG] 689b3b00ba8128e17f68e5e1 DONE
08/12/2025 03:00:54 PM UTC [DEBUG] 689b5491ba8128e17f68f53f RUNNING: 21
08/12/2025 03:00:54 PM UTC [DEBUG] 689b5491ba8128e17f68f53f HOLDOFF
08/12/2025 03:10:55 PM UTC [DEBUG] 689b54e5ba8128e17f68f55d RUNNING: 0
08/12/2025 03:10:55 PM UTC [DEBUG] 689b54e5ba8128e17f68f55d RUNNING (recursive): 0
08/12/2025 03:10:55 PM UTC [DEBUG] 689b54efba8128e17f68f563 RUNNING: 0
08/12/2025 03:10:55 PM UTC [DEBUG] 689b54efba8128e17f68f563 RUNNING (recursive): 0
08/12/2025 03:10:55 PM UTC [DEBUG] 689b551dba8128e17f68f583 RUNNING: 0
08/12/2025 03:10:55 PM UTC [DEBUG] 689b551dba8128e17f68f583 RUNNING (recursive): 0
08/12/2025 03:10:55 PM UTC [DEBUG] 689b54e5ba8128e17f68f55d DONE
08/12/2025 03:10:55 PM UTC [DEBUG] 689b54efba8128e17f68f563 DONE
08/12/2025 03:10:55 PM UTC [DEBUG] 689b551dba8128e17f68f583 DONE
08/12/2025 03:11:55 PM UTC [DEBUG] 689b54f4ba8128e17f68f566 RUNNING: 2
08/12/2025 03:11:55 PM UTC [DEBUG] 689b54fdba8128e17f68f56c RUNNING: 0
08/12/2025 03:11:55 PM UTC [DEBUG] 689b54fdba8128e17f68f56c RUNNING (recursive): 0
08/12/2025 03:11:55 PM UTC [DEBUG] 689b54f4ba8128e17f68f566 HOLDOFF
08/12/2025 03:11:55 PM UTC [DEBUG] 689b54fdba8128e17f68f56c DONE
08/12/2025 03:12:55 PM UTC [DEBUG] 689b5522ba8128e17f68f586 RUNNING: 0
08/12/2025 03:12:55 PM UTC [DEBUG] 689b5522ba8128e17f68f586 RUNNING (recursive): 0
08/12/2025 03:12:55 PM UTC [DEBUG] 689b5522ba8128e17f68f586 DONE
08/12/2025 03:13:55 PM UTC [DEBUG] 689b54eaba8128e17f68f560 RUNNING: 30
08/12/2025 03:13:55 PM UTC [DEBUG] 689b54eaba8128e17f68f560 HOLDOFF
08/12/2025 03:14:55 PM UTC [DEBUG] 689b54d2ba8128e17f68f54d RUNNING: 0
08/12/2025 03:14:55 PM UTC [DEBUG] 689b54d2ba8128e17f68f54d RUNNING (recursive): 0
08/12/2025 03:14:55 PM UTC [DEBUG] 689b54d2ba8128e17f68f54d DONE
08/12/2025 03:15:56 PM UTC [DEBUG] 689b54ccba8128e17f68f54a RUNNING: 0
08/12/2025 03:15:56 PM UTC [DEBUG] 689b54ccba8128e17f68f54a RUNNING (recursive): 0
08/12/2025 03:15:56 PM UTC [DEBUG] 689b54ccba8128e17f68f54a DONE
08/12/2025 03:16:56 PM UTC [DEBUG] 689b54f8ba8128e17f68f569 RUNNING: 0
08/12/2025 03:16:56 PM UTC [DEBUG] 689b54f8ba8128e17f68f569 RUNNING (recursive): 0
08/12/2025 03:16:56 PM UTC [DEBUG] 689b54f8ba8128e17f68f569 DONE
08/12/2025 03:17:56 PM UTC [DEBUG] 689b54e0ba8128e17f68f55a RUNNING: 0
08/12/2025 03:17:56 PM UTC [DEBUG] 689b54e0ba8128e17f68f55a RUNNING (recursive): 0
08/12/2025 03:17:56 PM UTC [DEBUG] 689b5519ba8128e17f68f580 RUNNING: 0
08/12/2025 03:17:56 PM UTC [DEBUG] 689b5519ba8128e17f68f580 RUNNING (recursive): 0
08/12/2025 03:17:56 PM UTC [DEBUG] 689b54e0ba8128e17f68f55a DONE
08/12/2025 03:17:56 PM UTC [DEBUG] 689b5519ba8128e17f68f580 DONE
08/12/2025 03:18:56 PM UTC [DEBUG] 689b54d6ba8128e17f68f554 RUNNING: 0
08/12/2025 03:18:56 PM UTC [DEBUG] 689b54d6ba8128e17f68f554 RUNNING (recursive): 0
08/12/2025 03:18:56 PM UTC [DEBUG] 689b54d6ba8128e17f68f554 DONE
08/12/2025 03:20:56 PM UTC [DEBUG] 689b54ccba8128e17f68f547 RUNNING: 0
08/12/2025 03:20:56 PM UTC [DEBUG] 689b54ccba8128e17f68f547 RUNNING (recursive): 0
08/12/2025 03:20:57 PM UTC [DEBUG] 689b54dbba8128e17f68f557 RUNNING: 0
08/12/2025 03:20:57 PM UTC [DEBUG] 689b54dbba8128e17f68f557 RUNNING (recursive): 0
08/12/2025 03:20:57 PM UTC [DEBUG] 689b54ccba8128e17f68f547 DONE
08/12/2025 03:20:57 PM UTC [DEBUG] 689b54dbba8128e17f68f557 DONE
08/12/2025 03:26:57 PM UTC [DEBUG] 689b5514ba8128e17f68f57d RUNNING: 0
08/12/2025 03:26:57 PM UTC [DEBUG] 689b5514ba8128e17f68f57d RUNNING (recursive): 0
08/12/2025 03:26:57 PM UTC [DEBUG] 689b5514ba8128e17f68f57d DONE
08/12/2025 03:27:57 PM UTC [DEBUG] 689b5502ba8128e17f68f56f RUNNING: 22
08/12/2025 03:27:57 PM UTC [DEBUG] 689b5506ba8128e17f68f572 RUNNING: 0
08/12/2025 03:27:57 PM UTC [DEBUG] 689b5506ba8128e17f68f572 RUNNING (recursive): 0
08/12/2025 03:27:57 PM UTC [DEBUG] 689b550fba8128e17f68f578 RUNNING: 0
08/12/2025 03:27:57 PM UTC [DEBUG] 689b550fba8128e17f68f578 RUNNING (recursive): 0
08/12/2025 03:27:57 PM UTC [DEBUG] 689b5502ba8128e17f68f56f HOLDOFF
08/12/2025 03:27:57 PM UTC [DEBUG] 689b5506ba8128e17f68f572 DONE
08/12/2025 03:27:57 PM UTC [DEBUG] 689b550fba8128e17f68f578 DONE
08/12/2025 03:31:57 PM UTC [DEBUG] 689b550bba8128e17f68f575 RUNNING: 0
08/12/2025 03:31:57 PM UTC [DEBUG] 689b550bba8128e17f68f575 RUNNING (recursive): 0
08/12/2025 03:31:57 PM UTC [DEBUG] 689b550bba8128e17f68f575 DONE
08/12/2025 04:11:58 PM UTC [DEBUG] 689b6521ba8128e17f690275 RUNNING: 18
08/12/2025 04:11:58 PM UTC [DEBUG] 689b6521ba8128e17f690275 HOLDOFF
08/12/2025 04:21:59 PM UTC [DEBUG] 689b6595ba8128e17f6902b0 RUNNING: 0
08/12/2025 04:21:59 PM UTC [DEBUG] 689b6595ba8128e17f6902b0 RUNNING (recursive): 0
08/12/2025 04:21:59 PM UTC [DEBUG] 689b6595ba8128e17f6902b0 DONE
08/12/2025 04:23:59 PM UTC [DEBUG] 689b6575ba8128e17f69029b RUNNING: 0
08/12/2025 04:23:59 PM UTC [DEBUG] 689b6575ba8128e17f69029b RUNNING (recursive): 0
08/12/2025 04:23:59 PM UTC [DEBUG] 689b659aba8128e17f6902b3 RUNNING: 1
08/12/2025 04:23:59 PM UTC [DEBUG] 689b65a3ba8128e17f6902b9 RUNNING: 1
08/12/2025 04:23:59 PM UTC [DEBUG] 689b659aba8128e17f6902b3 HOLDOFF
08/12/2025 04:23:59 PM UTC [DEBUG] 689b65a3ba8128e17f6902b9 HOLDOFF
08/12/2025 04:23:59 PM UTC [DEBUG] 689b6575ba8128e17f69029b DONE
08/12/2025 04:24:59 PM UTC [DEBUG] 689b659fba8128e17f6902b6 RUNNING: 1
08/12/2025 04:24:59 PM UTC [DEBUG] 689b659fba8128e17f6902b6 HOLDOFF
08/12/2025 04:25:59 PM UTC [DEBUG] 689b6562ba8128e17f69028f RUNNING: 0
08/12/2025 04:25:59 PM UTC [DEBUG] 689b6562ba8128e17f69028f RUNNING (recursive): 0
08/12/2025 04:25:59 PM UTC [DEBUG] 689b6562ba8128e17f69028f DONE
08/12/2025 04:26:59 PM UTC [DEBUG] 689b655cba8128e17f69028c RUNNING: 0
08/12/2025 04:26:59 PM UTC [DEBUG] 689b655cba8128e17f69028c RUNNING (recursive): 0
08/12/2025 04:26:59 PM UTC [DEBUG] 689b655cba8128e17f69028c DONE
08/12/2025 04:27:59 PM UTC [DEBUG] 689b6579ba8128e17f69029e RUNNING: 24
08/12/2025 04:27:59 PM UTC [DEBUG] 689b6579ba8128e17f69029e HOLDOFF
08/12/2025 04:29:00 PM UTC [DEBUG] 689b6567ba8128e17f690292 RUNNING: 0
08/12/2025 04:29:00 PM UTC [DEBUG] 689b6567ba8128e17f690292 RUNNING (recursive): 0
08/12/2025 04:29:00 PM UTC [DEBUG] 689b6567ba8128e17f690292 DONE
08/12/2025 04:31:00 PM UTC [DEBUG] 689b656bba8128e17f690295 RUNNING: 0
08/12/2025 04:31:00 PM UTC [DEBUG] 689b656bba8128e17f690295 RUNNING (recursive): 0
08/12/2025 04:31:00 PM UTC [DEBUG] 689b656bba8128e17f690295 DONE
08/12/2025 04:32:00 PM UTC [DEBUG] 689b655cba8128e17f690289 RUNNING: 0
08/12/2025 04:32:00 PM UTC [DEBUG] 689b655cba8128e17f690289 RUNNING (recursive): 0
08/12/2025 04:32:00 PM UTC [DEBUG] 689b6570ba8128e17f690298 RUNNING: 0
08/12/2025 04:32:00 PM UTC [DEBUG] 689b6570ba8128e17f690298 RUNNING (recursive): 0
08/12/2025 04:32:00 PM UTC [DEBUG] 689b655cba8128e17f690289 DONE
08/12/2025 04:32:00 PM UTC [DEBUG] 689b6570ba8128e17f690298 DONE
08/12/2025 04:34:16 PM UTC [INFO] Stopping.