08/13/2025 12:17:59 AM UTC [INFO] Looking for nodes with lapsed holdoff...
/home/kernelci/pipeline/src/timeout.py:119: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC).
  'holdoff__lt': datetime.isoformat(datetime.utcnow()),
08/13/2025 12:17:59 AM UTC [INFO] Press Ctrl-C to stop.
08/13/2025 12:26:59 AM UTC [DEBUG] 689bd6b287ae15a79a84698a RUNNING: 0
08/13/2025 12:26:59 AM UTC [DEBUG] 689bd6b287ae15a79a84698a RUNNING (recursive): 0
08/13/2025 12:26:59 AM UTC [DEBUG] 689bd6b287ae15a79a84698a DONE
08/13/2025 12:27:59 AM UTC [DEBUG] 689bd6cc87ae15a79a84699f RUNNING: 0
08/13/2025 12:27:59 AM UTC [DEBUG] 689bd6cc87ae15a79a84699f RUNNING (recursive): 0
08/13/2025 12:27:59 AM UTC [DEBUG] 689bd6d487ae15a79a8469a5 RUNNING: 1
08/13/2025 12:27:59 AM UTC [DEBUG] 689bd6d487ae15a79a8469a5 HOLDOFF
08/13/2025 12:27:59 AM UTC [DEBUG] 689bd6cc87ae15a79a84699f DONE
08/13/2025 12:28:59 AM UTC [DEBUG] 689bd6a387ae15a79a84697e RUNNING: 0
08/13/2025 12:28:59 AM UTC [DEBUG] 689bd6a387ae15a79a84697e RUNNING (recursive): 0
08/13/2025 12:28:59 AM UTC [DEBUG] 689bd9bae7c3677af8929c01 RUNNING: 21
08/13/2025 12:28:59 AM UTC [DEBUG] 689bd9bae7c3677af8929c01 HOLDOFF
08/13/2025 12:28:59 AM UTC [DEBUG] 689bd6a387ae15a79a84697e DONE
08/13/2025 12:31:00 AM UTC [DEBUG] 689bd6b587ae15a79a84698d RUNNING: 24
08/13/2025 12:31:00 AM UTC [DEBUG] 689bd6b587ae15a79a84698d HOLDOFF
08/13/2025 12:34:00 AM UTC [DEBUG] 689bd6d087ae15a79a8469a2 RUNNING: 1
08/13/2025 12:34:00 AM UTC [DEBUG] 689bd6d087ae15a79a8469a2 HOLDOFF
08/13/2025 12:35:00 AM UTC [DEBUG] 689bd69e87ae15a79a846978 RUNNING: 0
08/13/2025 12:35:00 AM UTC [DEBUG] 689bd69e87ae15a79a846978 RUNNING (recursive): 0
08/13/2025 12:35:00 AM UTC [DEBUG] 689bd69e87ae15a79a846978 DONE
08/13/2025 12:37:00 AM UTC [DEBUG] 689bd6aa87ae15a79a846984 RUNNING: 0
08/13/2025 12:37:00 AM UTC [DEBUG] 689bd6aa87ae15a79a846984 RUNNING (recursive): 0
08/13/2025 12:37:00 AM UTC [DEBUG] 689bd6aa87ae15a79a846984 DONE
08/13/2025 12:41:00 AM UTC [DEBUG] 689bda06e7c3677af8929c1e RUNNING: 0
08/13/2025 12:41:00 AM UTC [DEBUG] 689bda06e7c3677af8929c1e RUNNING (recursive): 0
08/13/2025 12:41:00 AM UTC [DEBUG] 689bda11e7c3677af8929c27 RUNNING: 1
08/13/2025 12:41:00 AM UTC [DEBUG] 689bda11e7c3677af8929c27 HOLDOFF
08/13/2025 12:41:00 AM UTC [DEBUG] 689bda06e7c3677af8929c1e DONE
08/13/2025 12:42:00 AM UTC [DEBUG] 689bd6bd87ae15a79a846993 RUNNING: 0
08/13/2025 12:42:00 AM UTC [DEBUG] 689bd6bd87ae15a79a846993 RUNNING (recursive): 0
08/13/2025 12:42:00 AM UTC [DEBUG] 689bd6bd87ae15a79a846993 DONE
08/13/2025 12:44:01 AM UTC [DEBUG] 689bd9f3e7c3677af8929c0f RUNNING: 0
08/13/2025 12:44:01 AM UTC [DEBUG] 689bd9f3e7c3677af8929c0f RUNNING (recursive): 0
08/13/2025 12:44:01 AM UTC [DEBUG] 689bda0ae7c3677af8929c21 RUNNING: 30
08/13/2025 12:44:01 AM UTC [DEBUG] 689bda0ae7c3677af8929c21 HOLDOFF
08/13/2025 12:44:01 AM UTC [DEBUG] 689bd9f3e7c3677af8929c0f DONE
08/13/2025 12:46:01 AM UTC [DEBUG] 689bd6c587ae15a79a846999 RUNNING: 0
08/13/2025 12:46:01 AM UTC [DEBUG] 689bd6c587ae15a79a846999 RUNNING (recursive): 0
08/13/2025 12:46:01 AM UTC [DEBUG] 689bd6f687ae15a79a8469b2 RUNNING: 0
08/13/2025 12:46:01 AM UTC [DEBUG] 689bd6f687ae15a79a8469b2 RUNNING (recursive): 0
08/13/2025 12:46:01 AM UTC [DEBUG] 689bd6c587ae15a79a846999 DONE
08/13/2025 12:46:01 AM UTC [DEBUG] 689bd6f687ae15a79a8469b2 DONE
08/13/2025 12:49:01 AM UTC [DEBUG] 689bd6a687ae15a79a846981 RUNNING: 0
08/13/2025 12:49:01 AM UTC [DEBUG] 689bd6a687ae15a79a846981 RUNNING (recursive): 0
08/13/2025 12:49:01 AM UTC [DEBUG] 689bda0de7c3677af8929c24 RUNNING: 0
08/13/2025 12:49:01 AM UTC [DEBUG] 689bda0de7c3677af8929c24 RUNNING (recursive): 0
08/13/2025 12:49:01 AM UTC [DEBUG] 689bd6a687ae15a79a846981 DONE
08/13/2025 12:49:01 AM UTC [DEBUG] 689bda0de7c3677af8929c24 DONE
08/13/2025 12:50:01 AM UTC [DEBUG] 689bd9f3e7c3677af8929c0c RUNNING: 0
08/13/2025 12:50:01 AM UTC [DEBUG] 689bd9f3e7c3677af8929c0c RUNNING (recursive): 0
08/13/2025 12:50:01 AM UTC [DEBUG] 689bd9fee7c3677af8929c18 RUNNING: 0
08/13/2025 12:50:01 AM UTC [DEBUG] 689bd9fee7c3677af8929c18 RUNNING (recursive): 0
08/13/2025 12:50:01 AM UTC [DEBUG] 689bd9f3e7c3677af8929c0c DONE
08/13/2025 12:50:02 AM UTC [DEBUG] 689bd9fee7c3677af8929c18 DONE
08/13/2025 12:52:02 AM UTC [DEBUG] 689bd71287ae15a79a8469b6 RUNNING: 0
08/13/2025 12:52:02 AM UTC [DEBUG] 689bd71287ae15a79a8469b6 RUNNING (recursive): 0
08/13/2025 12:52:02 AM UTC [DEBUG] 689bd71287ae15a79a8469b6 DONE
08/13/2025 12:53:02 AM UTC [DEBUG] 689bd6c887ae15a79a84699c RUNNING: 0
08/13/2025 12:53:02 AM UTC [DEBUG] 689bd6c887ae15a79a84699c RUNNING (recursive): 0
08/13/2025 12:53:02 AM UTC [DEBUG] 689bd6c887ae15a79a84699c DONE
08/13/2025 12:54:02 AM UTC [DEBUG] 689bd9f7e7c3677af8929c12 RUNNING: 0
08/13/2025 12:54:02 AM UTC [DEBUG] 689bd9f7e7c3677af8929c12 RUNNING (recursive): 0
08/13/2025 12:54:02 AM UTC [DEBUG] 689bd9f7e7c3677af8929c12 DONE
08/13/2025 12:55:02 AM UTC [DEBUG] 689bda39e7c3677af8929c4b RUNNING: 0
08/13/2025 12:55:02 AM UTC [DEBUG] 689bda39e7c3677af8929c4b RUNNING (recursive): 0
08/13/2025 12:55:02 AM UTC [DEBUG] 689bda39e7c3677af8929c4b DONE
08/13/2025 12:56:02 AM UTC [DEBUG] 689bd6b987ae15a79a846990 RUNNING: 17
08/13/2025 12:56:02 AM UTC [DEBUG] 689bd6b987ae15a79a846990 HOLDOFF
08/13/2025 01:01:02 AM UTC [DEBUG] 689bda02e7c3677af8929c1b RUNNING: 0
08/13/2025 01:01:02 AM UTC [DEBUG] 689bda02e7c3677af8929c1b RUNNING (recursive): 0
08/13/2025 01:01:02 AM UTC [DEBUG] 689bda02e7c3677af8929c1b DONE
08/13/2025 01:02:02 AM UTC [DEBUG] 689bd6d787ae15a79a8469a8 RUNNING: 1
08/13/2025 01:02:02 AM UTC [DEBUG] 689bd6d787ae15a79a8469a8 HOLDOFF
08/13/2025 01:03:02 AM UTC [DEBUG] 689bd9fbe7c3677af8929c15 RUNNING: 0
08/13/2025 01:03:03 AM UTC [DEBUG] 689bd9fbe7c3677af8929c15 RUNNING (recursive): 0
08/13/2025 01:03:03 AM UTC [DEBUG] 689bd9fbe7c3677af8929c15 DONE
08/13/2025 01:06:03 AM UTC [DEBUG] 689bda34e7c3677af8929c48 RUNNING: 0
08/13/2025 01:06:03 AM UTC [DEBUG] 689bda34e7c3677af8929c48 RUNNING (recursive): 0
08/13/2025 01:06:03 AM UTC [DEBUG] 689bda34e7c3677af8929c48 DONE
08/13/2025 01:08:03 AM UTC [DEBUG] 689bda2ce7c3677af8929c42 RUNNING: 0
08/13/2025 01:08:03 AM UTC [DEBUG] 689bda2ce7c3677af8929c42 RUNNING (recursive): 0
08/13/2025 01:08:03 AM UTC [DEBUG] 689bda2ce7c3677af8929c42 DONE
08/13/2025 01:17:03 AM UTC [DEBUG] 689bda20e7c3677af8929c39 RUNNING: 0
08/13/2025 01:17:03 AM UTC [DEBUG] 689bda20e7c3677af8929c39 RUNNING (recursive): 0
08/13/2025 01:17:03 AM UTC [DEBUG] 689bda20e7c3677af8929c39 DONE
08/13/2025 01:19:03 AM UTC [DEBUG] 689bda18e7c3677af8929c30 RUNNING: 0
08/13/2025 01:19:03 AM UTC [DEBUG] 689bda18e7c3677af8929c30 RUNNING (recursive): 0
08/13/2025 01:19:03 AM UTC [DEBUG] 689bda18e7c3677af8929c30 DONE
08/13/2025 01:21:03 AM UTC [DEBUG] 689bda15e7c3677af8929c2a RUNNING: 0
08/13/2025 01:21:03 AM UTC [DEBUG] 689bda15e7c3677af8929c2a RUNNING (recursive): 0
08/13/2025 01:21:03 AM UTC [DEBUG] 689be5c6e7c3677af892a569 RUNNING: 29
08/13/2025 01:21:03 AM UTC [DEBUG] 689be5c6e7c3677af892a569 HOLDOFF
08/13/2025 01:21:03 AM UTC [DEBUG] 689bda15e7c3677af8929c2a DONE
08/13/2025 01:28:04 AM UTC [DEBUG] 689bda24e7c3677af8929c3c RUNNING: 0
08/13/2025 01:28:04 AM UTC [DEBUG] 689bda24e7c3677af8929c3c RUNNING (recursive): 0
08/13/2025 01:28:04 AM UTC [DEBUG] 689bda24e7c3677af8929c3c DONE
08/13/2025 01:31:04 AM UTC [DEBUG] 689be64be7c3677af892a5b0 RUNNING: 0
08/13/2025 01:31:04 AM UTC [DEBUG] 689be64be7c3677af892a5b0 RUNNING (recursive): 0
08/13/2025 01:31:04 AM UTC [DEBUG] 689be64be7c3677af892a5b0 DONE
08/13/2025 01:32:04 AM UTC [DEBUG] 689be60fe7c3677af892a57d RUNNING: 0
08/13/2025 01:32:04 AM UTC [DEBUG] 689be60fe7c3677af892a57d RUNNING (recursive): 0
08/13/2025 01:32:04 AM UTC [DEBUG] 689be61ee7c3677af892a58c RUNNING: 0
08/13/2025 01:32:04 AM UTC [DEBUG] 689be61ee7c3677af892a58c RUNNING (recursive): 0
08/13/2025 01:32:04 AM UTC [DEBUG] 689be626e7c3677af892a592 RUNNING: 0
08/13/2025 01:32:04 AM UTC [DEBUG] 689be626e7c3677af892a592 RUNNING (recursive): 0
08/13/2025 01:32:04 AM UTC [DEBUG] 689be65ae7c3677af892a5bc RUNNING: 0
08/13/2025 01:32:04 AM UTC [DEBUG] 689be65ae7c3677af892a5bc RUNNING (recursive): 0
08/13/2025 01:32:04 AM UTC [DEBUG] 689be60fe7c3677af892a57d DONE
08/13/2025 01:32:04 AM UTC [DEBUG] 689be61ee7c3677af892a58c DONE
08/13/2025 01:32:04 AM UTC [DEBUG] 689be626e7c3677af892a592 DONE
08/13/2025 01:32:04 AM UTC [DEBUG] 689be65ae7c3677af892a5bc DONE
08/13/2025 01:33:04 AM UTC [DEBUG] 689be607e7c3677af892a574 RUNNING: 0
08/13/2025 01:33:05 AM UTC [DEBUG] 689be607e7c3677af892a574 RUNNING (recursive): 0
08/13/2025 01:33:05 AM UTC [DEBUG] 689be607e7c3677af892a574 DONE
08/13/2025 01:34:05 AM UTC [DEBUG] 689bda30e7c3677af8929c45 RUNNING: 1
08/13/2025 01:34:05 AM UTC [DEBUG] 689be622e7c3677af892a58f RUNNING: 0
08/13/2025 01:34:05 AM UTC [DEBUG] 689be622e7c3677af892a58f RUNNING (recursive): 0
08/13/2025 01:34:05 AM UTC [DEBUG] 689bda30e7c3677af8929c45 HOLDOFF
08/13/2025 01:34:05 AM UTC [DEBUG] 689be622e7c3677af892a58f DONE
08/13/2025 01:35:05 AM UTC [DEBUG] 689bda28e7c3677af8929c3f RUNNING: 0
08/13/2025 01:35:05 AM UTC [DEBUG] 689bda28e7c3677af8929c3f RUNNING (recursive): 0
08/13/2025 01:35:05 AM UTC [DEBUG] 689bda28e7c3677af8929c3f DONE
08/13/2025 01:36:05 AM UTC [DEBUG] 689be653e7c3677af892a5b6 RUNNING: 0
08/13/2025 01:36:05 AM UTC [DEBUG] 689be653e7c3677af892a5b6 RUNNING (recursive): 0
08/13/2025 01:36:05 AM UTC [DEBUG] 689be653e7c3677af892a5b6 DONE
08/13/2025 01:37:05 AM UTC [DEBUG] 689be62de7c3677af892a598 RUNNING: 0
08/13/2025 01:37:05 AM UTC [DEBUG] 689be62de7c3677af892a598 RUNNING (recursive): 0
08/13/2025 01:37:05 AM UTC [DEBUG] 689be62de7c3677af892a598 DONE
08/13/2025 01:39:05 AM UTC [DEBUG] 689be64fe7c3677af892a5b3 RUNNING: 0
08/13/2025 01:39:05 AM UTC [DEBUG] 689be64fe7c3677af892a5b3 RUNNING (recursive): 0
08/13/2025 01:39:05 AM UTC [DEBUG] 689be64fe7c3677af892a5b3 DONE
08/13/2025 01:41:05 AM UTC [DEBUG] 689be604e7c3677af892a56e RUNNING: 0
08/13/2025 01:41:06 AM UTC [DEBUG] 689be604e7c3677af892a56e RUNNING (recursive): 0
08/13/2025 01:41:06 AM UTC [DEBUG] 689be604e7c3677af892a56e DONE
08/13/2025 01:42:06 AM UTC [DEBUG] 689bd6c187ae15a79a846996 RUNNING: 0
08/13/2025 01:42:06 AM UTC [DEBUG] 689bd6c187ae15a79a846996 RUNNING (recursive): 0
08/13/2025 01:42:06 AM UTC [DEBUG] 689bd6c187ae15a79a846996 DONE
08/13/2025 01:43:06 AM UTC [DEBUG] 689be60be7c3677af892a57a RUNNING: 0
08/13/2025 01:43:06 AM UTC [DEBUG] 689be60be7c3677af892a57a RUNNING (recursive): 0
08/13/2025 01:43:06 AM UTC [DEBUG] 689be60be7c3677af892a57a DONE
08/13/2025 01:44:06 AM UTC [DEBUG] 689be639e7c3677af892a5a1 RUNNING: 0
08/13/2025 01:44:06 AM UTC [DEBUG] 689be639e7c3677af892a5a1 RUNNING (recursive): 0
08/13/2025 01:44:06 AM UTC [DEBUG] 689be639e7c3677af892a5a1 DONE
08/13/2025 01:46:06 AM UTC [DEBUG] 689be604e7c3677af892a571 RUNNING: 0
08/13/2025 01:46:06 AM UTC [DEBUG] 689be604e7c3677af892a571 RUNNING (recursive): 0
08/13/2025 01:46:06 AM UTC [DEBUG] 689be656e7c3677af892a5b9 RUNNING: 0
08/13/2025 01:46:06 AM UTC [DEBUG] 689be656e7c3677af892a5b9 RUNNING (recursive): 0
08/13/2025 01:46:06 AM UTC [DEBUG] 689be604e7c3677af892a571 DONE
08/13/2025 01:46:06 AM UTC [DEBUG] 689be656e7c3677af892a5b9 DONE
08/13/2025 01:47:06 AM UTC [DEBUG] 689bda1ce7c3677af8929c33 RUNNING: 24
08/13/2025 01:47:06 AM UTC [DEBUG] 689bda1ce7c3677af8929c33 HOLDOFF
08/13/2025 01:48:07 AM UTC [DEBUG] 689be629e7c3677af892a595 RUNNING: 25
08/13/2025 01:48:07 AM UTC [DEBUG] 689be629e7c3677af892a595 HOLDOFF
08/13/2025 01:50:07 AM UTC [DEBUG] 689be61ae7c3677af892a589 RUNNING: 0
08/13/2025 01:50:07 AM UTC [DEBUG] 689be61ae7c3677af892a589 RUNNING (recursive): 0
08/13/2025 01:50:07 AM UTC [DEBUG] 689be61ae7c3677af892a589 DONE
08/13/2025 01:53:07 AM UTC [DEBUG] 689be613e7c3677af892a580 RUNNING: 0
08/13/2025 01:53:07 AM UTC [DEBUG] 689be613e7c3677af892a580 RUNNING (recursive): 0
08/13/2025 01:53:07 AM UTC [DEBUG] 689be613e7c3677af892a580 DONE
08/13/2025 01:54:07 AM UTC [DEBUG] 689be631e7c3677af892a59b RUNNING: 14
08/13/2025 01:54:07 AM UTC [DEBUG] 689be631e7c3677af892a59b HOLDOFF
08/13/2025 01:55:07 AM UTC [DEBUG] 689be63ce7c3677af892a5a4 RUNNING: 0
08/13/2025 01:55:07 AM UTC [DEBUG] 689be63ce7c3677af892a5a4 RUNNING (recursive): 0
08/13/2025 01:55:07 AM UTC [DEBUG] 689be665e7c3677af892a5c5 RUNNING: 1
08/13/2025 01:55:07 AM UTC [DEBUG] 689be665e7c3677af892a5c5 HOLDOFF
08/13/2025 01:55:07 AM UTC [DEBUG] 689be63ce7c3677af892a5a4 DONE
08/13/2025 01:56:07 AM UTC [DEBUG] 689be616e7c3677af892a586 RUNNING: 0
08/13/2025 01:56:07 AM UTC [DEBUG] 689be616e7c3677af892a586 RUNNING (recursive): 0
08/13/2025 01:56:07 AM UTC [DEBUG] 689be616e7c3677af892a586 DONE
08/13/2025 01:57:07 AM UTC [DEBUG] 689be608e7c3677af892a577 RUNNING: 0
08/13/2025 01:57:07 AM UTC [DEBUG] 689be608e7c3677af892a577 RUNNING (recursive): 0
08/13/2025 01:57:07 AM UTC [DEBUG] 689be65de7c3677af892a5bf RUNNING: 1
08/13/2025 01:57:07 AM UTC [DEBUG] 689be65de7c3677af892a5bf HOLDOFF
08/13/2025 01:57:07 AM UTC [DEBUG] 689be608e7c3677af892a577 DONE
08/13/2025 01:59:08 AM UTC [DEBUG] 689be661e7c3677af892a5c2 RUNNING: 0
08/13/2025 01:59:08 AM UTC [DEBUG] 689be661e7c3677af892a5c2 RUNNING (recursive): 0
08/13/2025 01:59:08 AM UTC [DEBUG] 689be661e7c3677af892a5c2 DONE
08/13/2025 02:03:08 AM UTC [DEBUG] 689be643e7c3677af892a5aa RUNNING: 0
08/13/2025 02:03:08 AM UTC [DEBUG] 689be643e7c3677af892a5aa RUNNING (recursive): 0
08/13/2025 02:03:08 AM UTC [DEBUG] 689be643e7c3677af892a5aa DONE
08/13/2025 02:07:08 AM UTC [DEBUG] 689be647e7c3677af892a5ad RUNNING: 0
08/13/2025 02:07:08 AM UTC [DEBUG] 689be647e7c3677af892a5ad RUNNING (recursive): 0
08/13/2025 02:07:08 AM UTC [DEBUG] 689be647e7c3677af892a5ad DONE
08/13/2025 02:13:08 AM UTC [DEBUG] 689be640e7c3677af892a5a7 RUNNING: 0
08/13/2025 02:13:08 AM UTC [DEBUG] 689be640e7c3677af892a5a7 RUNNING (recursive): 0
08/13/2025 02:13:08 AM UTC [DEBUG] 689be640e7c3677af892a5a7 DONE
08/13/2025 03:45:49 AM UTC [INFO] Stopping.