08/06/2025 08:19:36 AM UTC [INFO] Looking for nodes with lapsed holdoff...
08/06/2025 08:19:36 AM UTC [INFO] Press Ctrl-C to stop.
/home/kernelci/pipeline/src/timeout.py:119: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC).
  'holdoff__lt': datetime.isoformat(datetime.utcnow()),
08/06/2025 08:19:36 AM UTC [DEBUG] 68930ba54caf53ccd87ab3bb RUNNING: 0
08/06/2025 08:19:36 AM UTC [DEBUG] 68930ba54caf53ccd87ab3bb RUNNING (recursive): 0
08/06/2025 08:19:36 AM UTC [DEBUG] 68930ba54caf53ccd87ab3bb DONE
08/06/2025 08:20:37 AM UTC [DEBUG] 68930b554caf53ccd87ab376 RUNNING: 0
08/06/2025 08:20:37 AM UTC [DEBUG] 68930b554caf53ccd87ab376 RUNNING (recursive): 0
08/06/2025 08:20:37 AM UTC [DEBUG] 68930b664caf53ccd87ab389 RUNNING: 0
08/06/2025 08:20:37 AM UTC [DEBUG] 68930b664caf53ccd87ab389 RUNNING (recursive): 0
08/06/2025 08:20:37 AM UTC [DEBUG] 68930b554caf53ccd87ab376 DONE
08/06/2025 08:20:37 AM UTC [DEBUG] 68930b664caf53ccd87ab389 DONE
08/06/2025 08:21:37 AM UTC [DEBUG] 68930aba4caf53ccd87aad84 RUNNING: 0
08/06/2025 08:21:37 AM UTC [DEBUG] 68930aba4caf53ccd87aad84 RUNNING (recursive): 0
08/06/2025 08:21:37 AM UTC [DEBUG] 68930ae64caf53ccd87aadb0 RUNNING: 0
08/06/2025 08:21:37 AM UTC [DEBUG] 68930ae64caf53ccd87aadb0 RUNNING (recursive): 0
08/06/2025 08:21:37 AM UTC [DEBUG] 68930b234caf53ccd87ab346 RUNNING: 0
08/06/2025 08:21:37 AM UTC [DEBUG] 68930b234caf53ccd87ab346 RUNNING (recursive): 0
08/06/2025 08:21:37 AM UTC [DEBUG] 68930b794caf53ccd87ab39a RUNNING: 0
08/06/2025 08:21:37 AM UTC [DEBUG] 68930b794caf53ccd87ab39a RUNNING (recursive): 0
08/06/2025 08:21:37 AM UTC [DEBUG] 68930c544caf53ccd87ab40a RUNNING: 0
08/06/2025 08:21:37 AM UTC [DEBUG] 68930c544caf53ccd87ab40a RUNNING (recursive): 0
08/06/2025 08:21:37 AM UTC [DEBUG] 68930aba4caf53ccd87aad84 DONE
08/06/2025 08:21:37 AM UTC [DEBUG] 68930ae64caf53ccd87aadb0 DONE
08/06/2025 08:21:38 AM UTC [DEBUG] 68930b234caf53ccd87ab346 DONE
08/06/2025 08:21:38 AM UTC [DEBUG] 68930b794caf53ccd87ab39a DONE
08/06/2025 08:21:38 AM UTC [DEBUG] 68930c544caf53ccd87ab40a DONE
08/06/2025 08:22:38 AM UTC [DEBUG] 68930c604caf53ccd87ab413 RUNNING: 1
08/06/2025 08:22:38 AM UTC [DEBUG] 68930c604caf53ccd87ab413 HOLDOFF
08/06/2025 08:23:38 AM UTC [DEBUG] 68930b064caf53ccd87ab32e RUNNING: 0
08/06/2025 08:23:38 AM UTC [DEBUG] 68930b064caf53ccd87ab32e RUNNING (recursive): 0
08/06/2025 08:23:38 AM UTC [DEBUG] 68930b274caf53ccd87ab34d RUNNING: 7
08/06/2025 08:23:38 AM UTC [DEBUG] 68930c584caf53ccd87ab40d RUNNING: 0
08/06/2025 08:23:38 AM UTC [DEBUG] 68930c584caf53ccd87ab40d RUNNING (recursive): 0
08/06/2025 08:23:38 AM UTC [DEBUG] 68930b274caf53ccd87ab34d HOLDOFF
08/06/2025 08:23:38 AM UTC [DEBUG] 68930b064caf53ccd87ab32e DONE
08/06/2025 08:23:38 AM UTC [DEBUG] 68930c584caf53ccd87ab40d DONE
08/06/2025 08:24:38 AM UTC [DEBUG] 68930aa94caf53ccd87aad73 RUNNING: 0
08/06/2025 08:24:38 AM UTC [DEBUG] 68930aa94caf53ccd87aad73 RUNNING (recursive): 0
08/06/2025 08:24:38 AM UTC [DEBUG] 68930ad04caf53ccd87aad9d RUNNING: 0
08/06/2025 08:24:39 AM UTC [DEBUG] 68930ad04caf53ccd87aad9d RUNNING (recursive): 0
08/06/2025 08:24:39 AM UTC [DEBUG] 68930b2e4caf53ccd87ab353 RUNNING: 0
08/06/2025 08:24:39 AM UTC [DEBUG] 68930b2e4caf53ccd87ab353 RUNNING (recursive): 0
08/06/2025 08:24:39 AM UTC [DEBUG] 68930b894caf53ccd87ab3a6 RUNNING: 0
08/06/2025 08:24:39 AM UTC [DEBUG] 68930b894caf53ccd87ab3a6 RUNNING (recursive): 0
08/06/2025 08:24:39 AM UTC [DEBUG] 68930aa94caf53ccd87aad73 DONE
08/06/2025 08:24:39 AM UTC [DEBUG] 68930ad04caf53ccd87aad9d DONE
08/06/2025 08:24:39 AM UTC [DEBUG] 68930b2e4caf53ccd87ab353 DONE
08/06/2025 08:24:39 AM UTC [DEBUG] 68930b894caf53ccd87ab3a6 DONE
08/06/2025 08:25:39 AM UTC [DEBUG] 68930aaf4caf53ccd87aad7b RUNNING: 0
08/06/2025 08:25:39 AM UTC [DEBUG] 68930aaf4caf53ccd87aad7b RUNNING (recursive): 0
08/06/2025 08:25:39 AM UTC [DEBUG] 68930afd4caf53ccd87aadc3 RUNNING: 1
08/06/2025 08:25:39 AM UTC [DEBUG] 68930b3e4caf53ccd87ab360 RUNNING: 0
08/06/2025 08:25:39 AM UTC [DEBUG] 68930b3e4caf53ccd87ab360 RUNNING (recursive): 0
08/06/2025 08:25:39 AM UTC [DEBUG] 68930b514caf53ccd87ab373 RUNNING: 1
08/06/2025 08:25:39 AM UTC [DEBUG] 68930c5c4caf53ccd87ab410 RUNNING: 2
08/06/2025 08:25:39 AM UTC [DEBUG] 68930afd4caf53ccd87aadc3 HOLDOFF
08/06/2025 08:25:39 AM UTC [DEBUG] 68930b514caf53ccd87ab373 HOLDOFF
08/06/2025 08:25:39 AM UTC [DEBUG] 68930c5c4caf53ccd87ab410 HOLDOFF
08/06/2025 08:25:39 AM UTC [DEBUG] 68930aaf4caf53ccd87aad7b DONE
08/06/2025 08:25:39 AM UTC [DEBUG] 68930b3e4caf53ccd87ab360 DONE
08/06/2025 08:26:39 AM UTC [DEBUG] 68930ac44caf53ccd87aad94 RUNNING: 23
08/06/2025 08:26:39 AM UTC [DEBUG] 68930b204caf53ccd87ab343 RUNNING: 21
08/06/2025 08:26:39 AM UTC [DEBUG] 68930ac44caf53ccd87aad94 HOLDOFF
08/06/2025 08:26:39 AM UTC [DEBUG] 68930b204caf53ccd87ab343 HOLDOFF
08/06/2025 08:28:40 AM UTC [DEBUG] 68930af54caf53ccd87aadbd RUNNING: 1
08/06/2025 08:28:40 AM UTC [DEBUG] 68930b5e4caf53ccd87ab383 RUNNING: 0
08/06/2025 08:28:40 AM UTC [DEBUG] 68930b5e4caf53ccd87ab383 RUNNING (recursive): 0
08/06/2025 08:28:40 AM UTC [DEBUG] 68930b694caf53ccd87ab38c RUNNING: 0
08/06/2025 08:28:40 AM UTC [DEBUG] 68930b694caf53ccd87ab38c RUNNING (recursive): 0
08/06/2025 08:28:40 AM UTC [DEBUG] 68930b6d4caf53ccd87ab38f RUNNING: 0
08/06/2025 08:28:40 AM UTC [DEBUG] 68930b6d4caf53ccd87ab38f RUNNING (recursive): 0
08/06/2025 08:28:40 AM UTC [DEBUG] 68930b754caf53ccd87ab397 RUNNING: 0
08/06/2025 08:28:40 AM UTC [DEBUG] 68930b754caf53ccd87ab397 RUNNING (recursive): 0
08/06/2025 08:28:40 AM UTC [DEBUG] 68930af54caf53ccd87aadbd HOLDOFF
08/06/2025 08:28:40 AM UTC [DEBUG] 68930b5e4caf53ccd87ab383 DONE
08/06/2025 08:28:40 AM UTC [DEBUG] 68930b694caf53ccd87ab38c DONE
08/06/2025 08:28:40 AM UTC [DEBUG] 68930b6d4caf53ccd87ab38f DONE
08/06/2025 08:28:40 AM UTC [DEBUG] 68930b754caf53ccd87ab397 DONE
08/06/2025 08:29:40 AM UTC [DEBUG] 68930b424caf53ccd87ab363 RUNNING: 0
08/06/2025 08:29:40 AM UTC [DEBUG] 68930b424caf53ccd87ab363 RUNNING (recursive): 0
08/06/2025 08:29:40 AM UTC [DEBUG] 68930b424caf53ccd87ab363 DONE
08/06/2025 08:30:40 AM UTC [DEBUG] 68930aa64caf53ccd87aad70 RUNNING: 0
08/06/2025 08:30:40 AM UTC [DEBUG] 68930aa64caf53ccd87aad70 RUNNING (recursive): 0
08/06/2025 08:30:40 AM UTC [DEBUG] 68930aa64caf53ccd87aad70 DONE
08/06/2025 08:31:40 AM UTC [DEBUG] 68930b0d4caf53ccd87ab334 RUNNING: 0
08/06/2025 08:31:40 AM UTC [DEBUG] 68930b0d4caf53ccd87ab334 RUNNING (recursive): 0
08/06/2025 08:31:40 AM UTC [DEBUG] 68930b624caf53ccd87ab386 RUNNING: 0
08/06/2025 08:31:41 AM UTC [DEBUG] 68930b624caf53ccd87ab386 RUNNING (recursive): 0
08/06/2025 08:31:41 AM UTC [DEBUG] 68930b814caf53ccd87ab3a0 RUNNING: 0
08/06/2025 08:31:41 AM UTC [DEBUG] 68930b814caf53ccd87ab3a0 RUNNING (recursive): 0
08/06/2025 08:31:41 AM UTC [DEBUG] 68930b994caf53ccd87ab3b2 RUNNING: 0
08/06/2025 08:31:41 AM UTC [DEBUG] 68930b994caf53ccd87ab3b2 RUNNING (recursive): 0
08/06/2025 08:31:41 AM UTC [DEBUG] 6893101d498bf8a0e6f66498 RUNNING: 21
08/06/2025 08:31:41 AM UTC [DEBUG] 6893101d498bf8a0e6f66498 HOLDOFF
08/06/2025 08:31:41 AM UTC [DEBUG] 68930b0d4caf53ccd87ab334 DONE
08/06/2025 08:31:41 AM UTC [DEBUG] 68930b624caf53ccd87ab386 DONE
08/06/2025 08:31:41 AM UTC [DEBUG] 68930b814caf53ccd87ab3a0 DONE
08/06/2025 08:31:41 AM UTC [DEBUG] 68930b994caf53ccd87ab3b2 DONE
08/06/2025 08:32:41 AM UTC [DEBUG] 68930b3a4caf53ccd87ab35d RUNNING: 0
08/06/2025 08:32:41 AM UTC [DEBUG] 68930b3a4caf53ccd87ab35d RUNNING (recursive): 0
08/06/2025 08:32:41 AM UTC [DEBUG] 68930b4d4caf53ccd87ab36c RUNNING: 0
08/06/2025 08:32:41 AM UTC [DEBUG] 68930b4d4caf53ccd87ab36c RUNNING (recursive): 0
08/06/2025 08:32:41 AM UTC [DEBUG] 68930b584caf53ccd87ab379 RUNNING: 1
08/06/2025 08:32:41 AM UTC [DEBUG] 68930b584caf53ccd87ab379 HOLDOFF
08/06/2025 08:32:41 AM UTC [DEBUG] 68930b3a4caf53ccd87ab35d DONE
08/06/2025 08:32:41 AM UTC [DEBUG] 68930b4d4caf53ccd87ab36c DONE
08/06/2025 08:33:41 AM UTC [DEBUG] 68930bb94caf53ccd87ab3ce RUNNING: 1
08/06/2025 08:33:41 AM UTC [DEBUG] 68930bb94caf53ccd87ab3ce HOLDOFF
08/06/2025 08:34:41 AM UTC [DEBUG] 68930c1e4caf53ccd87ab3e3 RUNNING: 0
08/06/2025 08:34:41 AM UTC [DEBUG] 68930c1e4caf53ccd87ab3e3 RUNNING (recursive): 0
08/06/2025 08:34:41 AM UTC [DEBUG] 68930c434caf53ccd87ab3fe RUNNING: 0
08/06/2025 08:34:42 AM UTC [DEBUG] 68930c434caf53ccd87ab3fe RUNNING (recursive): 0
08/06/2025 08:34:42 AM UTC [DEBUG] 68930c1e4caf53ccd87ab3e3 DONE
08/06/2025 08:34:42 AM UTC [DEBUG] 68930c434caf53ccd87ab3fe DONE
08/06/2025 08:35:42 AM UTC [DEBUG] 68930c2f4caf53ccd87ab3ef RUNNING: 0
08/06/2025 08:35:42 AM UTC [DEBUG] 68930c2f4caf53ccd87ab3ef RUNNING (recursive): 0
08/06/2025 08:35:42 AM UTC [DEBUG] 68930c2f4caf53ccd87ab3ef DONE
08/06/2025 08:36:42 AM UTC [DEBUG] 68930b9d4caf53ccd87ab3b5 RUNNING: 0
08/06/2025 08:36:42 AM UTC [DEBUG] 68930b9d4caf53ccd87ab3b5 RUNNING (recursive): 0
08/06/2025 08:36:42 AM UTC [DEBUG] 689310a4498bf8a0e6f66507 RUNNING: 0
08/06/2025 08:36:42 AM UTC [DEBUG] 689310a4498bf8a0e6f66507 RUNNING (recursive): 0
08/06/2025 08:36:42 AM UTC [DEBUG] 68930b9d4caf53ccd87ab3b5 DONE
08/06/2025 08:36:42 AM UTC [DEBUG] 689310a4498bf8a0e6f66507 DONE
08/06/2025 08:37:42 AM UTC [DEBUG] 68930aac4caf53ccd87aad78 RUNNING: 0
08/06/2025 08:37:42 AM UTC [DEBUG] 68930aac4caf53ccd87aad78 RUNNING (recursive): 0
08/06/2025 08:37:42 AM UTC [DEBUG] 68931088498bf8a0e6f664e1 RUNNING: 0
08/06/2025 08:37:42 AM UTC [DEBUG] 68931088498bf8a0e6f664e1 RUNNING (recursive): 0
08/06/2025 08:37:42 AM UTC [DEBUG] 68930aac4caf53ccd87aad78 DONE
08/06/2025 08:37:42 AM UTC [DEBUG] 68931088498bf8a0e6f664e1 DONE
08/06/2025 08:38:42 AM UTC [DEBUG] 68930aa44caf53ccd87aad6d RUNNING: 0
08/06/2025 08:38:42 AM UTC [DEBUG] 68930aa44caf53ccd87aad6d RUNNING (recursive): 0
08/06/2025 08:38:42 AM UTC [DEBUG] 68930adc4caf53ccd87aada7 RUNNING: 0
08/06/2025 08:38:42 AM UTC [DEBUG] 68930adc4caf53ccd87aada7 RUNNING (recursive): 0
08/06/2025 08:38:42 AM UTC [DEBUG] 68930aa44caf53ccd87aad6d DONE
08/06/2025 08:38:42 AM UTC [DEBUG] 68930adc4caf53ccd87aada7 DONE
08/06/2025 08:39:42 AM UTC [DEBUG] 68930b034caf53ccd87ab32b RUNNING: 0
08/06/2025 08:39:43 AM UTC [DEBUG] 68930b034caf53ccd87ab32b RUNNING (recursive): 0
08/06/2025 08:39:43 AM UTC [DEBUG] 68930b7d4caf53ccd87ab39d RUNNING: 19
08/06/2025 08:39:43 AM UTC [DEBUG] 68930b954caf53ccd87ab3af RUNNING: 0
08/06/2025 08:39:43 AM UTC [DEBUG] 68930b954caf53ccd87ab3af RUNNING (recursive): 0
08/06/2025 08:39:43 AM UTC [DEBUG] 6893107c498bf8a0e6f664d6 RUNNING: 0
08/06/2025 08:39:43 AM UTC [DEBUG] 6893107c498bf8a0e6f664d6 RUNNING (recursive): 0
08/06/2025 08:39:43 AM UTC [DEBUG] 68930b7d4caf53ccd87ab39d HOLDOFF
08/06/2025 08:39:43 AM UTC [DEBUG] 68930b034caf53ccd87ab32b DONE
08/06/2025 08:39:43 AM UTC [DEBUG] 68930b954caf53ccd87ab3af DONE
08/06/2025 08:39:43 AM UTC [DEBUG] 6893107c498bf8a0e6f664d6 DONE
08/06/2025 08:40:43 AM UTC [DEBUG] 68930b2b4caf53ccd87ab350 RUNNING: 0
08/06/2025 08:40:43 AM UTC [DEBUG] 68930b2b4caf53ccd87ab350 RUNNING (recursive): 0
08/06/2025 08:40:43 AM UTC [DEBUG] 68931072498bf8a0e6f664ce RUNNING: 0
08/06/2025 08:40:43 AM UTC [DEBUG] 68931072498bf8a0e6f664ce RUNNING (recursive): 0
08/06/2025 08:40:43 AM UTC [DEBUG] 68930b2b4caf53ccd87ab350 DONE
08/06/2025 08:40:43 AM UTC [DEBUG] 68931072498bf8a0e6f664ce DONE
08/06/2025 08:42:43 AM UTC [DEBUG] 68930aee4caf53ccd87aadb6 RUNNING: 0
08/06/2025 08:42:44 AM UTC [DEBUG] 68930aee4caf53ccd87aadb6 RUNNING (recursive): 0
08/06/2025 08:42:44 AM UTC [DEBUG] 68930aee4caf53ccd87aadb6 DONE
08/06/2025 08:43:44 AM UTC [DEBUG] 68930ab64caf53ccd87aad81 RUNNING: 0
08/06/2025 08:43:44 AM UTC [DEBUG] 68930ab64caf53ccd87aad81 RUNNING (recursive): 0
08/06/2025 08:43:44 AM UTC [DEBUG] 68930acc4caf53ccd87aad9a RUNNING: 5
08/06/2025 08:43:44 AM UTC [DEBUG] 68930b854caf53ccd87ab3a3 RUNNING: 4
08/06/2025 08:43:44 AM UTC [DEBUG] 68930c374caf53ccd87ab3f5 RUNNING: 0
08/06/2025 08:43:44 AM UTC [DEBUG] 68930c374caf53ccd87ab3f5 RUNNING (recursive): 0
08/06/2025 08:43:44 AM UTC [DEBUG] 68930c3b4caf53ccd87ab3f8 RUNNING: 23
08/06/2025 08:43:44 AM UTC [DEBUG] 689310a8498bf8a0e6f6650a RUNNING: 0
08/06/2025 08:43:44 AM UTC [DEBUG] 689310a8498bf8a0e6f6650a RUNNING (recursive): 0
08/06/2025 08:43:44 AM UTC [DEBUG] 68930acc4caf53ccd87aad9a HOLDOFF
08/06/2025 08:43:44 AM UTC [DEBUG] 68930b854caf53ccd87ab3a3 HOLDOFF
08/06/2025 08:43:44 AM UTC [DEBUG] 68930c3b4caf53ccd87ab3f8 HOLDOFF
08/06/2025 08:43:44 AM UTC [DEBUG] 68930ab64caf53ccd87aad81 DONE
08/06/2025 08:43:44 AM UTC [DEBUG] 68930c374caf53ccd87ab3f5 DONE
08/06/2025 08:43:45 AM UTC [DEBUG] 689310a8498bf8a0e6f6650a DONE
08/06/2025 08:44:45 AM UTC [DEBUG] 6893105e498bf8a0e6f664ae RUNNING: 0
08/06/2025 08:44:45 AM UTC [DEBUG] 6893105e498bf8a0e6f664ae RUNNING (recursive): 0
08/06/2025 08:44:45 AM UTC [DEBUG] 6893105e498bf8a0e6f664ae DONE
08/06/2025 08:48:11 AM UTC [INFO] Stopping.