INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:35134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53194 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:32:40,212 - lava_callback - INFO - Received callback for node 69c40db6944faaf0e7f5e466 2026-03-25 16:32:40,219 - lava_callback - INFO - Starting async job submit for node 69c40db6944faaf0e7f5e466 INFO: 172.21.0.1:50786 - "POST /node/69c40db6944faaf0e7f5e466 HTTP/1.0" 202 Accepted 2026-03-25 16:32:40,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:32:40,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40db6944faaf0e7f5e466 HTTP/1.1" 200 None 2026-03-25 16:32:40,263 - lava_callback - DEBUG - Processing node 69c40db6944faaf0e7f5e466: baseline-arm 2026-03-25 16:32:40,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:32:40,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:32:40,645 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c40db6944faaf0e7f5e466/log.txt.gz 2026-03-25 16:32:40,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:32:40,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:32:41,000 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c40db6944faaf0e7f5e466/lava-logs.yaml 2026-03-25 16:32:41,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:32:41,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:32:41,156 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c40db6944faaf0e7f5e466/lava_callback.json.gz 2026-03-25 16:32:41,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:32:41,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40db6944faaf0e7f5e466 HTTP/1.1" 200 None 2026-03-25 16:32:41,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:32:41,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ace944faaf0e7f5e40e HTTP/1.1" 200 None 2026-03-25 16:32:41,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:32:41,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c40db6944faaf0e7f5e466 HTTP/1.1" 200 None 2026-03-25 16:32:41,257 - lava_callback - INFO - Completed processing callback for node 69c40db6944faaf0e7f5e466 INFO: 172.21.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:33:11,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:33:11,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37360 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:39:23,396 - lava_callback - INFO - Received callback for node 69c16ca82b2b51e9ad97a082 INFO: 172.21.0.1:38082 - "POST /node/69c16ca82b2b51e9ad97a082 HTTP/1.0" 202 Accepted 2026-03-25 16:39:23,401 - lava_callback - INFO - Starting async job submit for node 69c16ca82b2b51e9ad97a082 2026-03-25 16:39:23,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:23,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ca82b2b51e9ad97a082 HTTP/1.1" 200 None 2026-03-25 16:39:23,418 - lava_callback - DEBUG - Processing node 69c16ca82b2b51e9ad97a082: baseline-arm-baylibre 2026-03-25 16:39:23,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16ca82b2b51e9ad97a082 2026-03-25 16:39:23,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:23,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ca82b2b51e9ad97a082 HTTP/1.1" 200 None 2026-03-25 16:39:23,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:23,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:23,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:23,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16ca82b2b51e9ad97a082 HTTP/1.1" 200 None 2026-03-25 16:39:23,486 - lava_callback - ERROR - Error processing callback for node 69c16ca82b2b51e9ad97a082: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 16:39:24,040 - lava_callback - INFO - Received callback for node 69c16caa2b2b51e9ad97a085 INFO: 172.21.0.1:38092 - "POST /node/69c16caa2b2b51e9ad97a085 HTTP/1.0" 202 Accepted 2026-03-25 16:39:24,048 - lava_callback - INFO - Starting async job submit for node 69c16caa2b2b51e9ad97a085 2026-03-25 16:39:24,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:24,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16caa2b2b51e9ad97a085 HTTP/1.1" 200 None 2026-03-25 16:39:24,064 - lava_callback - DEBUG - Processing node 69c16caa2b2b51e9ad97a085: baseline-arm-baylibre 2026-03-25 16:39:24,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16caa2b2b51e9ad97a085 2026-03-25 16:39:24,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:24,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16caa2b2b51e9ad97a085 HTTP/1.1" 200 None 2026-03-25 16:39:24,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:24,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:24,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:24,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16caa2b2b51e9ad97a085 HTTP/1.1" 200 None 2026-03-25 16:39:24,116 - lava_callback - ERROR - Error processing callback for node 69c16caa2b2b51e9ad97a085: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 16:39:24,734 - lava_callback - INFO - Received callback for node 69c16cab2b2b51e9ad97a088 INFO: 172.21.0.1:38102 - "POST /node/69c16cab2b2b51e9ad97a088 HTTP/1.0" 202 Accepted 2026-03-25 16:39:24,740 - lava_callback - INFO - Starting async job submit for node 69c16cab2b2b51e9ad97a088 2026-03-25 16:39:24,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:24,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cab2b2b51e9ad97a088 HTTP/1.1" 200 None 2026-03-25 16:39:24,764 - lava_callback - DEBUG - Processing node 69c16cab2b2b51e9ad97a088: baseline-arm-baylibre 2026-03-25 16:39:24,764 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16cab2b2b51e9ad97a088 2026-03-25 16:39:24,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:24,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cab2b2b51e9ad97a088 HTTP/1.1" 200 None 2026-03-25 16:39:24,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:24,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:24,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:24,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cab2b2b51e9ad97a088 HTTP/1.1" 200 None 2026-03-25 16:39:24,824 - lava_callback - ERROR - Error processing callback for node 69c16cab2b2b51e9ad97a088: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 16:39:25,379 - lava_callback - INFO - Received callback for node 69c16cac2b2b51e9ad97a08b INFO: 172.21.0.1:38114 - "POST /node/69c16cac2b2b51e9ad97a08b HTTP/1.0" 202 Accepted 2026-03-25 16:39:25,385 - lava_callback - INFO - Starting async job submit for node 69c16cac2b2b51e9ad97a08b 2026-03-25 16:39:25,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:25,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cac2b2b51e9ad97a08b HTTP/1.1" 200 None 2026-03-25 16:39:25,402 - lava_callback - DEBUG - Processing node 69c16cac2b2b51e9ad97a08b: baseline-arm-baylibre 2026-03-25 16:39:25,402 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16cac2b2b51e9ad97a08b 2026-03-25 16:39:25,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:25,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cac2b2b51e9ad97a08b HTTP/1.1" 200 None 2026-03-25 16:39:25,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:25,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:25,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:25,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cac2b2b51e9ad97a08b HTTP/1.1" 200 None 2026-03-25 16:39:25,458 - lava_callback - ERROR - Error processing callback for node 69c16cac2b2b51e9ad97a08b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 16:39:26,028 - lava_callback - INFO - Received callback for node 69c16caf2b2b51e9ad97a0a5 INFO: 172.21.0.1:38128 - "POST /node/69c16caf2b2b51e9ad97a0a5 HTTP/1.0" 202 Accepted 2026-03-25 16:39:26,034 - lava_callback - INFO - Starting async job submit for node 69c16caf2b2b51e9ad97a0a5 2026-03-25 16:39:26,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:26,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16caf2b2b51e9ad97a0a5 HTTP/1.1" 200 None 2026-03-25 16:39:26,062 - lava_callback - DEBUG - Processing node 69c16caf2b2b51e9ad97a0a5: baseline-arm-baylibre 2026-03-25 16:39:26,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16caf2b2b51e9ad97a0a5 2026-03-25 16:39:26,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:26,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16caf2b2b51e9ad97a0a5 HTTP/1.1" 200 None 2026-03-25 16:39:26,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:26,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:26,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:26,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16caf2b2b51e9ad97a0a5 HTTP/1.1" 200 None 2026-03-25 16:39:26,133 - lava_callback - ERROR - Error processing callback for node 69c16caf2b2b51e9ad97a0a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38130 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:39:26,699 - lava_callback - INFO - Received callback for node 69c16cb12b2b51e9ad97a0a8 INFO: 172.21.0.1:38134 - "POST /node/69c16cb12b2b51e9ad97a0a8 HTTP/1.0" 202 Accepted 2026-03-25 16:39:26,704 - lava_callback - INFO - Starting async job submit for node 69c16cb12b2b51e9ad97a0a8 2026-03-25 16:39:26,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:26,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cb12b2b51e9ad97a0a8 HTTP/1.1" 200 None 2026-03-25 16:39:26,741 - lava_callback - DEBUG - Processing node 69c16cb12b2b51e9ad97a0a8: baseline-arm-baylibre 2026-03-25 16:39:26,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16cb12b2b51e9ad97a0a8 2026-03-25 16:39:26,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:26,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cb12b2b51e9ad97a0a8 HTTP/1.1" 200 None 2026-03-25 16:39:26,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:26,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:26,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:26,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cb12b2b51e9ad97a0a8 HTTP/1.1" 200 None 2026-03-25 16:39:26,818 - lava_callback - ERROR - Error processing callback for node 69c16cb12b2b51e9ad97a0a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:39:37,879 - lava_callback - INFO - Received callback for node 69c16cb82b2b51e9ad97a0be INFO: 172.21.0.1:51894 - "POST /node/69c16cb82b2b51e9ad97a0be HTTP/1.0" 202 Accepted 2026-03-25 16:39:37,884 - lava_callback - INFO - Starting async job submit for node 69c16cb82b2b51e9ad97a0be 2026-03-25 16:39:37,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:37,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cb82b2b51e9ad97a0be HTTP/1.1" 200 None 2026-03-25 16:39:37,900 - lava_callback - DEBUG - Processing node 69c16cb82b2b51e9ad97a0be: baseline-arm-clabbe 2026-03-25 16:39:37,900 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16cb82b2b51e9ad97a0be 2026-03-25 16:39:37,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:37,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cb82b2b51e9ad97a0be HTTP/1.1" 200 None 2026-03-25 16:39:37,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:37,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:37,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:37,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cb82b2b51e9ad97a0be HTTP/1.1" 200 None 2026-03-25 16:39:37,954 - lava_callback - ERROR - Error processing callback for node 69c16cb82b2b51e9ad97a0be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 16:39:38,567 - lava_callback - INFO - Received callback for node 69c16cbd2b2b51e9ad97a0ce INFO: 172.21.0.1:51904 - "POST /node/69c16cbd2b2b51e9ad97a0ce HTTP/1.0" 202 Accepted 2026-03-25 16:39:38,573 - lava_callback - INFO - Starting async job submit for node 69c16cbd2b2b51e9ad97a0ce 2026-03-25 16:39:38,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:38,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cbd2b2b51e9ad97a0ce HTTP/1.1" 200 None 2026-03-25 16:39:38,594 - lava_callback - DEBUG - Processing node 69c16cbd2b2b51e9ad97a0ce: baseline-arm-clabbe 2026-03-25 16:39:38,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16cbd2b2b51e9ad97a0ce 2026-03-25 16:39:38,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:38,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cbd2b2b51e9ad97a0ce HTTP/1.1" 200 None 2026-03-25 16:39:38,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:38,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:38,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:38,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cbd2b2b51e9ad97a0ce HTTP/1.1" 200 None 2026-03-25 16:39:38,651 - lava_callback - ERROR - Error processing callback for node 69c16cbd2b2b51e9ad97a0ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 16:39:39,237 - lava_callback - INFO - Received callback for node 69c16cbd2b2b51e9ad97a0d1 INFO: 172.21.0.1:51918 - "POST /node/69c16cbd2b2b51e9ad97a0d1 HTTP/1.0" 202 Accepted 2026-03-25 16:39:39,243 - lava_callback - INFO - Starting async job submit for node 69c16cbd2b2b51e9ad97a0d1 2026-03-25 16:39:39,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:39,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cbd2b2b51e9ad97a0d1 HTTP/1.1" 200 None 2026-03-25 16:39:39,259 - lava_callback - DEBUG - Processing node 69c16cbd2b2b51e9ad97a0d1: baseline-arm-clabbe 2026-03-25 16:39:39,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16cbd2b2b51e9ad97a0d1 2026-03-25 16:39:39,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:39,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cbd2b2b51e9ad97a0d1 HTTP/1.1" 200 None 2026-03-25 16:39:39,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:39,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:39,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:39,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cbd2b2b51e9ad97a0d1 HTTP/1.1" 200 None 2026-03-25 16:39:39,321 - lava_callback - ERROR - Error processing callback for node 69c16cbd2b2b51e9ad97a0d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 16:39:39,990 - lava_callback - INFO - Received callback for node 69c16cbe2b2b51e9ad97a0d4 INFO: 172.21.0.1:58838 - "POST /node/69c16cbe2b2b51e9ad97a0d4 HTTP/1.0" 202 Accepted 2026-03-25 16:39:39,995 - lava_callback - INFO - Starting async job submit for node 69c16cbe2b2b51e9ad97a0d4 2026-03-25 16:39:39,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:40,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cbe2b2b51e9ad97a0d4 HTTP/1.1" 200 None 2026-03-25 16:39:40,013 - lava_callback - DEBUG - Processing node 69c16cbe2b2b51e9ad97a0d4: baseline-arm-clabbe 2026-03-25 16:39:40,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16cbe2b2b51e9ad97a0d4 2026-03-25 16:39:40,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:40,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cbe2b2b51e9ad97a0d4 HTTP/1.1" 200 None 2026-03-25 16:39:40,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:40,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:40,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:40,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cbe2b2b51e9ad97a0d4 HTTP/1.1" 200 None 2026-03-25 16:39:40,076 - lava_callback - ERROR - Error processing callback for node 69c16cbe2b2b51e9ad97a0d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 16:39:40,664 - lava_callback - INFO - Received callback for node 69c16cc12b2b51e9ad97a0dd INFO: 172.21.0.1:58842 - "POST /node/69c16cc12b2b51e9ad97a0dd HTTP/1.0" 202 Accepted 2026-03-25 16:39:40,670 - lava_callback - INFO - Starting async job submit for node 69c16cc12b2b51e9ad97a0dd 2026-03-25 16:39:40,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:40,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cc12b2b51e9ad97a0dd HTTP/1.1" 200 None 2026-03-25 16:39:40,686 - lava_callback - DEBUG - Processing node 69c16cc12b2b51e9ad97a0dd: baseline-arm-clabbe 2026-03-25 16:39:40,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16cc12b2b51e9ad97a0dd 2026-03-25 16:39:40,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:40,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cc12b2b51e9ad97a0dd HTTP/1.1" 200 None 2026-03-25 16:39:40,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:40,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:40,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:40,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cc12b2b51e9ad97a0dd HTTP/1.1" 200 None 2026-03-25 16:39:40,785 - lava_callback - ERROR - Error processing callback for node 69c16cc12b2b51e9ad97a0dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:43:35,019 - lava_callback - INFO - Received callback for node 69c410a3944faaf0e7f60be8 INFO: 172.21.0.1:32968 - "POST /node/69c410a3944faaf0e7f60be8 HTTP/1.0" 202 Accepted 2026-03-25 16:43:35,026 - lava_callback - INFO - Starting async job submit for node 69c410a3944faaf0e7f60be8 2026-03-25 16:43:35,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:35,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a3944faaf0e7f60be8 HTTP/1.1" 200 None 2026-03-25 16:43:35,047 - lava_callback - DEBUG - Processing node 69c410a3944faaf0e7f60be8: baseline-arm 2026-03-25 16:43:35,056 - lava_callback - WARNING - Failed to upload log 2026-03-25 16:43:35,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:43:35,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:43:35,247 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a3944faaf0e7f60be8/lava-logs.yaml 2026-03-25 16:43:35,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:43:35,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:43:35,388 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a3944faaf0e7f60be8/lava_callback.json.gz 2026-03-25 16:43:35,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:35,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a3944faaf0e7f60be8 HTTP/1.1" 200 None 2026-03-25 16:43:35,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:35,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:43:35,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:35,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410a3944faaf0e7f60be8 HTTP/1.1" 200 None 2026-03-25 16:43:35,460 - lava_callback - INFO - Completed processing callback for node 69c410a3944faaf0e7f60be8 INFO: 172.21.0.1:32980 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:43:41,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:41,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 16:43:43,917 - lava_callback - INFO - Received callback for node 69c410a7944faaf0e7f60bf4 INFO: 172.21.0.1:36978 - "POST /node/69c410a7944faaf0e7f60bf4 HTTP/1.0" 202 Accepted 2026-03-25 16:43:43,967 - lava_callback - INFO - Starting async job submit for node 69c410a7944faaf0e7f60bf4 2026-03-25 16:43:43,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:44,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a7944faaf0e7f60bf4 HTTP/1.1" 200 None 2026-03-25 16:43:44,014 - lava_callback - DEBUG - Processing node 69c410a7944faaf0e7f60bf4: baseline-arm 2026-03-25 16:43:44,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:43:44,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:43:44,399 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a7944faaf0e7f60bf4/log.txt.gz 2026-03-25 16:43:44,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:43:44,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:43:44,692 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a7944faaf0e7f60bf4/lava-logs.yaml 2026-03-25 16:43:44,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:43:44,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:43:44,820 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a7944faaf0e7f60bf4/lava_callback.json.gz 2026-03-25 16:43:44,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:44,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a7944faaf0e7f60bf4 HTTP/1.1" 200 None 2026-03-25 16:43:44,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:44,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:43:44,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:44,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410a7944faaf0e7f60bf4 HTTP/1.1" 200 None 2026-03-25 16:43:44,926 - lava_callback - INFO - Completed processing callback for node 69c410a7944faaf0e7f60bf4 INFO: 172.21.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:43:57,522 - lava_callback - INFO - Received callback for node 69c410a4944faaf0e7f60beb INFO: 172.21.0.1:60574 - "POST /node/69c410a4944faaf0e7f60beb HTTP/1.0" 202 Accepted 2026-03-25 16:43:57,569 - lava_callback - INFO - Starting async job submit for node 69c410a4944faaf0e7f60beb 2026-03-25 16:43:57,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:57,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a4944faaf0e7f60beb HTTP/1.1" 200 None 2026-03-25 16:43:57,613 - lava_callback - DEBUG - Processing node 69c410a4944faaf0e7f60beb: baseline-arm 2026-03-25 16:43:57,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:43:57,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:43:57,875 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a4944faaf0e7f60beb/log.txt.gz 2026-03-25 16:43:57,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:43:58,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:43:58,110 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a4944faaf0e7f60beb/lava-logs.yaml 2026-03-25 16:43:58,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:43:58,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:43:58,263 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a4944faaf0e7f60beb/lava_callback.json.gz 2026-03-25 16:43:58,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:58,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a4944faaf0e7f60beb HTTP/1.1" 200 None 2026-03-25 16:43:58,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:58,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:43:58,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:58,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410a4944faaf0e7f60beb HTTP/1.1" 200 None 2026-03-25 16:43:58,384 - lava_callback - INFO - Completed processing callback for node 69c410a4944faaf0e7f60beb INFO: 172.21.0.1:39086 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:44:11,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:11,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48842 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:44:22,191 - lava_callback - INFO - Received callback for node 69c410a6944faaf0e7f60bf1 INFO: 172.21.0.1:45398 - "POST /node/69c410a6944faaf0e7f60bf1 HTTP/1.0" 202 Accepted 2026-03-25 16:44:22,201 - lava_callback - INFO - Starting async job submit for node 69c410a6944faaf0e7f60bf1 2026-03-25 16:44:22,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:22,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a6944faaf0e7f60bf1 HTTP/1.1" 200 None 2026-03-25 16:44:22,273 - lava_callback - DEBUG - Processing node 69c410a6944faaf0e7f60bf1: baseline-arm 2026-03-25 16:44:22,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:22,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:22,760 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a6944faaf0e7f60bf1/log.txt.gz 2026-03-25 16:44:22,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:23,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:23,076 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a6944faaf0e7f60bf1/lava-logs.yaml 2026-03-25 16:44:23,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:23,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:23,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a6944faaf0e7f60bf1/lava_callback.json.gz 2026-03-25 16:44:23,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:23,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a6944faaf0e7f60bf1 HTTP/1.1" 200 None 2026-03-25 16:44:23,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:23,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:44:23,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:23,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410a6944faaf0e7f60bf1 HTTP/1.1" 200 None 2026-03-25 16:44:23,316 - lava_callback - INFO - Completed processing callback for node 69c410a6944faaf0e7f60bf1 INFO: 172.21.0.1:45406 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:44:30,487 - lava_callback - INFO - Received callback for node 69c410a3944faaf0e7f60be5 INFO: 172.21.0.1:45102 - "POST /node/69c410a3944faaf0e7f60be5 HTTP/1.0" 202 Accepted 2026-03-25 16:44:30,502 - lava_callback - INFO - Starting async job submit for node 69c410a3944faaf0e7f60be5 2026-03-25 16:44:30,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:30,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a3944faaf0e7f60be5 HTTP/1.1" 200 None 2026-03-25 16:44:30,573 - lava_callback - DEBUG - Processing node 69c410a3944faaf0e7f60be5: baseline-arm 2026-03-25 16:44:30,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:31,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:31,273 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a3944faaf0e7f60be5/log.txt.gz 2026-03-25 16:44:31,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:31,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:31,708 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a3944faaf0e7f60be5/lava-logs.yaml 2026-03-25 16:44:31,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:32,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:32,143 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a3944faaf0e7f60be5/lava_callback.json.gz 2026-03-25 16:44:32,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:32,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a3944faaf0e7f60be5 HTTP/1.1" 200 None 2026-03-25 16:44:32,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:32,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:44:32,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:32,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410a3944faaf0e7f60be5 HTTP/1.1" 200 None 2026-03-25 16:44:32,349 - lava_callback - INFO - Completed processing callback for node 69c410a3944faaf0e7f60be5 INFO: 172.21.0.1:45110 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:44:41,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:41,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 16:44:43,396 - lava_callback - INFO - Received callback for node 69c410c8944faaf0e7f60c65 INFO: 172.21.0.1:35804 - "POST /node/69c410c8944faaf0e7f60c65 HTTP/1.0" 202 Accepted 2026-03-25 16:44:43,406 - lava_callback - INFO - Starting async job submit for node 69c410c8944faaf0e7f60c65 2026-03-25 16:44:43,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:43,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c8944faaf0e7f60c65 HTTP/1.1" 200 None 2026-03-25 16:44:43,478 - lava_callback - DEBUG - Processing node 69c410c8944faaf0e7f60c65: baseline-arm-pengutronix 2026-03-25 16:44:43,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:43,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:43,826 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c8944faaf0e7f60c65/log.txt.gz 2026-03-25 16:44:43,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:44,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:44,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c8944faaf0e7f60c65/lava-logs.yaml 2026-03-25 16:44:44,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35808 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:44:44,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:44,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c8944faaf0e7f60c65/lava_callback.json.gz 2026-03-25 16:44:44,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:44,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c8944faaf0e7f60c65 HTTP/1.1" 200 None 2026-03-25 16:44:44,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:44,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:44:44,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:44,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410c8944faaf0e7f60c65 HTTP/1.1" 200 None 2026-03-25 16:44:44,829 - lava_callback - INFO - Completed processing callback for node 69c410c8944faaf0e7f60c65 2026-03-25 16:44:45,122 - lava_callback - INFO - Received callback for node 69c410c7944faaf0e7f60c62 INFO: 172.21.0.1:35820 - "POST /node/69c410c7944faaf0e7f60c62 HTTP/1.0" 202 Accepted 2026-03-25 16:44:45,131 - lava_callback - INFO - Starting async job submit for node 69c410c7944faaf0e7f60c62 2026-03-25 16:44:45,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:45,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c7944faaf0e7f60c62 HTTP/1.1" 200 None 2026-03-25 16:44:45,235 - lava_callback - DEBUG - Processing node 69c410c7944faaf0e7f60c62: baseline-arm-pengutronix 2026-03-25 16:44:45,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:45,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:45,577 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c7944faaf0e7f60c62/log.txt.gz 2026-03-25 16:44:45,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:46,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:46,354 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c7944faaf0e7f60c62/lava-logs.yaml 2026-03-25 16:44:46,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35822 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:44:46,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:46,580 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c7944faaf0e7f60c62/lava_callback.json.gz 2026-03-25 16:44:46,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:46,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c7944faaf0e7f60c62 HTTP/1.1" 200 None 2026-03-25 16:44:46,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:46,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:44:46,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:46,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410c7944faaf0e7f60c62 HTTP/1.1" 200 None 2026-03-25 16:44:46,703 - lava_callback - INFO - Completed processing callback for node 69c410c7944faaf0e7f60c62 2026-03-25 16:44:53,472 - lava_callback - INFO - Received callback for node 69c410cb944faaf0e7f60c8d INFO: 172.21.0.1:54688 - "POST /node/69c410cb944faaf0e7f60c8d HTTP/1.0" 202 Accepted 2026-03-25 16:44:53,526 - lava_callback - INFO - Starting async job submit for node 69c410cb944faaf0e7f60c8d 2026-03-25 16:44:53,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:53,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410cb944faaf0e7f60c8d HTTP/1.1" 200 None 2026-03-25 16:44:53,588 - lava_callback - DEBUG - Processing node 69c410cb944faaf0e7f60c8d: baseline-arm-pengutronix 2026-03-25 16:44:53,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:54,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:54,010 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410cb944faaf0e7f60c8d/log.txt.gz 2026-03-25 16:44:54,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:54,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:54,533 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410cb944faaf0e7f60c8d/lava-logs.yaml 2026-03-25 16:44:54,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:54,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:54,692 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410cb944faaf0e7f60c8d/lava_callback.json.gz 2026-03-25 16:44:54,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:54,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410cb944faaf0e7f60c8d HTTP/1.1" 200 None 2026-03-25 16:44:54,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:54,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:44:54,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:54,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410cb944faaf0e7f60c8d HTTP/1.1" 200 None 2026-03-25 16:44:54,778 - lava_callback - INFO - Completed processing callback for node 69c410cb944faaf0e7f60c8d INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:45:02,143 - lava_callback - INFO - Received callback for node 69c410b6944faaf0e7f60c25 INFO: 172.21.0.1:55266 - "POST /node/69c410b6944faaf0e7f60c25 HTTP/1.0" 202 Accepted 2026-03-25 16:45:02,151 - lava_callback - INFO - Starting async job submit for node 69c410b6944faaf0e7f60c25 2026-03-25 16:45:02,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:02,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b6944faaf0e7f60c25 HTTP/1.1" 200 None 2026-03-25 16:45:02,197 - lava_callback - DEBUG - Processing node 69c410b6944faaf0e7f60c25: baseline-arm-broonie 2026-03-25 16:45:02,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:02,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:02,766 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b6944faaf0e7f60c25/log.txt.gz 2026-03-25 16:45:02,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:03,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:03,279 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b6944faaf0e7f60c25/lava-logs.yaml 2026-03-25 16:45:03,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:03,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:03,475 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b6944faaf0e7f60c25/lava_callback.json.gz 2026-03-25 16:45:03,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:03,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b6944faaf0e7f60c25 HTTP/1.1" 200 None 2026-03-25 16:45:03,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:03,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:45:03,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:03,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410b6944faaf0e7f60c25 HTTP/1.1" 200 None 2026-03-25 16:45:03,563 - lava_callback - INFO - Completed processing callback for node 69c410b6944faaf0e7f60c25 2026-03-25 16:45:03,681 - lava_callback - INFO - Received callback for node 69c410b8944faaf0e7f60c2a INFO: 172.21.0.1:55282 - "POST /node/69c410b8944faaf0e7f60c2a HTTP/1.0" 202 Accepted 2026-03-25 16:45:03,691 - lava_callback - INFO - Starting async job submit for node 69c410b8944faaf0e7f60c2a 2026-03-25 16:45:03,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:03,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b8944faaf0e7f60c2a HTTP/1.1" 200 None 2026-03-25 16:45:03,750 - lava_callback - DEBUG - Processing node 69c410b8944faaf0e7f60c2a: baseline-arm-broonie 2026-03-25 16:45:04,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:04,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:04,404 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b8944faaf0e7f60c2a/log.txt.gz 2026-03-25 16:45:04,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:05,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:05,156 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b8944faaf0e7f60c2a/lava-logs.yaml 2026-03-25 16:45:05,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:05,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:05,364 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b8944faaf0e7f60c2a/lava_callback.json.gz 2026-03-25 16:45:05,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:05,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b8944faaf0e7f60c2a HTTP/1.1" 200 None 2026-03-25 16:45:05,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:05,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:45:05,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:05,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410b8944faaf0e7f60c2a HTTP/1.1" 200 None 2026-03-25 16:45:05,457 - lava_callback - INFO - Completed processing callback for node 69c410b8944faaf0e7f60c2a INFO: 172.21.0.1:55286 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:45:11,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:11,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-25 16:45:12,494 - lava_callback - INFO - Received callback for node 69c410bd944faaf0e7f60c3d INFO: 172.21.0.1:57898 - "POST /node/69c410bd944faaf0e7f60c3d HTTP/1.0" 202 Accepted 2026-03-25 16:45:12,506 - lava_callback - INFO - Starting async job submit for node 69c410bd944faaf0e7f60c3d 2026-03-25 16:45:12,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:12,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410bd944faaf0e7f60c3d HTTP/1.1" 200 None 2026-03-25 16:45:12,583 - lava_callback - DEBUG - Processing node 69c410bd944faaf0e7f60c3d: baseline-arm-clabbe 2026-03-25 16:45:12,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:13,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:13,032 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410bd944faaf0e7f60c3d/log.txt.gz 2026-03-25 16:45:13,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:13,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:13,680 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410bd944faaf0e7f60c3d/lava-logs.yaml 2026-03-25 16:45:13,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:13,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:13,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410bd944faaf0e7f60c3d/lava_callback.json.gz 2026-03-25 16:45:13,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:13,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410bd944faaf0e7f60c3d HTTP/1.1" 200 None 2026-03-25 16:45:13,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:13,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:45:13,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:13,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410bd944faaf0e7f60c3d HTTP/1.1" 200 None 2026-03-25 16:45:13,976 - lava_callback - INFO - Completed processing callback for node 69c410bd944faaf0e7f60c3d INFO: 172.21.0.1:57910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34034 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:45:41,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:41,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 16:45:43,654 - lava_callback - INFO - Received callback for node 69c16e222b2b51e9ad97a331 INFO: 172.21.0.1:58436 - "POST /node/69c16e222b2b51e9ad97a331 HTTP/1.0" 202 Accepted 2026-03-25 16:45:43,660 - lava_callback - INFO - Starting async job submit for node 69c16e222b2b51e9ad97a331 2026-03-25 16:45:43,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:43,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16e222b2b51e9ad97a331 HTTP/1.1" 200 None 2026-03-25 16:45:43,683 - lava_callback - DEBUG - Processing node 69c16e222b2b51e9ad97a331: baseline-arm64-baylibre 2026-03-25 16:45:43,683 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16e222b2b51e9ad97a331 2026-03-25 16:45:43,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:43,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16e222b2b51e9ad97a331 HTTP/1.1" 200 None 2026-03-25 16:45:43,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:43,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 16:45:43,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:43,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16e222b2b51e9ad97a331 HTTP/1.1" 200 None 2026-03-25 16:45:43,770 - lava_callback - ERROR - Error processing callback for node 69c16e222b2b51e9ad97a331: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:46:15,144 - lava_callback - INFO - Received callback for node 69c41141944faaf0e7f60d3c INFO: 172.21.0.1:45596 - "POST /node/69c41141944faaf0e7f60d3c HTTP/1.0" 202 Accepted 2026-03-25 16:46:15,153 - lava_callback - INFO - Starting async job submit for node 69c41141944faaf0e7f60d3c INFO: 172.21.0.1:45598 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 16:46:15,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:15,204 - lava_callback - INFO - Received callback for node 69c410e6944faaf0e7f60cac 2026-03-25 16:46:15,214 - lava_callback - INFO - Starting async job submit for node 69c410e6944faaf0e7f60cac INFO: 172.21.0.1:45606 - "POST /node/69c410e6944faaf0e7f60cac HTTP/1.0" 202 Accepted 2026-03-25 16:46:15,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41141944faaf0e7f60d3c HTTP/1.1" 200 None 2026-03-25 16:46:15,267 - lava_callback - DEBUG - Processing node 69c41141944faaf0e7f60d3c: baseline-x86 2026-03-25 16:46:15,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:15,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e6944faaf0e7f60cac HTTP/1.1" 200 None 2026-03-25 16:46:15,382 - lava_callback - DEBUG - Processing node 69c410e6944faaf0e7f60cac: ltp-dio 2026-03-25 16:46:15,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:16,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:16,312 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c41141944faaf0e7f60d3c/log.txt.gz 2026-03-25 16:46:16,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:16,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:46:16,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:16,909 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69c410e6944faaf0e7f60cac/log.txt.gz 2026-03-25 16:46:16,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:16,990 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c41141944faaf0e7f60d3c/lava-logs.yaml 2026-03-25 16:46:17,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:17,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:17,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:17,600 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c41141944faaf0e7f60d3c/lava_callback.json.gz 2026-03-25 16:46:17,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:17,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41141944faaf0e7f60d3c HTTP/1.1" 200 None 2026-03-25 16:46:17,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:17,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40aef944faaf0e7f5e438 HTTP/1.1" 200 None 2026-03-25 16:46:17,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:17,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41141944faaf0e7f60d3c HTTP/1.1" 200 None 2026-03-25 16:46:17,728 - lava_callback - INFO - Completed processing callback for node 69c41141944faaf0e7f60d3c 2026-03-25 16:46:17,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:17,754 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69c410e6944faaf0e7f60cac/lava-logs.yaml 2026-03-25 16:46:17,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:18,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:18,417 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69c410e6944faaf0e7f60cac/lava_callback.json.gz 2026-03-25 16:46:18,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:18,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e6944faaf0e7f60cac HTTP/1.1" 200 None 2026-03-25 16:46:18,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:18,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:46:18,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:18,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410e6944faaf0e7f60cac HTTP/1.1" 200 None 2026-03-25 16:46:18,568 - lava_callback - INFO - Completed processing callback for node 69c410e6944faaf0e7f60cac INFO: 172.21.0.1:33404 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:46:30,383 - lava_callback - INFO - Received callback for node 69c41143944faaf0e7f60d49 INFO: 172.21.0.1:47046 - "POST /node/69c41143944faaf0e7f60d49 HTTP/1.0" 202 Accepted 2026-03-25 16:46:30,392 - lava_callback - INFO - Starting async job submit for node 69c41143944faaf0e7f60d49 2026-03-25 16:46:30,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:30,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41143944faaf0e7f60d49 HTTP/1.1" 200 None 2026-03-25 16:46:30,438 - lava_callback - DEBUG - Processing node 69c41143944faaf0e7f60d49: baseline-x86 2026-03-25 16:46:30,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:31,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:31,077 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c41143944faaf0e7f60d49/log.txt.gz 2026-03-25 16:46:31,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:31,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:31,681 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c41143944faaf0e7f60d49/lava-logs.yaml 2026-03-25 16:46:31,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:31,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:31,858 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c41143944faaf0e7f60d49/lava_callback.json.gz 2026-03-25 16:46:31,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:31,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41143944faaf0e7f60d49 HTTP/1.1" 200 None 2026-03-25 16:46:31,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:31,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40aef944faaf0e7f5e438 HTTP/1.1" 200 None 2026-03-25 16:46:31,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:31,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41143944faaf0e7f60d49 HTTP/1.1" 200 None 2026-03-25 16:46:31,962 - lava_callback - INFO - Completed processing callback for node 69c41143944faaf0e7f60d49 INFO: 172.21.0.1:47058 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:46:39,424 - lava_callback - INFO - Received callback for node 69c410be944faaf0e7f60c41 INFO: 172.21.0.1:47066 - "POST /node/69c410be944faaf0e7f60c41 HTTP/1.0" 202 Accepted 2026-03-25 16:46:39,434 - lava_callback - INFO - Starting async job submit for node 69c410be944faaf0e7f60c41 2026-03-25 16:46:39,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:39,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410be944faaf0e7f60c41 HTTP/1.1" 200 None 2026-03-25 16:46:39,509 - lava_callback - DEBUG - Processing node 69c410be944faaf0e7f60c41: baseline-arm-clabbe 2026-03-25 16:46:39,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:40,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:40,102 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410be944faaf0e7f60c41/log.txt.gz 2026-03-25 16:46:40,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:40,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:40,601 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410be944faaf0e7f60c41/lava-logs.yaml 2026-03-25 16:46:40,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:40,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:40,767 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410be944faaf0e7f60c41/lava_callback.json.gz 2026-03-25 16:46:40,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:40,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410be944faaf0e7f60c41 HTTP/1.1" 200 None 2026-03-25 16:46:40,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:40,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:46:40,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:40,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410be944faaf0e7f60c41 HTTP/1.1" 200 None 2026-03-25 16:46:40,855 - lava_callback - INFO - Completed processing callback for node 69c410be944faaf0e7f60c41 2026-03-25 16:46:41,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:41,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:47:06,859 - lava_callback - INFO - Received callback for node 69c41141944faaf0e7f60d43 INFO: 172.21.0.1:51052 - "POST /node/69c41141944faaf0e7f60d43 HTTP/1.0" 202 Accepted 2026-03-25 16:47:06,865 - lava_callback - INFO - Starting async job submit for node 69c41141944faaf0e7f60d43 2026-03-25 16:47:06,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:06,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41141944faaf0e7f60d43 HTTP/1.1" 200 None 2026-03-25 16:47:06,907 - lava_callback - DEBUG - Processing node 69c41141944faaf0e7f60d43: baseline-x86 2026-03-25 16:47:07,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:07,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:07,388 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c41141944faaf0e7f60d43/log.txt.gz 2026-03-25 16:47:07,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:07,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:07,775 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c41141944faaf0e7f60d43/lava-logs.yaml 2026-03-25 16:47:07,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:07,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:07,921 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c41141944faaf0e7f60d43/lava_callback.json.gz 2026-03-25 16:47:07,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:08,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41141944faaf0e7f60d43 HTTP/1.1" 200 None 2026-03-25 16:47:08,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:08,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40aef944faaf0e7f5e438 HTTP/1.1" 200 None 2026-03-25 16:47:08,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:08,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41141944faaf0e7f60d43 HTTP/1.1" 200 None 2026-03-25 16:47:08,059 - lava_callback - INFO - Completed processing callback for node 69c41141944faaf0e7f60d43 2026-03-25 16:47:11,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:11,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54404 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:47:19,714 - lava_callback - INFO - Received callback for node 69c41180944faaf0e7f60dc5 INFO: 172.21.0.1:54220 - "POST /node/69c41180944faaf0e7f60dc5 HTTP/1.0" 202 Accepted 2026-03-25 16:47:19,721 - lava_callback - INFO - Starting async job submit for node 69c41180944faaf0e7f60dc5 2026-03-25 16:47:19,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:19,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41180944faaf0e7f60dc5 HTTP/1.1" 200 None 2026-03-25 16:47:19,757 - lava_callback - DEBUG - Processing node 69c41180944faaf0e7f60dc5: baseline-arm64 2026-03-25 16:47:19,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:20,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:20,025 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41180944faaf0e7f60dc5/log.txt.gz 2026-03-25 16:47:20,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:20,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:20,367 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41180944faaf0e7f60dc5/lava-logs.yaml 2026-03-25 16:47:20,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:20,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:20,499 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41180944faaf0e7f60dc5/lava_callback.json.gz 2026-03-25 16:47:20,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:20,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41180944faaf0e7f60dc5 HTTP/1.1" 200 None 2026-03-25 16:47:20,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:20,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:47:20,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:20,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41180944faaf0e7f60dc5 HTTP/1.1" 200 None 2026-03-25 16:47:20,601 - lava_callback - INFO - Completed processing callback for node 69c41180944faaf0e7f60dc5 2026-03-25 16:47:20,687 - lava_callback - INFO - Received callback for node 69c41174944faaf0e7f60d8d INFO: 172.21.0.1:54236 - "POST /node/69c41174944faaf0e7f60d8d HTTP/1.0" 202 Accepted 2026-03-25 16:47:20,695 - lava_callback - INFO - Starting async job submit for node 69c41174944faaf0e7f60d8d 2026-03-25 16:47:20,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:20,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41174944faaf0e7f60d8d HTTP/1.1" 200 None 2026-03-25 16:47:20,733 - lava_callback - DEBUG - Processing node 69c41174944faaf0e7f60d8d: baseline-arm64 2026-03-25 16:47:20,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:21,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:21,103 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41174944faaf0e7f60d8d/log.txt.gz 2026-03-25 16:47:21,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:21,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:21,377 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41174944faaf0e7f60d8d/lava-logs.yaml 2026-03-25 16:47:21,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:21,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:21,538 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41174944faaf0e7f60d8d/lava_callback.json.gz 2026-03-25 16:47:21,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:21,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41174944faaf0e7f60d8d HTTP/1.1" 200 None 2026-03-25 16:47:21,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:21,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:47:21,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:21,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41174944faaf0e7f60d8d HTTP/1.1" 200 None 2026-03-25 16:47:21,622 - lava_callback - INFO - Completed processing callback for node 69c41174944faaf0e7f60d8d 2026-03-25 16:47:24,053 - lava_callback - INFO - Received callback for node 69c41191944faaf0e7f60df3 INFO: 172.21.0.1:54248 - "POST /node/69c41191944faaf0e7f60df3 HTTP/1.0" 202 Accepted 2026-03-25 16:47:24,066 - lava_callback - INFO - Starting async job submit for node 69c41191944faaf0e7f60df3 2026-03-25 16:47:24,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:24,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41191944faaf0e7f60df3 HTTP/1.1" 200 None 2026-03-25 16:47:24,118 - lava_callback - DEBUG - Processing node 69c41191944faaf0e7f60df3: baseline-nfs-arm64 2026-03-25 16:47:24,120 - lava_callback - WARNING - Failed to upload log 2026-03-25 16:47:24,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:24,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:24,272 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41191944faaf0e7f60df3/lava-logs.yaml 2026-03-25 16:47:24,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:24,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:24,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41191944faaf0e7f60df3/lava_callback.json.gz 2026-03-25 16:47:24,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:24,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41191944faaf0e7f60df3 HTTP/1.1" 200 None 2026-03-25 16:47:24,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:24,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:47:24,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:24,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41191944faaf0e7f60df3 HTTP/1.1" 200 None 2026-03-25 16:47:24,476 - lava_callback - INFO - Completed processing callback for node 69c41191944faaf0e7f60df3 INFO: 172.21.0.1:54260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59718 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:47:41,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:41,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:48:08,500 - lava_callback - INFO - Received callback for node 69c41175944faaf0e7f60d93 INFO: 172.21.0.1:48770 - "POST /node/69c41175944faaf0e7f60d93 HTTP/1.0" 202 Accepted 2026-03-25 16:48:08,508 - lava_callback - INFO - Starting async job submit for node 69c41175944faaf0e7f60d93 2026-03-25 16:48:08,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:08,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41175944faaf0e7f60d93 HTTP/1.1" 200 None 2026-03-25 16:48:08,550 - lava_callback - DEBUG - Processing node 69c41175944faaf0e7f60d93: baseline-arm64 2026-03-25 16:48:08,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:08,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:08,994 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41175944faaf0e7f60d93/log.txt.gz 2026-03-25 16:48:09,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:09,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:09,383 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41175944faaf0e7f60d93/lava-logs.yaml 2026-03-25 16:48:09,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:09,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:09,516 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41175944faaf0e7f60d93/lava_callback.json.gz 2026-03-25 16:48:09,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:09,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41175944faaf0e7f60d93 HTTP/1.1" 200 None 2026-03-25 16:48:09,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:09,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:09,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:09,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41175944faaf0e7f60d93 HTTP/1.1" 200 None 2026-03-25 16:48:09,611 - lava_callback - INFO - Completed processing callback for node 69c41175944faaf0e7f60d93 2026-03-25 16:48:11,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:11,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50852 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:48:18,524 - lava_callback - INFO - Received callback for node 69c410c1944faaf0e7f60c51 INFO: 172.21.0.1:50864 - "POST /node/69c410c1944faaf0e7f60c51 HTTP/1.0" 202 Accepted 2026-03-25 16:48:18,530 - lava_callback - INFO - Starting async job submit for node 69c410c1944faaf0e7f60c51 2026-03-25 16:48:18,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:18,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c1944faaf0e7f60c51 HTTP/1.1" 200 None 2026-03-25 16:48:18,567 - lava_callback - DEBUG - Processing node 69c410c1944faaf0e7f60c51: baseline-arm-clabbe 2026-03-25 16:48:18,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:18,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:18,888 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410c1944faaf0e7f60c51/log.txt.gz 2026-03-25 16:48:19,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:19,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:19,230 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410c1944faaf0e7f60c51/lava-logs.yaml 2026-03-25 16:48:19,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:19,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:19,426 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410c1944faaf0e7f60c51/lava_callback.json.gz 2026-03-25 16:48:19,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:19,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c1944faaf0e7f60c51 HTTP/1.1" 200 None 2026-03-25 16:48:19,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:19,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:48:19,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:19,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410c1944faaf0e7f60c51 HTTP/1.1" 200 None 2026-03-25 16:48:19,512 - lava_callback - INFO - Completed processing callback for node 69c410c1944faaf0e7f60c51 2026-03-25 16:48:20,677 - lava_callback - INFO - Received callback for node 69c41177944faaf0e7f60d99 INFO: 172.21.0.1:54814 - "POST /node/69c41177944faaf0e7f60d99 HTTP/1.0" 202 Accepted 2026-03-25 16:48:20,683 - lava_callback - INFO - Starting async job submit for node 69c41177944faaf0e7f60d99 2026-03-25 16:48:20,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:20,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41177944faaf0e7f60d99 HTTP/1.1" 200 None 2026-03-25 16:48:20,759 - lava_callback - DEBUG - Processing node 69c41177944faaf0e7f60d99: baseline-arm64 2026-03-25 16:48:20,916 - lava_callback - WARNING - Failed to upload log 2026-03-25 16:48:20,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:21,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:21,155 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41177944faaf0e7f60d99/lava-logs.yaml 2026-03-25 16:48:21,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:21,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:21,313 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41177944faaf0e7f60d99/lava_callback.json.gz 2026-03-25 16:48:21,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:21,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41177944faaf0e7f60d99 HTTP/1.1" 200 None 2026-03-25 16:48:21,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:21,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:21,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:21,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41177944faaf0e7f60d99 HTTP/1.1" 200 None 2026-03-25 16:48:21,465 - lava_callback - INFO - Completed processing callback for node 69c41177944faaf0e7f60d99 2026-03-25 16:48:25,116 - lava_callback - INFO - Received callback for node 69c41174944faaf0e7f60d90 INFO: 172.21.0.1:54816 - "POST /node/69c41174944faaf0e7f60d90 HTTP/1.0" 202 Accepted 2026-03-25 16:48:25,123 - lava_callback - INFO - Starting async job submit for node 69c41174944faaf0e7f60d90 2026-03-25 16:48:25,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:25,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41174944faaf0e7f60d90 HTTP/1.1" 200 None 2026-03-25 16:48:25,167 - lava_callback - DEBUG - Processing node 69c41174944faaf0e7f60d90: baseline-arm64 2026-03-25 16:48:25,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:25,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:25,594 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41174944faaf0e7f60d90/log.txt.gz 2026-03-25 16:48:25,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:25,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:25,943 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41174944faaf0e7f60d90/lava-logs.yaml 2026-03-25 16:48:25,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:26,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:26,080 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41174944faaf0e7f60d90/lava_callback.json.gz 2026-03-25 16:48:26,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:26,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41174944faaf0e7f60d90 HTTP/1.1" 200 None 2026-03-25 16:48:26,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:26,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:26,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:26,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41174944faaf0e7f60d90 HTTP/1.1" 200 None 2026-03-25 16:48:26,164 - lava_callback - INFO - Completed processing callback for node 69c41174944faaf0e7f60d90 INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:48:28,820 - lava_callback - INFO - Received callback for node 69c41185944faaf0e7f60dd1 INFO: 172.21.0.1:54840 - "POST /node/69c41185944faaf0e7f60dd1 HTTP/1.0" 202 Accepted 2026-03-25 16:48:28,826 - lava_callback - INFO - Starting async job submit for node 69c41185944faaf0e7f60dd1 2026-03-25 16:48:28,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:28,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41185944faaf0e7f60dd1 HTTP/1.1" 200 None 2026-03-25 16:48:28,863 - lava_callback - DEBUG - Processing node 69c41185944faaf0e7f60dd1: baseline-arm64 2026-03-25 16:48:29,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:29,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:29,250 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41185944faaf0e7f60dd1/log.txt.gz 2026-03-25 16:48:29,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:29,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:29,581 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41185944faaf0e7f60dd1/lava-logs.yaml 2026-03-25 16:48:29,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:29,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:29,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41185944faaf0e7f60dd1/lava_callback.json.gz 2026-03-25 16:48:29,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:29,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41185944faaf0e7f60dd1 HTTP/1.1" 200 None 2026-03-25 16:48:29,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:29,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:29,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:29,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41185944faaf0e7f60dd1 HTTP/1.1" 200 None 2026-03-25 16:48:29,808 - lava_callback - INFO - Completed processing callback for node 69c41185944faaf0e7f60dd1 2026-03-25 16:48:32,986 - lava_callback - INFO - Received callback for node 69c41181944faaf0e7f60dc8 INFO: 172.21.0.1:50466 - "POST /node/69c41181944faaf0e7f60dc8 HTTP/1.0" 202 Accepted 2026-03-25 16:48:32,992 - lava_callback - INFO - Starting async job submit for node 69c41181944faaf0e7f60dc8 2026-03-25 16:48:33,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:33,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41181944faaf0e7f60dc8 HTTP/1.1" 200 None 2026-03-25 16:48:33,028 - lava_callback - DEBUG - Processing node 69c41181944faaf0e7f60dc8: baseline-arm64 2026-03-25 16:48:33,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:33,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:33,411 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41181944faaf0e7f60dc8/log.txt.gz 2026-03-25 16:48:33,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:33,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:33,733 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41181944faaf0e7f60dc8/lava-logs.yaml 2026-03-25 16:48:33,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:33,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:33,890 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41181944faaf0e7f60dc8/lava_callback.json.gz 2026-03-25 16:48:33,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:33,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41181944faaf0e7f60dc8 HTTP/1.1" 200 None 2026-03-25 16:48:33,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:33,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:33,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:33,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41181944faaf0e7f60dc8 HTTP/1.1" 200 None 2026-03-25 16:48:33,989 - lava_callback - INFO - Completed processing callback for node 69c41181944faaf0e7f60dc8 INFO: 172.21.0.1:50472 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:48:37,936 - lava_callback - INFO - Received callback for node 69c411ba944faaf0e7f60e94 INFO: 172.21.0.1:50488 - "POST /node/69c411ba944faaf0e7f60e94 HTTP/1.0" 202 Accepted 2026-03-25 16:48:37,943 - lava_callback - INFO - Starting async job submit for node 69c411ba944faaf0e7f60e94 2026-03-25 16:48:37,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:37,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411ba944faaf0e7f60e94 HTTP/1.1" 200 None 2026-03-25 16:48:37,977 - lava_callback - DEBUG - Processing node 69c411ba944faaf0e7f60e94: baseline-arm64-pengutronix 2026-03-25 16:48:38,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:38,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:38,276 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411ba944faaf0e7f60e94/log.txt.gz 2026-03-25 16:48:38,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:38,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:38,562 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411ba944faaf0e7f60e94/lava-logs.yaml 2026-03-25 16:48:38,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:38,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:38,697 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411ba944faaf0e7f60e94/lava_callback.json.gz 2026-03-25 16:48:38,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:38,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411ba944faaf0e7f60e94 HTTP/1.1" 200 None 2026-03-25 16:48:38,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:38,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:38,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:38,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411ba944faaf0e7f60e94 HTTP/1.1" 200 None 2026-03-25 16:48:38,781 - lava_callback - INFO - Completed processing callback for node 69c411ba944faaf0e7f60e94 2026-03-25 16:48:41,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:41,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:49974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:48:46,726 - lava_callback - INFO - Received callback for node 69c41178944faaf0e7f60d9c INFO: 172.21.0.1:49984 - "POST /node/69c41178944faaf0e7f60d9c HTTP/1.0" 202 Accepted 2026-03-25 16:48:46,733 - lava_callback - INFO - Starting async job submit for node 69c41178944faaf0e7f60d9c 2026-03-25 16:48:46,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:46,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41178944faaf0e7f60d9c HTTP/1.1" 200 None 2026-03-25 16:48:46,795 - lava_callback - DEBUG - Processing node 69c41178944faaf0e7f60d9c: baseline-arm64 2026-03-25 16:48:46,990 - lava_callback - WARNING - Failed to upload log 2026-03-25 16:48:47,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:47,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:47,284 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41178944faaf0e7f60d9c/lava-logs.yaml 2026-03-25 16:48:47,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:47,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:47,402 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41178944faaf0e7f60d9c/lava_callback.json.gz 2026-03-25 16:48:47,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:47,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41178944faaf0e7f60d9c HTTP/1.1" 200 None 2026-03-25 16:48:47,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:47,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:47,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:47,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41178944faaf0e7f60d9c HTTP/1.1" 200 None 2026-03-25 16:48:47,581 - lava_callback - INFO - Completed processing callback for node 69c41178944faaf0e7f60d9c 2026-03-25 16:48:49,766 - lava_callback - INFO - Received callback for node 69c41184944faaf0e7f60dce INFO: 172.21.0.1:57888 - "POST /node/69c41184944faaf0e7f60dce HTTP/1.0" 202 Accepted 2026-03-25 16:48:49,772 - lava_callback - INFO - Starting async job submit for node 69c41184944faaf0e7f60dce 2026-03-25 16:48:49,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:49,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41184944faaf0e7f60dce HTTP/1.1" 200 None 2026-03-25 16:48:49,810 - lava_callback - DEBUG - Processing node 69c41184944faaf0e7f60dce: baseline-arm64 2026-03-25 16:48:50,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:50,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:50,216 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41184944faaf0e7f60dce/log.txt.gz 2026-03-25 16:48:50,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:50,422 - lava_callback - INFO - Received callback for node 69c4117e944faaf0e7f60dbf INFO: 172.21.0.1:57890 - "POST /node/69c4117e944faaf0e7f60dbf HTTP/1.0" 202 Accepted 2026-03-25 16:48:50,429 - lava_callback - INFO - Starting async job submit for node 69c4117e944faaf0e7f60dbf 2026-03-25 16:48:50,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:50,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117e944faaf0e7f60dbf HTTP/1.1" 200 None 2026-03-25 16:48:50,469 - lava_callback - DEBUG - Processing node 69c4117e944faaf0e7f60dbf: baseline-arm64 2026-03-25 16:48:50,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:50,622 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41184944faaf0e7f60dce/lava-logs.yaml 2026-03-25 16:48:50,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:50,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:50,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:50,986 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41184944faaf0e7f60dce/lava_callback.json.gz 2026-03-25 16:48:51,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:51,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41184944faaf0e7f60dce HTTP/1.1" 200 None 2026-03-25 16:48:51,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:51,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:51,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:51,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:51,056 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117e944faaf0e7f60dbf/log.txt.gz 2026-03-25 16:48:51,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41184944faaf0e7f60dce HTTP/1.1" 200 None 2026-03-25 16:48:51,143 - lava_callback - INFO - Completed processing callback for node 69c41184944faaf0e7f60dce 2026-03-25 16:48:51,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:51,520 - lava_callback - INFO - Received callback for node 69c410b9944faaf0e7f60c2d INFO: 172.21.0.1:57892 - "POST /node/69c410b9944faaf0e7f60c2d HTTP/1.0" 202 Accepted 2026-03-25 16:48:51,526 - lava_callback - INFO - Starting async job submit for node 69c410b9944faaf0e7f60c2d 2026-03-25 16:48:51,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:51,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b9944faaf0e7f60c2d HTTP/1.1" 200 None 2026-03-25 16:48:51,566 - lava_callback - DEBUG - Processing node 69c410b9944faaf0e7f60c2d: baseline-arm-broonie 2026-03-25 16:48:51,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:51,679 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117e944faaf0e7f60dbf/lava-logs.yaml 2026-03-25 16:48:51,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:51,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:51,990 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:51,992 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117e944faaf0e7f60dbf/lava_callback.json.gz 2026-03-25 16:48:52,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:52,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:52,019 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b9944faaf0e7f60c2d/log.txt.gz 2026-03-25 16:48:52,095 - lava_callback - INFO - Received callback for node 69c411be944faaf0e7f60e9d 2026-03-25 16:48:52,109 - lava_callback - INFO - Starting async job submit for node 69c411be944faaf0e7f60e9d INFO: 172.21.0.1:57908 - "POST /node/69c411be944faaf0e7f60e9d HTTP/1.0" 202 Accepted 2026-03-25 16:48:52,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117e944faaf0e7f60dbf HTTP/1.1" 200 None 2026-03-25 16:48:52,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:52,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:52,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411be944faaf0e7f60e9d HTTP/1.1" 200 None 2026-03-25 16:48:52,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:52,281 - lava_callback - DEBUG - Processing node 69c411be944faaf0e7f60e9d: baseline-arm64-foundriesio 2026-03-25 16:48:52,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:52,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:52,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4117e944faaf0e7f60dbf HTTP/1.1" 200 None 2026-03-25 16:48:52,403 - lava_callback - INFO - Completed processing callback for node 69c4117e944faaf0e7f60dbf 2026-03-25 16:48:52,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:52,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:52,634 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b9944faaf0e7f60c2d/lava-logs.yaml 2026-03-25 16:48:52,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:52,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:52,744 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c411be944faaf0e7f60e9d/log.txt.gz 2026-03-25 16:48:52,788 - lava_callback - INFO - Received callback for node 69c41196944faaf0e7f60dff INFO: 172.21.0.1:57918 - "POST /node/69c41196944faaf0e7f60dff HTTP/1.0" 202 Accepted 2026-03-25 16:48:52,814 - lava_callback - INFO - Starting async job submit for node 69c41196944faaf0e7f60dff 2026-03-25 16:48:52,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:52,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:52,882 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b9944faaf0e7f60c2d/lava_callback.json.gz 2026-03-25 16:48:52,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:52,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41196944faaf0e7f60dff HTTP/1.1" 200 None 2026-03-25 16:48:52,974 - lava_callback - DEBUG - Processing node 69c41196944faaf0e7f60dff: baseline-nfs-arm64 2026-03-25 16:48:53,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:53,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b9944faaf0e7f60c2d HTTP/1.1" 200 None 2026-03-25 16:48:53,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:53,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:48:53,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:53,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410b9944faaf0e7f60c2d HTTP/1.1" 200 None 2026-03-25 16:48:53,321 - lava_callback - INFO - Completed processing callback for node 69c410b9944faaf0e7f60c2d 2026-03-25 16:48:53,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:53,361 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c411be944faaf0e7f60e9d/lava-logs.yaml 2026-03-25 16:48:53,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:53,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:53,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:53,653 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c411be944faaf0e7f60e9d/lava_callback.json.gz 2026-03-25 16:48:53,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:53,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:53,678 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41196944faaf0e7f60dff/log.txt.gz 2026-03-25 16:48:53,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411be944faaf0e7f60e9d HTTP/1.1" 200 None 2026-03-25 16:48:53,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:53,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:53,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:53,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411be944faaf0e7f60e9d HTTP/1.1" 200 None 2026-03-25 16:48:53,938 - lava_callback - INFO - Completed processing callback for node 69c411be944faaf0e7f60e9d 2026-03-25 16:48:53,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:54,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:54,206 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41196944faaf0e7f60dff/lava-logs.yaml 2026-03-25 16:48:54,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:54,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:54,368 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41196944faaf0e7f60dff/lava_callback.json.gz 2026-03-25 16:48:54,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:54,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41196944faaf0e7f60dff HTTP/1.1" 200 None 2026-03-25 16:48:54,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:54,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:54,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:54,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41196944faaf0e7f60dff HTTP/1.1" 200 None 2026-03-25 16:48:54,471 - lava_callback - INFO - Completed processing callback for node 69c41196944faaf0e7f60dff 2026-03-25 16:48:55,905 - lava_callback - INFO - Received callback for node 69c4117f944faaf0e7f60dc2 INFO: 172.21.0.1:57926 - "POST /node/69c4117f944faaf0e7f60dc2 HTTP/1.0" 202 Accepted 2026-03-25 16:48:55,914 - lava_callback - INFO - Starting async job submit for node 69c4117f944faaf0e7f60dc2 2026-03-25 16:48:55,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:55,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117f944faaf0e7f60dc2 HTTP/1.1" 200 None 2026-03-25 16:48:55,956 - lava_callback - DEBUG - Processing node 69c4117f944faaf0e7f60dc2: baseline-arm64 2026-03-25 16:48:56,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:57932 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:48:56,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:56,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117f944faaf0e7f60dc2/log.txt.gz 2026-03-25 16:48:56,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:57,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:57,145 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117f944faaf0e7f60dc2/lava-logs.yaml 2026-03-25 16:48:57,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:57,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:57,306 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117f944faaf0e7f60dc2/lava_callback.json.gz 2026-03-25 16:48:57,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:57,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117f944faaf0e7f60dc2 HTTP/1.1" 200 None 2026-03-25 16:48:57,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:57,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:57,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:57,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4117f944faaf0e7f60dc2 HTTP/1.1" 200 None 2026-03-25 16:48:57,399 - lava_callback - INFO - Completed processing callback for node 69c4117f944faaf0e7f60dc2 2026-03-25 16:48:59,611 - lava_callback - INFO - Received callback for node 69c41176944faaf0e7f60d96 INFO: 172.21.0.1:57936 - "POST /node/69c41176944faaf0e7f60d96 HTTP/1.0" 202 Accepted 2026-03-25 16:48:59,617 - lava_callback - INFO - Starting async job submit for node 69c41176944faaf0e7f60d96 2026-03-25 16:48:59,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:59,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41176944faaf0e7f60d96 HTTP/1.1" 200 None 2026-03-25 16:48:59,654 - lava_callback - DEBUG - Processing node 69c41176944faaf0e7f60d96: baseline-arm64 2026-03-25 16:48:59,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:00,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:00,051 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41176944faaf0e7f60d96/log.txt.gz 2026-03-25 16:49:00,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:00,261 - lava_callback - INFO - Received callback for node 69c411bb944faaf0e7f60e97 INFO: 172.21.0.1:40550 - "POST /node/69c411bb944faaf0e7f60e97 HTTP/1.0" 202 Accepted 2026-03-25 16:49:00,268 - lava_callback - INFO - Starting async job submit for node 69c411bb944faaf0e7f60e97 2026-03-25 16:49:00,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:00,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411bb944faaf0e7f60e97 HTTP/1.1" 200 None 2026-03-25 16:49:00,317 - lava_callback - DEBUG - Processing node 69c411bb944faaf0e7f60e97: baseline-arm64-pengutronix 2026-03-25 16:49:00,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:00,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41176944faaf0e7f60d96/lava-logs.yaml 2026-03-25 16:49:00,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:00,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:00,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:00,683 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41176944faaf0e7f60d96/lava_callback.json.gz 2026-03-25 16:49:00,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:00,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:00,709 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411bb944faaf0e7f60e97/log.txt.gz 2026-03-25 16:49:00,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41176944faaf0e7f60d96 HTTP/1.1" 200 None 2026-03-25 16:49:00,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:00,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:00,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:00,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:00,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41176944faaf0e7f60d96 HTTP/1.1" 200 None 2026-03-25 16:49:00,881 - lava_callback - INFO - Completed processing callback for node 69c41176944faaf0e7f60d96 2026-03-25 16:49:01,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:01,102 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411bb944faaf0e7f60e97/lava-logs.yaml 2026-03-25 16:49:01,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:01,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:01,258 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411bb944faaf0e7f60e97/lava_callback.json.gz 2026-03-25 16:49:01,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:01,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411bb944faaf0e7f60e97 HTTP/1.1" 200 None 2026-03-25 16:49:01,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:01,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:01,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:01,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411bb944faaf0e7f60e97 HTTP/1.1" 200 None 2026-03-25 16:49:01,351 - lava_callback - INFO - Completed processing callback for node 69c411bb944faaf0e7f60e97 2026-03-25 16:49:03,779 - lava_callback - INFO - Received callback for node 69c16ef12b2b51e9ad97a398 INFO: 172.21.0.1:40560 - "POST /node/69c16ef12b2b51e9ad97a398 HTTP/1.0" 202 Accepted 2026-03-25 16:49:03,785 - lava_callback - INFO - Starting async job submit for node 69c16ef12b2b51e9ad97a398 2026-03-25 16:49:03,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:03,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ef12b2b51e9ad97a398 HTTP/1.1" 200 None 2026-03-25 16:49:03,816 - lava_callback - DEBUG - Processing node 69c16ef12b2b51e9ad97a398: baseline-arm64-baylibre 2026-03-25 16:49:03,816 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16ef12b2b51e9ad97a398 2026-03-25 16:49:03,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:03,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ef12b2b51e9ad97a398 HTTP/1.1" 200 None 2026-03-25 16:49:03,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:03,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 16:49:03,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:03,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16ef12b2b51e9ad97a398 HTTP/1.1" 200 None 2026-03-25 16:49:03,890 - lava_callback - ERROR - Error processing callback for node 69c16ef12b2b51e9ad97a398: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:49:08,331 - lava_callback - INFO - Received callback for node 69c4118f944faaf0e7f60dea INFO: 172.21.0.1:40578 - "POST /node/69c4118f944faaf0e7f60dea HTTP/1.0" 202 Accepted 2026-03-25 16:49:08,338 - lava_callback - INFO - Starting async job submit for node 69c4118f944faaf0e7f60dea 2026-03-25 16:49:08,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:08,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4118f944faaf0e7f60dea HTTP/1.1" 200 None 2026-03-25 16:49:08,376 - lava_callback - DEBUG - Processing node 69c4118f944faaf0e7f60dea: baseline-nfs-arm64 2026-03-25 16:49:08,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:09,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:09,005 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118f944faaf0e7f60dea/log.txt.gz 2026-03-25 16:49:09,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:09,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:09,502 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118f944faaf0e7f60dea/lava-logs.yaml 2026-03-25 16:49:09,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:09,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:09,678 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118f944faaf0e7f60dea/lava_callback.json.gz 2026-03-25 16:49:09,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:09,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4118f944faaf0e7f60dea HTTP/1.1" 200 None 2026-03-25 16:49:09,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:09,729 - lava_callback - INFO - Received callback for node 69c411bc944faaf0e7f60e9a INFO: 172.21.0.1:52688 - "POST /node/69c411bc944faaf0e7f60e9a HTTP/1.0" 202 Accepted 2026-03-25 16:49:09,735 - lava_callback - INFO - Starting async job submit for node 69c411bc944faaf0e7f60e9a 2026-03-25 16:49:09,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:09,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:09,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:09,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411bc944faaf0e7f60e9a HTTP/1.1" 200 None 2026-03-25 16:49:09,774 - lava_callback - DEBUG - Processing node 69c411bc944faaf0e7f60e9a: baseline-arm64-pengutronix 2026-03-25 16:49:09,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4118f944faaf0e7f60dea HTTP/1.1" 200 None 2026-03-25 16:49:09,881 - lava_callback - INFO - Completed processing callback for node 69c4118f944faaf0e7f60dea 2026-03-25 16:49:10,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:10,218 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:10,220 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411bc944faaf0e7f60e9a/log.txt.gz 2026-03-25 16:49:10,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:10,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:10,535 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411bc944faaf0e7f60e9a/lava-logs.yaml 2026-03-25 16:49:10,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:10,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:10,670 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411bc944faaf0e7f60e9a/lava_callback.json.gz 2026-03-25 16:49:10,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:10,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411bc944faaf0e7f60e9a HTTP/1.1" 200 None 2026-03-25 16:49:10,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:10,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:10,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:10,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411bc944faaf0e7f60e9a HTTP/1.1" 200 None 2026-03-25 16:49:10,766 - lava_callback - INFO - Completed processing callback for node 69c411bc944faaf0e7f60e9a 2026-03-25 16:49:11,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:11,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-25 16:49:14,484 - lava_callback - INFO - Received callback for node 69c41195944faaf0e7f60dfc INFO: 172.21.0.1:52702 - "POST /node/69c41195944faaf0e7f60dfc HTTP/1.0" 202 Accepted 2026-03-25 16:49:14,490 - lava_callback - INFO - Starting async job submit for node 69c41195944faaf0e7f60dfc 2026-03-25 16:49:14,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:14,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41195944faaf0e7f60dfc HTTP/1.1" 200 None 2026-03-25 16:49:14,528 - lava_callback - DEBUG - Processing node 69c41195944faaf0e7f60dfc: baseline-nfs-arm64 2026-03-25 16:49:14,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:15,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:15,013 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41195944faaf0e7f60dfc/log.txt.gz INFO: 172.21.0.1:52710 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 16:49:15,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:15,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:15,400 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41195944faaf0e7f60dfc/lava-logs.yaml 2026-03-25 16:49:15,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:15,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:15,551 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41195944faaf0e7f60dfc/lava_callback.json.gz 2026-03-25 16:49:15,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:15,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41195944faaf0e7f60dfc HTTP/1.1" 200 None 2026-03-25 16:49:15,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:15,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:15,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:15,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41195944faaf0e7f60dfc HTTP/1.1" 200 None 2026-03-25 16:49:15,631 - lava_callback - INFO - Completed processing callback for node 69c41195944faaf0e7f60dfc 2026-03-25 16:49:16,444 - lava_callback - INFO - Received callback for node 69c4118c944faaf0e7f60de4 INFO: 172.21.0.1:52722 - "POST /node/69c4118c944faaf0e7f60de4 HTTP/1.0" 202 Accepted 2026-03-25 16:49:16,450 - lava_callback - INFO - Starting async job submit for node 69c4118c944faaf0e7f60de4 2026-03-25 16:49:16,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:16,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4118c944faaf0e7f60de4 HTTP/1.1" 200 None 2026-03-25 16:49:16,489 - lava_callback - DEBUG - Processing node 69c4118c944faaf0e7f60de4: baseline-nfs-arm64 INFO: 172.21.0.1:52732 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:49:16,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:16,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:16,933 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118c944faaf0e7f60de4/log.txt.gz 2026-03-25 16:49:17,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:17,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:17,324 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118c944faaf0e7f60de4/lava-logs.yaml 2026-03-25 16:49:17,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:17,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:17,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118c944faaf0e7f60de4/lava_callback.json.gz 2026-03-25 16:49:17,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:17,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4118c944faaf0e7f60de4 HTTP/1.1" 200 None 2026-03-25 16:49:17,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:17,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:17,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:17,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4118c944faaf0e7f60de4 HTTP/1.1" 200 None 2026-03-25 16:49:17,553 - lava_callback - INFO - Completed processing callback for node 69c4118c944faaf0e7f60de4 2026-03-25 16:49:18,512 - lava_callback - INFO - Received callback for node 69c41190944faaf0e7f60df0 INFO: 172.21.0.1:52738 - "POST /node/69c41190944faaf0e7f60df0 HTTP/1.0" 202 Accepted 2026-03-25 16:49:18,520 - lava_callback - INFO - Starting async job submit for node 69c41190944faaf0e7f60df0 2026-03-25 16:49:18,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:18,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41190944faaf0e7f60df0 HTTP/1.1" 200 None 2026-03-25 16:49:18,557 - lava_callback - DEBUG - Processing node 69c41190944faaf0e7f60df0: baseline-nfs-arm64 2026-03-25 16:49:18,968 - lava_callback - INFO - Received callback for node 69c41192944faaf0e7f60df6 INFO: 172.21.0.1:52746 - "POST /node/69c41192944faaf0e7f60df6 HTTP/1.0" 202 Accepted 2026-03-25 16:49:19,000 - lava_callback - INFO - Starting async job submit for node 69c41192944faaf0e7f60df6 2026-03-25 16:49:19,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:19,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41192944faaf0e7f60df6 HTTP/1.1" 200 None 2026-03-25 16:49:19,161 - lava_callback - DEBUG - Processing node 69c41192944faaf0e7f60df6: baseline-nfs-arm64 2026-03-25 16:49:19,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:19,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:19,522 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41190944faaf0e7f60df0/log.txt.gz 2026-03-25 16:49:19,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:19,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:19,835 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41192944faaf0e7f60df6/log.txt.gz 2026-03-25 16:49:20,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:20,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:20,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:20,326 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41190944faaf0e7f60df0/lava-logs.yaml 2026-03-25 16:49:20,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:20,331 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41192944faaf0e7f60df6/lava-logs.yaml 2026-03-25 16:49:20,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:20,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:20,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:20,496 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41192944faaf0e7f60df6/lava_callback.json.gz 2026-03-25 16:49:20,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:20,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:20,528 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41190944faaf0e7f60df0/lava_callback.json.gz 2026-03-25 16:49:20,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:20,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41192944faaf0e7f60df6 HTTP/1.1" 200 None 2026-03-25 16:49:20,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:20,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41190944faaf0e7f60df0 HTTP/1.1" 200 None 2026-03-25 16:49:20,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:20,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:20,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:20,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:20,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:20,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41192944faaf0e7f60df6 HTTP/1.1" 200 None 2026-03-25 16:49:20,619 - lava_callback - INFO - Completed processing callback for node 69c41192944faaf0e7f60df6 2026-03-25 16:49:20,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41190944faaf0e7f60df0 HTTP/1.1" 200 None 2026-03-25 16:49:20,682 - lava_callback - INFO - Completed processing callback for node 69c41190944faaf0e7f60df0 2026-03-25 16:49:21,471 - lava_callback - INFO - Received callback for node 69c411bf944faaf0e7f60ea0 INFO: 172.21.0.1:47370 - "POST /node/69c411bf944faaf0e7f60ea0 HTTP/1.0" 202 Accepted 2026-03-25 16:49:21,478 - lava_callback - INFO - Starting async job submit for node 69c411bf944faaf0e7f60ea0 2026-03-25 16:49:21,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:21,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411bf944faaf0e7f60ea0 HTTP/1.1" 200 None 2026-03-25 16:49:21,521 - lava_callback - DEBUG - Processing node 69c411bf944faaf0e7f60ea0: baseline-arm64-foundriesio 2026-03-25 16:49:21,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:22,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:22,069 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c411bf944faaf0e7f60ea0/log.txt.gz 2026-03-25 16:49:22,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:22,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:22,542 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c411bf944faaf0e7f60ea0/lava-logs.yaml 2026-03-25 16:49:22,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:22,590 - lava_callback - INFO - Received callback for node 69c41189944faaf0e7f60dda INFO: 172.21.0.1:47386 - "POST /node/69c41189944faaf0e7f60dda HTTP/1.0" 202 Accepted 2026-03-25 16:49:22,600 - lava_callback - INFO - Starting async job submit for node 69c41189944faaf0e7f60dda 2026-03-25 16:49:22,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:22,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41189944faaf0e7f60dda HTTP/1.1" 200 None 2026-03-25 16:49:22,655 - lava_callback - DEBUG - Processing node 69c41189944faaf0e7f60dda: baseline-nfs-arm64 2026-03-25 16:49:22,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:22,792 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c411bf944faaf0e7f60ea0/lava_callback.json.gz 2026-03-25 16:49:22,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:22,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411bf944faaf0e7f60ea0 HTTP/1.1" 200 None 2026-03-25 16:49:22,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:23,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:23,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:23,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:23,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411bf944faaf0e7f60ea0 HTTP/1.1" 200 None 2026-03-25 16:49:23,078 - lava_callback - INFO - Completed processing callback for node 69c411bf944faaf0e7f60ea0 2026-03-25 16:49:23,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:23,189 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41189944faaf0e7f60dda/log.txt.gz 2026-03-25 16:49:23,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:23,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:23,569 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41189944faaf0e7f60dda/lava-logs.yaml 2026-03-25 16:49:23,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:23,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:23,708 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41189944faaf0e7f60dda/lava_callback.json.gz 2026-03-25 16:49:23,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:23,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41189944faaf0e7f60dda HTTP/1.1" 200 None 2026-03-25 16:49:23,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:23,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:23,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:23,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41189944faaf0e7f60dda HTTP/1.1" 200 None 2026-03-25 16:49:23,796 - lava_callback - INFO - Completed processing callback for node 69c41189944faaf0e7f60dda INFO: 172.21.0.1:47396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47838 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:49:41,450 - lava_callback - INFO - Received callback for node 69c411b2944faaf0e7f60e5e INFO: 172.21.0.1:47936 - "POST /node/69c411b2944faaf0e7f60e5e HTTP/1.0" 202 Accepted 2026-03-25 16:49:41,456 - lava_callback - INFO - Starting async job submit for node 69c411b2944faaf0e7f60e5e 2026-03-25 16:49:41,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:41,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b2944faaf0e7f60e5e HTTP/1.1" 200 None 2026-03-25 16:49:41,495 - lava_callback - DEBUG - Processing node 69c411b2944faaf0e7f60e5e: baseline-arm64-broonie 2026-03-25 16:49:41,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:41,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-25 16:49:41,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:41,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:41,915 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411b2944faaf0e7f60e5e/log.txt.gz 2026-03-25 16:49:42,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:42,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:42,287 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411b2944faaf0e7f60e5e/lava-logs.yaml 2026-03-25 16:49:42,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:42,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:42,453 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411b2944faaf0e7f60e5e/lava_callback.json.gz 2026-03-25 16:49:42,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:42,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b2944faaf0e7f60e5e HTTP/1.1" 200 None 2026-03-25 16:49:42,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:42,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:42,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:42,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411b2944faaf0e7f60e5e HTTP/1.1" 200 None 2026-03-25 16:49:42,555 - lava_callback - INFO - Completed processing callback for node 69c411b2944faaf0e7f60e5e 2026-03-25 16:49:42,584 - lava_callback - INFO - Received callback for node 69c4117b944faaf0e7f60da4 INFO: 172.21.0.1:47948 - "POST /node/69c4117b944faaf0e7f60da4 HTTP/1.0" 202 Accepted 2026-03-25 16:49:42,595 - lava_callback - INFO - Starting async job submit for node 69c4117b944faaf0e7f60da4 2026-03-25 16:49:42,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:42,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117b944faaf0e7f60da4 HTTP/1.1" 200 None 2026-03-25 16:49:42,659 - lava_callback - DEBUG - Processing node 69c4117b944faaf0e7f60da4: baseline-arm64 2026-03-25 16:49:42,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:43,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:43,111 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117b944faaf0e7f60da4/log.txt.gz 2026-03-25 16:49:43,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:43,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:43,465 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117b944faaf0e7f60da4/lava-logs.yaml 2026-03-25 16:49:43,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:43,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:43,606 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117b944faaf0e7f60da4/lava_callback.json.gz 2026-03-25 16:49:43,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:43,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117b944faaf0e7f60da4 HTTP/1.1" 200 None 2026-03-25 16:49:43,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:43,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:43,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:43,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4117b944faaf0e7f60da4 HTTP/1.1" 200 None 2026-03-25 16:49:43,782 - lava_callback - INFO - Completed processing callback for node 69c4117b944faaf0e7f60da4 INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:49:53,237 - lava_callback - INFO - Received callback for node 69c411a9944faaf0e7f60e48 INFO: 172.21.0.1:40098 - "POST /node/69c411a9944faaf0e7f60e48 HTTP/1.0" 202 Accepted 2026-03-25 16:49:53,243 - lava_callback - INFO - Starting async job submit for node 69c411a9944faaf0e7f60e48 2026-03-25 16:49:53,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:53,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411a9944faaf0e7f60e48 HTTP/1.1" 200 None 2026-03-25 16:49:53,284 - lava_callback - DEBUG - Processing node 69c411a9944faaf0e7f60e48: baseline-arm64-broonie 2026-03-25 16:49:53,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:53,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:53,653 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411a9944faaf0e7f60e48/log.txt.gz 2026-03-25 16:49:53,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:54,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:54,044 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411a9944faaf0e7f60e48/lava-logs.yaml 2026-03-25 16:49:54,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:54,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:54,191 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411a9944faaf0e7f60e48/lava_callback.json.gz 2026-03-25 16:49:54,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:54,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411a9944faaf0e7f60e48 HTTP/1.1" 200 None 2026-03-25 16:49:54,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:54,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:54,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:54,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411a9944faaf0e7f60e48 HTTP/1.1" 200 None 2026-03-25 16:49:54,276 - lava_callback - INFO - Completed processing callback for node 69c411a9944faaf0e7f60e48 INFO: 172.21.0.1:40104 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:50:01,712 - lava_callback - INFO - Received callback for node 69c411b6944faaf0e7f60e6d INFO: 172.21.0.1:38682 - "POST /node/69c411b6944faaf0e7f60e6d HTTP/1.0" 202 Accepted 2026-03-25 16:50:01,718 - lava_callback - INFO - Starting async job submit for node 69c411b6944faaf0e7f60e6d 2026-03-25 16:50:01,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:01,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b6944faaf0e7f60e6d HTTP/1.1" 200 None 2026-03-25 16:50:01,754 - lava_callback - DEBUG - Processing node 69c411b6944faaf0e7f60e6d: baseline-arm64-clabbe 2026-03-25 16:50:01,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:50:02,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:50:02,102 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c411b6944faaf0e7f60e6d/log.txt.gz 2026-03-25 16:50:02,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:50:02,438 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:50:02,440 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c411b6944faaf0e7f60e6d/lava-logs.yaml 2026-03-25 16:50:02,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:50:02,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:50:02,572 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c411b6944faaf0e7f60e6d/lava_callback.json.gz 2026-03-25 16:50:02,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:02,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b6944faaf0e7f60e6d HTTP/1.1" 200 None 2026-03-25 16:50:02,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:02,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:50:02,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:02,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411b6944faaf0e7f60e6d HTTP/1.1" 200 None 2026-03-25 16:50:02,672 - lava_callback - INFO - Completed processing callback for node 69c411b6944faaf0e7f60e6d INFO: 172.21.0.1:38684 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:50:11,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:11,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:39110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39118 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:50:21,038 - lava_callback - INFO - Received callback for node 69c40db8944faaf0e7f5e469 INFO: 172.21.0.1:55800 - "POST /node/69c40db8944faaf0e7f5e469 HTTP/1.0" 202 Accepted 2026-03-25 16:50:21,048 - lava_callback - INFO - Starting async job submit for node 69c40db8944faaf0e7f5e469 2026-03-25 16:50:21,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:21,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40db8944faaf0e7f5e469 HTTP/1.1" 200 None 2026-03-25 16:50:21,132 - lava_callback - DEBUG - Processing node 69c40db8944faaf0e7f5e469: ltp-smoke 2026-03-25 16:50:21,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:50:21,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:50:21,777 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c40db8944faaf0e7f5e469/log.txt.gz 2026-03-25 16:50:22,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:50:22,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:50:22,295 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c40db8944faaf0e7f5e469/lava-logs.yaml 2026-03-25 16:50:22,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:50:22,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:50:22,465 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c40db8944faaf0e7f5e469/lava_callback.json.gz 2026-03-25 16:50:22,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:22,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40db8944faaf0e7f5e469 HTTP/1.1" 200 None 2026-03-25 16:50:22,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:22,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ace944faaf0e7f5e40e HTTP/1.1" 200 None 2026-03-25 16:50:22,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:22,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c40db8944faaf0e7f5e469 HTTP/1.1" 200 None 2026-03-25 16:50:22,816 - lava_callback - INFO - Completed processing callback for node 69c40db8944faaf0e7f5e469 INFO: 172.21.0.1:55816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58464 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:50:41,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:41,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57930 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:51:23,681 - lava_callback - INFO - Received callback for node 69c411aa944faaf0e7f60e4b INFO: 172.21.0.1:40316 - "POST /node/69c411aa944faaf0e7f60e4b HTTP/1.0" 202 Accepted 2026-03-25 16:51:23,687 - lava_callback - INFO - Starting async job submit for node 69c411aa944faaf0e7f60e4b 2026-03-25 16:51:23,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:23,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411aa944faaf0e7f60e4b HTTP/1.1" 200 None 2026-03-25 16:51:23,724 - lava_callback - DEBUG - Processing node 69c411aa944faaf0e7f60e4b: baseline-arm64-broonie 2026-03-25 16:51:23,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:51:24,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:51:24,161 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411aa944faaf0e7f60e4b/log.txt.gz 2026-03-25 16:51:24,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:51:24,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:51:24,554 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411aa944faaf0e7f60e4b/lava-logs.yaml 2026-03-25 16:51:24,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:51:24,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:51:24,711 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411aa944faaf0e7f60e4b/lava_callback.json.gz 2026-03-25 16:51:24,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:24,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411aa944faaf0e7f60e4b HTTP/1.1" 200 None 2026-03-25 16:51:24,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:24,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:51:24,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:24,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411aa944faaf0e7f60e4b HTTP/1.1" 200 None 2026-03-25 16:51:24,820 - lava_callback - INFO - Completed processing callback for node 69c411aa944faaf0e7f60e4b INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:51:28,702 - lava_callback - INFO - Received callback for node 69c410c2944faaf0e7f60c54 INFO: 172.21.0.1:40326 - "POST /node/69c410c2944faaf0e7f60c54 HTTP/1.0" 202 Accepted 2026-03-25 16:51:28,708 - lava_callback - INFO - Starting async job submit for node 69c410c2944faaf0e7f60c54 2026-03-25 16:51:28,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:28,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c2944faaf0e7f60c54 HTTP/1.1" 200 None 2026-03-25 16:51:28,763 - lava_callback - DEBUG - Processing node 69c410c2944faaf0e7f60c54: baseline-arm-clabbe 2026-03-25 16:51:28,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:51:29,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:51:29,100 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410c2944faaf0e7f60c54/log.txt.gz 2026-03-25 16:51:29,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:51:29,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:51:29,422 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410c2944faaf0e7f60c54/lava-logs.yaml 2026-03-25 16:51:29,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:51:29,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:51:29,564 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410c2944faaf0e7f60c54/lava_callback.json.gz 2026-03-25 16:51:29,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:29,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c2944faaf0e7f60c54 HTTP/1.1" 200 None 2026-03-25 16:51:29,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:29,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:51:29,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:29,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410c2944faaf0e7f60c54 HTTP/1.1" 200 None 2026-03-25 16:51:29,651 - lava_callback - INFO - Completed processing callback for node 69c410c2944faaf0e7f60c54 INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:51:41,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:41,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 16:51:44,122 - lava_callback - INFO - Received callback for node 69c16f942b2b51e9ad97a3da INFO: 172.21.0.1:34840 - "POST /node/69c16f942b2b51e9ad97a3da HTTP/1.0" 202 Accepted 2026-03-25 16:51:44,132 - lava_callback - INFO - Starting async job submit for node 69c16f942b2b51e9ad97a3da 2026-03-25 16:51:44,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:44,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16f942b2b51e9ad97a3da HTTP/1.1" 200 None 2026-03-25 16:51:44,164 - lava_callback - DEBUG - Processing node 69c16f942b2b51e9ad97a3da: baseline-arm64-baylibre 2026-03-25 16:51:44,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16f942b2b51e9ad97a3da 2026-03-25 16:51:44,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:44,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16f942b2b51e9ad97a3da HTTP/1.1" 200 None 2026-03-25 16:51:44,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:44,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 16:51:44,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:44,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16f942b2b51e9ad97a3da HTTP/1.1" 200 None 2026-03-25 16:51:44,282 - lava_callback - ERROR - Error processing callback for node 69c16f942b2b51e9ad97a3da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52192 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:52:11,964 - lava_callback - INFO - Received callback for node 69c410f5944faaf0e7f60cdd INFO: 172.21.0.1:59492 - "POST /node/69c410f5944faaf0e7f60cdd HTTP/1.0" 202 Accepted 2026-03-25 16:52:11,977 - lava_callback - INFO - Starting async job submit for node 69c410f5944faaf0e7f60cdd 2026-03-25 16:52:12,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:52:12,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f5944faaf0e7f60cdd HTTP/1.1" 200 None 2026-03-25 16:52:12,052 - lava_callback - DEBUG - Processing node 69c410f5944faaf0e7f60cdd: ltp-syscalls 2026-03-25 16:52:13,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:52:13,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:52:13,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c410f5944faaf0e7f60cdd/log.txt.gz 2026-03-25 16:52:14,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:52:15,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:52:15,143 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c410f5944faaf0e7f60cdd/lava-logs.yaml INFO: 172.21.0.1:59494 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 16:52:15,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:52:15,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:52:15,631 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c410f5944faaf0e7f60cdd/lava_callback.json.gz 2026-03-25 16:52:15,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:52:15,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f5944faaf0e7f60cdd HTTP/1.1" 200 None 2026-03-25 16:52:15,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:52:15,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:52:15,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:52:15,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410f5944faaf0e7f60cdd HTTP/1.1" 200 None 2026-03-25 16:52:15,790 - lava_callback - INFO - Completed processing callback for node 69c410f5944faaf0e7f60cdd INFO: 172.21.0.1:59504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:52:41,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:52:41,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:53:21,184 - lava_callback - INFO - Received callback for node 69c412f4944faaf0e7f60fe0 INFO: 172.21.0.1:41770 - "POST /node/69c412f4944faaf0e7f60fe0 HTTP/1.0" 202 Accepted 2026-03-25 16:53:21,190 - lava_callback - INFO - Starting async job submit for node 69c412f4944faaf0e7f60fe0 2026-03-25 16:53:21,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:53:21,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c412f4944faaf0e7f60fe0 HTTP/1.1" 200 None 2026-03-25 16:53:21,208 - lava_callback - DEBUG - Processing node 69c412f4944faaf0e7f60fe0: baseline-arm 2026-03-25 16:53:21,213 - lava_callback - WARNING - Failed to upload log 2026-03-25 16:53:21,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:53:21,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:53:21,371 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c412f4944faaf0e7f60fe0/lava-logs.yaml 2026-03-25 16:53:21,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:53:21,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:53:21,494 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c412f4944faaf0e7f60fe0/lava_callback.json.gz 2026-03-25 16:53:21,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:53:21,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c412f4944faaf0e7f60fe0 HTTP/1.1" 200 None 2026-03-25 16:53:21,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:53:21,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:53:21,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:53:21,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c412f4944faaf0e7f60fe0 HTTP/1.1" 200 None 2026-03-25 16:53:21,559 - lava_callback - INFO - Completed processing callback for node 69c412f4944faaf0e7f60fe0 INFO: 172.21.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:53:41,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:53:41,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59878 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:54:24,081 - lava_callback - INFO - Received callback for node 69c1703d2b2b51e9ad97a418 INFO: 172.21.0.1:36660 - "POST /node/69c1703d2b2b51e9ad97a418 HTTP/1.0" 202 Accepted 2026-03-25 16:54:24,093 - lava_callback - INFO - Starting async job submit for node 69c1703d2b2b51e9ad97a418 2026-03-25 16:54:24,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:54:24,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1703d2b2b51e9ad97a418 HTTP/1.1" 200 None 2026-03-25 16:54:24,138 - lava_callback - DEBUG - Processing node 69c1703d2b2b51e9ad97a418: baseline-arm64-baylibre 2026-03-25 16:54:24,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1703d2b2b51e9ad97a418 2026-03-25 16:54:24,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:54:24,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1703d2b2b51e9ad97a418 HTTP/1.1" 200 None 2026-03-25 16:54:24,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:54:24,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 16:54:24,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:54:24,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1703d2b2b51e9ad97a418 HTTP/1.1" 200 None 2026-03-25 16:54:24,217 - lava_callback - ERROR - Error processing callback for node 69c1703d2b2b51e9ad97a418: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45842 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:55:13,420 - lava_callback - INFO - Received callback for node 69c41188944faaf0e7f60dd7 INFO: 172.21.0.1:48132 - "POST /node/69c41188944faaf0e7f60dd7 HTTP/1.0" 202 Accepted 2026-03-25 16:55:13,427 - lava_callback - INFO - Starting async job submit for node 69c41188944faaf0e7f60dd7 2026-03-25 16:55:13,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:55:13,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41188944faaf0e7f60dd7 HTTP/1.1" 200 None 2026-03-25 16:55:13,478 - lava_callback - DEBUG - Processing node 69c41188944faaf0e7f60dd7: baseline-arm64 2026-03-25 16:55:13,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:55:14,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:55:14,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41188944faaf0e7f60dd7/log.txt.gz 2026-03-25 16:55:14,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:55:14,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:55:14,463 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41188944faaf0e7f60dd7/lava-logs.yaml 2026-03-25 16:55:14,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:55:14,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:55:14,638 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41188944faaf0e7f60dd7/lava_callback.json.gz DEBUG: Setup failed for 69c41188944faaf0e7f60dd7. Transitting job node result: incomplete -> fail 2026-03-25 16:55:14,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:55:14,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41188944faaf0e7f60dd7 HTTP/1.1" 200 None 2026-03-25 16:55:14,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:55:14,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:55:14,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:55:14,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41188944faaf0e7f60dd7 HTTP/1.1" 200 None 2026-03-25 16:55:14,858 - lava_callback - INFO - Completed processing callback for node 69c41188944faaf0e7f60dd7 INFO: 172.21.0.1:48138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51438 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:55:41,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:55:41,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46732 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:56:04,179 - lava_callback - INFO - Received callback for node 69c170952b2b51e9ad97a45b INFO: 172.21.0.1:45512 - "POST /node/69c170952b2b51e9ad97a45b HTTP/1.0" 202 Accepted 2026-03-25 16:56:04,185 - lava_callback - INFO - Starting async job submit for node 69c170952b2b51e9ad97a45b 2026-03-25 16:56:04,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:56:04,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c170952b2b51e9ad97a45b HTTP/1.1" 200 None 2026-03-25 16:56:04,203 - lava_callback - DEBUG - Processing node 69c170952b2b51e9ad97a45b: baseline-arm64-baylibre 2026-03-25 16:56:04,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c170952b2b51e9ad97a45b 2026-03-25 16:56:04,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:56:04,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c170952b2b51e9ad97a45b HTTP/1.1" 200 None 2026-03-25 16:56:04,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:56:04,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 16:56:04,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:56:04,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c170952b2b51e9ad97a45b HTTP/1.1" 200 None 2026-03-25 16:56:04,292 - lava_callback - ERROR - Error processing callback for node 69c170952b2b51e9ad97a45b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:57:24,232 - lava_callback - INFO - Received callback for node 69c170ec2b2b51e9ad97a48d INFO: 172.21.0.1:58968 - "POST /node/69c170ec2b2b51e9ad97a48d HTTP/1.0" 202 Accepted 2026-03-25 16:57:24,240 - lava_callback - INFO - Starting async job submit for node 69c170ec2b2b51e9ad97a48d 2026-03-25 16:57:24,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:57:24,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c170ec2b2b51e9ad97a48d HTTP/1.1" 200 None 2026-03-25 16:57:24,257 - lava_callback - DEBUG - Processing node 69c170ec2b2b51e9ad97a48d: baseline-arm64-baylibre 2026-03-25 16:57:24,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c170ec2b2b51e9ad97a48d 2026-03-25 16:57:24,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:57:24,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c170ec2b2b51e9ad97a48d HTTP/1.1" 200 None 2026-03-25 16:57:24,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:57:24,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 16:57:24,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:57:24,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c170ec2b2b51e9ad97a48d HTTP/1.1" 200 None 2026-03-25 16:57:24,373 - lava_callback - ERROR - Error processing callback for node 69c170ec2b2b51e9ad97a48d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50260 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:59:27,864 - lava_callback - INFO - Received callback for node 69c410a5944faaf0e7f60bee INFO: 172.21.0.1:50264 - "POST /node/69c410a5944faaf0e7f60bee HTTP/1.0" 202 Accepted 2026-03-25 16:59:27,871 - lava_callback - INFO - Starting async job submit for node 69c410a5944faaf0e7f60bee 2026-03-25 16:59:27,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:27,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a5944faaf0e7f60bee HTTP/1.1" 200 None 2026-03-25 16:59:27,941 - lava_callback - DEBUG - Processing node 69c410a5944faaf0e7f60bee: baseline-arm 2026-03-25 16:59:28,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:59:29,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:59:29,150 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a5944faaf0e7f60bee/log.txt.gz 2026-03-25 16:59:29,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:59:29,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:59:29,937 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a5944faaf0e7f60bee/lava-logs.yaml 2026-03-25 16:59:29,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:59:30,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:59:30,149 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a5944faaf0e7f60bee/lava_callback.json.gz DEBUG: Setup failed for 69c410a5944faaf0e7f60bee. Transitting job node result: incomplete -> fail 2026-03-25 16:59:30,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:30,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a5944faaf0e7f60bee HTTP/1.1" 200 None 2026-03-25 16:59:30,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:30,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:59:30,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:30,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410a5944faaf0e7f60bee HTTP/1.1" 200 None 2026-03-25 16:59:30,595 - lava_callback - INFO - Completed processing callback for node 69c410a5944faaf0e7f60bee INFO: 172.21.0.1:45240 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:59:41,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:41,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 16:59:44,795 - lava_callback - INFO - Received callback for node 69c41476944faaf0e7f6105e INFO: 172.21.0.1:48424 - "POST /node/69c41476944faaf0e7f6105e HTTP/1.0" 202 Accepted 2026-03-25 16:59:44,804 - lava_callback - INFO - Starting async job submit for node 69c41476944faaf0e7f6105e 2026-03-25 16:59:44,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:44,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41476944faaf0e7f6105e HTTP/1.1" 200 None 2026-03-25 16:59:44,835 - lava_callback - DEBUG - Processing node 69c41476944faaf0e7f6105e: baseline-nfs-arm64 2026-03-25 16:59:44,837 - lava_callback - WARNING - Failed to upload log 2026-03-25 16:59:44,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:48430 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:59:45,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:59:45,176 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41476944faaf0e7f6105e/lava-logs.yaml 2026-03-25 16:59:45,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:59:45,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:59:45,283 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41476944faaf0e7f6105e/lava_callback.json.gz 2026-03-25 16:59:45,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:45,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41476944faaf0e7f6105e HTTP/1.1" 200 None 2026-03-25 16:59:45,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:45,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:59:45,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:45,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41476944faaf0e7f6105e HTTP/1.1" 200 None 2026-03-25 16:59:45,385 - lava_callback - INFO - Completed processing callback for node 69c41476944faaf0e7f6105e INFO: 172.21.0.1:48438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37586 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:00:11,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:00:11,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33970 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:00:24,365 - lava_callback - INFO - Received callback for node 69c171932b2b51e9ad97a4ed INFO: 172.21.0.1:58892 - "POST /node/69c171932b2b51e9ad97a4ed HTTP/1.0" 202 Accepted 2026-03-25 17:00:24,371 - lava_callback - INFO - Starting async job submit for node 69c171932b2b51e9ad97a4ed 2026-03-25 17:00:24,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:00:24,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c171932b2b51e9ad97a4ed HTTP/1.1" 200 None 2026-03-25 17:00:24,387 - lava_callback - DEBUG - Processing node 69c171932b2b51e9ad97a4ed: baseline-arm64-baylibre 2026-03-25 17:00:24,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c171932b2b51e9ad97a4ed 2026-03-25 17:00:24,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:00:24,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c171932b2b51e9ad97a4ed HTTP/1.1" 200 None 2026-03-25 17:00:24,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:00:24,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:00:24,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:00:24,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c171932b2b51e9ad97a4ed HTTP/1.1" 200 None 2026-03-25 17:00:24,443 - lava_callback - ERROR - Error processing callback for node 69c171932b2b51e9ad97a4ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48932 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:01:44,490 - lava_callback - INFO - Received callback for node 69c171ee2b2b51e9ad97a50d INFO: 172.21.0.1:35230 - "POST /node/69c171ee2b2b51e9ad97a50d HTTP/1.0" 202 Accepted 2026-03-25 17:01:44,496 - lava_callback - INFO - Starting async job submit for node 69c171ee2b2b51e9ad97a50d 2026-03-25 17:01:44,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:01:44,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c171ee2b2b51e9ad97a50d HTTP/1.1" 200 None 2026-03-25 17:01:44,512 - lava_callback - DEBUG - Processing node 69c171ee2b2b51e9ad97a50d: baseline-arm64-baylibre 2026-03-25 17:01:44,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c171ee2b2b51e9ad97a50d 2026-03-25 17:01:44,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:01:44,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c171ee2b2b51e9ad97a50d HTTP/1.1" 200 None 2026-03-25 17:01:44,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:01:44,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:01:44,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:01:44,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c171ee2b2b51e9ad97a50d HTTP/1.1" 200 None 2026-03-25 17:01:44,584 - lava_callback - ERROR - Error processing callback for node 69c171ee2b2b51e9ad97a50d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:01:47,404 - lava_callback - INFO - Received callback for node 69c41142944faaf0e7f60d46 INFO: 172.21.0.1:35258 - "POST /node/69c41142944faaf0e7f60d46 HTTP/1.0" 202 Accepted 2026-03-25 17:01:47,411 - lava_callback - INFO - Starting async job submit for node 69c41142944faaf0e7f60d46 2026-03-25 17:01:47,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:01:47,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41142944faaf0e7f60d46 HTTP/1.1" 200 None 2026-03-25 17:01:47,485 - lava_callback - DEBUG - Processing node 69c41142944faaf0e7f60d46: baseline-x86 2026-03-25 17:01:48,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:01:48,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:01:48,434 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c41142944faaf0e7f60d46/log.txt.gz 2026-03-25 17:01:48,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:01:49,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:01:49,138 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c41142944faaf0e7f60d46/lava-logs.yaml 2026-03-25 17:01:49,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:01:49,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:01:49,344 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c41142944faaf0e7f60d46/lava_callback.json.gz DEBUG: Setup failed for 69c41142944faaf0e7f60d46. Transitting job node result: incomplete -> fail 2026-03-25 17:01:49,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:01:49,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41142944faaf0e7f60d46 HTTP/1.1" 200 None 2026-03-25 17:01:49,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:01:49,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40aef944faaf0e7f5e438 HTTP/1.1" 200 None 2026-03-25 17:01:49,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:01:49,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41142944faaf0e7f60d46 HTTP/1.1" 200 None 2026-03-25 17:01:49,600 - lava_callback - INFO - Completed processing callback for node 69c41142944faaf0e7f60d46 INFO: 172.21.0.1:37688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58488 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:02:11,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:11,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51486 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 17:02:16,351 - lava_callback - INFO - Received callback for node 69c41198944faaf0e7f60e02 INFO: 172.21.0.1:51502 - "POST /node/69c41198944faaf0e7f60e02 HTTP/1.0" 202 Accepted 2026-03-25 17:02:16,359 - lava_callback - INFO - Starting async job submit for node 69c41198944faaf0e7f60e02 2026-03-25 17:02:16,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:16,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41198944faaf0e7f60e02 HTTP/1.1" 200 None 2026-03-25 17:02:16,425 - lava_callback - DEBUG - Processing node 69c41198944faaf0e7f60e02: baseline-nfs-arm64 INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:02:17,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:02:17,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:02:17,351 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41198944faaf0e7f60e02/log.txt.gz 2026-03-25 17:02:17,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:02:18,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:02:18,058 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41198944faaf0e7f60e02/lava-logs.yaml 2026-03-25 17:02:18,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:02:18,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:02:18,259 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41198944faaf0e7f60e02/lava_callback.json.gz DEBUG: Setup failed for 69c41198944faaf0e7f60e02. Transitting job node result: incomplete -> fail 2026-03-25 17:02:18,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:18,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41198944faaf0e7f60e02 HTTP/1.1" 200 None 2026-03-25 17:02:18,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:18,391 - lava_callback - INFO - Received callback for node 69c41187944faaf0e7f60dd4 INFO: 172.21.0.1:51522 - "POST /node/69c41187944faaf0e7f60dd4 HTTP/1.0" 202 Accepted 2026-03-25 17:02:18,399 - lava_callback - INFO - Starting async job submit for node 69c41187944faaf0e7f60dd4 2026-03-25 17:02:18,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:18,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:02:18,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:18,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41187944faaf0e7f60dd4 HTTP/1.1" 200 None 2026-03-25 17:02:18,471 - lava_callback - DEBUG - Processing node 69c41187944faaf0e7f60dd4: baseline-arm64 2026-03-25 17:02:18,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41198944faaf0e7f60e02 HTTP/1.1" 200 None 2026-03-25 17:02:18,700 - lava_callback - INFO - Completed processing callback for node 69c41198944faaf0e7f60e02 2026-03-25 17:02:19,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:02:19,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:02:19,537 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41187944faaf0e7f60dd4/log.txt.gz 2026-03-25 17:02:19,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:02:20,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:02:20,211 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41187944faaf0e7f60dd4/lava-logs.yaml 2026-03-25 17:02:20,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:02:20,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:02:20,389 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41187944faaf0e7f60dd4/lava_callback.json.gz DEBUG: Setup failed for 69c41187944faaf0e7f60dd4. Transitting job node result: incomplete -> fail 2026-03-25 17:02:20,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:20,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41187944faaf0e7f60dd4 HTTP/1.1" 200 None 2026-03-25 17:02:20,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:20,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:02:20,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:20,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41187944faaf0e7f60dd4 HTTP/1.1" 200 None 2026-03-25 17:02:20,661 - lava_callback - INFO - Completed processing callback for node 69c41187944faaf0e7f60dd4 INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43922 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:02:41,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:42,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:03:04,500 - lava_callback - INFO - Received callback for node 69c41517944faaf0e7f61097 INFO: 172.21.0.1:35488 - "POST /node/69c41517944faaf0e7f61097 HTTP/1.0" 202 Accepted 2026-03-25 17:03:04,507 - lava_callback - INFO - Starting async job submit for node 69c41517944faaf0e7f61097 2026-03-25 17:03:04,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:04,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41517944faaf0e7f61097 HTTP/1.1" 200 None 2026-03-25 17:03:04,567 - lava_callback - DEBUG - Processing node 69c41517944faaf0e7f61097: baseline-arm64 2026-03-25 17:03:04,716 - lava_callback - WARNING - Failed to upload log 2026-03-25 17:03:04,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:03:04,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:03:04,966 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41517944faaf0e7f61097/lava-logs.yaml 2026-03-25 17:03:04,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:03:05,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:03:05,102 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41517944faaf0e7f61097/lava_callback.json.gz 2026-03-25 17:03:05,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:05,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41517944faaf0e7f61097 HTTP/1.1" 200 None 2026-03-25 17:03:05,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:05,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:03:05,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:05,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41517944faaf0e7f61097 HTTP/1.1" 200 None 2026-03-25 17:03:05,261 - lava_callback - INFO - Completed processing callback for node 69c41517944faaf0e7f61097 INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:03:12,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:12,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:03:24,572 - lava_callback - INFO - Received callback for node 69c172472b2b51e9ad97a522 INFO: 172.21.0.1:51856 - "POST /node/69c172472b2b51e9ad97a522 HTTP/1.0" 202 Accepted 2026-03-25 17:03:24,582 - lava_callback - INFO - Starting async job submit for node 69c172472b2b51e9ad97a522 2026-03-25 17:03:24,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:24,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c172472b2b51e9ad97a522 HTTP/1.1" 200 None 2026-03-25 17:03:24,605 - lava_callback - DEBUG - Processing node 69c172472b2b51e9ad97a522: baseline-arm64-baylibre 2026-03-25 17:03:24,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c172472b2b51e9ad97a522 2026-03-25 17:03:24,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:24,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c172472b2b51e9ad97a522 HTTP/1.1" 200 None 2026-03-25 17:03:24,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:24,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:03:24,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:24,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c172472b2b51e9ad97a522 HTTP/1.1" 200 None 2026-03-25 17:03:24,670 - lava_callback - ERROR - Error processing callback for node 69c172472b2b51e9ad97a522: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:04:36,027 - lava_callback - INFO - Received callback for node 69c4117c944faaf0e7f60da7 INFO: 172.21.0.1:48790 - "POST /node/69c4117c944faaf0e7f60da7 HTTP/1.0" 202 Accepted 2026-03-25 17:04:36,034 - lava_callback - INFO - Starting async job submit for node 69c4117c944faaf0e7f60da7 2026-03-25 17:04:36,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:36,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117c944faaf0e7f60da7 HTTP/1.1" 200 None 2026-03-25 17:04:36,086 - lava_callback - DEBUG - Processing node 69c4117c944faaf0e7f60da7: baseline-arm64 INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:04:36,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:04:36,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:04:36,745 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117c944faaf0e7f60da7/log.txt.gz 2026-03-25 17:04:37,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:04:37,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:04:37,457 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117c944faaf0e7f60da7/lava-logs.yaml 2026-03-25 17:04:37,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:04:37,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:04:37,640 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117c944faaf0e7f60da7/lava_callback.json.gz 2026-03-25 17:04:37,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:37,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117c944faaf0e7f60da7 HTTP/1.1" 200 None 2026-03-25 17:04:37,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:37,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:04:37,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:37,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4117c944faaf0e7f60da7 HTTP/1.1" 200 None 2026-03-25 17:04:37,764 - lava_callback - INFO - Completed processing callback for node 69c4117c944faaf0e7f60da7 2026-03-25 17:04:42,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:42,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44406 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:04:45,001 - lava_callback - INFO - Received callback for node 69c1729a2b2b51e9ad97a535 INFO: 172.21.0.1:44418 - "POST /node/69c1729a2b2b51e9ad97a535 HTTP/1.0" 202 Accepted 2026-03-25 17:04:45,007 - lava_callback - INFO - Starting async job submit for node 69c1729a2b2b51e9ad97a535 2026-03-25 17:04:45,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:45,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1729a2b2b51e9ad97a535 HTTP/1.1" 200 None 2026-03-25 17:04:45,024 - lava_callback - DEBUG - Processing node 69c1729a2b2b51e9ad97a535: baseline-arm64-baylibre 2026-03-25 17:04:45,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1729a2b2b51e9ad97a535 2026-03-25 17:04:45,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:45,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1729a2b2b51e9ad97a535 HTTP/1.1" 200 None 2026-03-25 17:04:45,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:45,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:04:45,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:45,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1729a2b2b51e9ad97a535 HTTP/1.1" 200 None 2026-03-25 17:04:45,093 - lava_callback - ERROR - Error processing callback for node 69c1729a2b2b51e9ad97a535: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36878 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:06:04,750 - lava_callback - INFO - Received callback for node 69c172f22b2b51e9ad97a54b INFO: 172.21.0.1:53024 - "POST /node/69c172f22b2b51e9ad97a54b HTTP/1.0" 202 Accepted 2026-03-25 17:06:04,759 - lava_callback - INFO - Starting async job submit for node 69c172f22b2b51e9ad97a54b 2026-03-25 17:06:04,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:06:04,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c172f22b2b51e9ad97a54b HTTP/1.1" 200 None 2026-03-25 17:06:04,774 - lava_callback - DEBUG - Processing node 69c172f22b2b51e9ad97a54b: baseline-arm64-baylibre 2026-03-25 17:06:04,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c172f22b2b51e9ad97a54b 2026-03-25 17:06:04,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:06:04,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c172f22b2b51e9ad97a54b HTTP/1.1" 200 None 2026-03-25 17:06:04,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:06:04,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:06:04,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:06:04,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c172f22b2b51e9ad97a54b HTTP/1.1" 200 None 2026-03-25 17:06:04,830 - lava_callback - ERROR - Error processing callback for node 69c172f22b2b51e9ad97a54b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:07:34,231 - lava_callback - INFO - Received callback for node 69c4161b944faaf0e7f610e4 INFO: 172.21.0.1:48704 - "POST /node/69c4161b944faaf0e7f610e4 HTTP/1.0" 202 Accepted 2026-03-25 17:07:34,237 - lava_callback - INFO - Starting async job submit for node 69c4161b944faaf0e7f610e4 2026-03-25 17:07:34,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:34,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4161b944faaf0e7f610e4 HTTP/1.1" 200 None 2026-03-25 17:07:34,281 - lava_callback - DEBUG - Processing node 69c4161b944faaf0e7f610e4: baseline-arm64 2026-03-25 17:07:34,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:07:34,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:07:34,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4161b944faaf0e7f610e4/log.txt.gz 2026-03-25 17:07:34,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:07:35,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:07:35,079 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4161b944faaf0e7f610e4/lava-logs.yaml 2026-03-25 17:07:35,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:07:35,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:07:35,287 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4161b944faaf0e7f610e4/lava_callback.json.gz 2026-03-25 17:07:35,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:35,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4161b944faaf0e7f610e4 HTTP/1.1" 200 None 2026-03-25 17:07:35,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:35,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:07:35,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:35,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4161b944faaf0e7f610e4 HTTP/1.1" 200 None 2026-03-25 17:07:35,368 - lava_callback - INFO - Completed processing callback for node 69c4161b944faaf0e7f610e4 INFO: 172.21.0.1:48712 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:07:42,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:42,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 17:07:44,796 - lava_callback - INFO - Received callback for node 69c1734b2b2b51e9ad97a562 INFO: 172.21.0.1:44420 - "POST /node/69c1734b2b2b51e9ad97a562 HTTP/1.0" 202 Accepted 2026-03-25 17:07:44,804 - lava_callback - INFO - Starting async job submit for node 69c1734b2b2b51e9ad97a562 2026-03-25 17:07:44,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:44,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1734b2b2b51e9ad97a562 HTTP/1.1" 200 None 2026-03-25 17:07:44,831 - lava_callback - DEBUG - Processing node 69c1734b2b2b51e9ad97a562: baseline-arm64-baylibre 2026-03-25 17:07:44,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1734b2b2b51e9ad97a562 2026-03-25 17:07:44,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:44,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1734b2b2b51e9ad97a562 HTTP/1.1" 200 None 2026-03-25 17:07:44,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:44,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:07:44,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:44,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1734b2b2b51e9ad97a562 HTTP/1.1" 200 None 2026-03-25 17:07:44,893 - lava_callback - ERROR - Error processing callback for node 69c1734b2b2b51e9ad97a562: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:09:39,637 - lava_callback - INFO - Received callback for node 69c173cf2b2b51e9ad97a584 INFO: 172.21.0.1:40272 - "POST /node/69c173cf2b2b51e9ad97a584 HTTP/1.0" 202 Accepted 2026-03-25 17:09:39,642 - lava_callback - INFO - Starting async job submit for node 69c173cf2b2b51e9ad97a584 2026-03-25 17:09:39,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:09:39,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c173cf2b2b51e9ad97a584 HTTP/1.1" 200 None 2026-03-25 17:09:39,659 - lava_callback - DEBUG - Processing node 69c173cf2b2b51e9ad97a584: baseline-arm64-clabbe 2026-03-25 17:09:39,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c173cf2b2b51e9ad97a584 2026-03-25 17:09:39,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:09:39,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c173cf2b2b51e9ad97a584 HTTP/1.1" 200 None 2026-03-25 17:09:39,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:09:39,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:09:39,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:09:39,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c173cf2b2b51e9ad97a584 HTTP/1.1" 200 None 2026-03-25 17:09:39,727 - lava_callback - ERROR - Error processing callback for node 69c173cf2b2b51e9ad97a584: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:09:43,989 - lava_callback - INFO - Received callback for node 69c416c4944faaf0e7f61112 INFO: 172.21.0.1:51000 - "POST /node/69c416c4944faaf0e7f61112 HTTP/1.0" 202 Accepted 2026-03-25 17:09:43,995 - lava_callback - INFO - Starting async job submit for node 69c416c4944faaf0e7f61112 2026-03-25 17:09:43,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:09:44,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c416c4944faaf0e7f61112 HTTP/1.1" 200 None 2026-03-25 17:09:44,015 - lava_callback - DEBUG - Processing node 69c416c4944faaf0e7f61112: baseline-arm 2026-03-25 17:09:44,020 - lava_callback - WARNING - Failed to upload log 2026-03-25 17:09:44,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:09:44,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:09:44,306 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c416c4944faaf0e7f61112/lava-logs.yaml 2026-03-25 17:09:44,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:09:44,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:09:44,464 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c416c4944faaf0e7f61112/lava_callback.json.gz 2026-03-25 17:09:44,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:09:44,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c416c4944faaf0e7f61112 HTTP/1.1" 200 None 2026-03-25 17:09:44,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:09:44,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 17:09:44,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:09:44,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c416c4944faaf0e7f61112 HTTP/1.1" 200 None 2026-03-25 17:09:44,532 - lava_callback - INFO - Completed processing callback for node 69c416c4944faaf0e7f61112 INFO: 172.21.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55014 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:10:12,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:10:12,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50976 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:10:31,730 - lava_callback - INFO - Received callback for node 69c415c3944faaf0e7f610d2 INFO: 172.21.0.1:34916 - "POST /node/69c415c3944faaf0e7f610d2 HTTP/1.0" 202 Accepted 2026-03-25 17:10:31,737 - lava_callback - INFO - Starting async job submit for node 69c415c3944faaf0e7f610d2 2026-03-25 17:10:31,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:10:31,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c415c3944faaf0e7f610d2 HTTP/1.1" 200 None 2026-03-25 17:10:31,785 - lava_callback - DEBUG - Processing node 69c415c3944faaf0e7f610d2: baseline-arm64 2026-03-25 17:10:31,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:10:32,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:10:32,096 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c415c3944faaf0e7f610d2/log.txt.gz 2026-03-25 17:10:32,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:10:32,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:10:32,391 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c415c3944faaf0e7f610d2/lava-logs.yaml 2026-03-25 17:10:32,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:10:32,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:10:32,534 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c415c3944faaf0e7f610d2/lava_callback.json.gz 2026-03-25 17:10:32,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:10:32,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c415c3944faaf0e7f610d2 HTTP/1.1" 200 None 2026-03-25 17:10:32,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:10:32,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:10:32,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:10:32,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c415c3944faaf0e7f610d2 HTTP/1.1" 200 None 2026-03-25 17:10:32,664 - lava_callback - INFO - Completed processing callback for node 69c415c3944faaf0e7f610d2 INFO: 172.21.0.1:34926 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:10:42,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:10:42,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39162 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:11:19,282 - lava_callback - INFO - Received callback for node 69c174272b2b51e9ad97a5a1 INFO: 172.21.0.1:39178 - "POST /node/69c174272b2b51e9ad97a5a1 HTTP/1.0" 202 Accepted 2026-03-25 17:11:19,291 - lava_callback - INFO - Starting async job submit for node 69c174272b2b51e9ad97a5a1 2026-03-25 17:11:19,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:11:19,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c174272b2b51e9ad97a5a1 HTTP/1.1" 200 None 2026-03-25 17:11:19,314 - lava_callback - DEBUG - Processing node 69c174272b2b51e9ad97a5a1: baseline-arm64-clabbe 2026-03-25 17:11:19,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c174272b2b51e9ad97a5a1 2026-03-25 17:11:19,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:11:19,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c174272b2b51e9ad97a5a1 HTTP/1.1" 200 None 2026-03-25 17:11:19,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:11:19,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:11:19,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:11:19,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c174272b2b51e9ad97a5a1 HTTP/1.1" 200 None 2026-03-25 17:11:19,377 - lava_callback - ERROR - Error processing callback for node 69c174272b2b51e9ad97a5a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43800 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:12:39,364 - lava_callback - INFO - Received callback for node 69c174822b2b51e9ad97a5b6 INFO: 172.21.0.1:43814 - "POST /node/69c174822b2b51e9ad97a5b6 HTTP/1.0" 202 Accepted 2026-03-25 17:12:39,373 - lava_callback - INFO - Starting async job submit for node 69c174822b2b51e9ad97a5b6 2026-03-25 17:12:39,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:12:39,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c174822b2b51e9ad97a5b6 HTTP/1.1" 200 None 2026-03-25 17:12:39,400 - lava_callback - DEBUG - Processing node 69c174822b2b51e9ad97a5b6: baseline-arm64-clabbe 2026-03-25 17:12:39,400 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c174822b2b51e9ad97a5b6 2026-03-25 17:12:39,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:12:39,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c174822b2b51e9ad97a5b6 HTTP/1.1" 200 None 2026-03-25 17:12:39,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:12:39,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:12:39,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:12:39,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c174822b2b51e9ad97a5b6 HTTP/1.1" 200 None 2026-03-25 17:12:39,531 - lava_callback - ERROR - Error processing callback for node 69c174822b2b51e9ad97a5b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:14:19,468 - lava_callback - INFO - Received callback for node 69c174e52b2b51e9ad97a5e5 INFO: 172.21.0.1:56812 - "POST /node/69c174e52b2b51e9ad97a5e5 HTTP/1.0" 202 Accepted 2026-03-25 17:14:19,474 - lava_callback - INFO - Starting async job submit for node 69c174e52b2b51e9ad97a5e5 2026-03-25 17:14:19,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:14:19,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c174e52b2b51e9ad97a5e5 HTTP/1.1" 200 None 2026-03-25 17:14:19,490 - lava_callback - DEBUG - Processing node 69c174e52b2b51e9ad97a5e5: baseline-arm64-clabbe 2026-03-25 17:14:19,490 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c174e52b2b51e9ad97a5e5 2026-03-25 17:14:19,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:14:19,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c174e52b2b51e9ad97a5e5 HTTP/1.1" 200 None 2026-03-25 17:14:19,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:14:19,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:14:19,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:14:19,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c174e52b2b51e9ad97a5e5 HTTP/1.1" 200 None 2026-03-25 17:14:19,545 - lava_callback - ERROR - Error processing callback for node 69c174e52b2b51e9ad97a5e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57130 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:15:25,585 - lava_callback - INFO - Received callback for node 69c4181e944faaf0e7f61172 INFO: 172.21.0.1:50720 - "POST /node/69c4181e944faaf0e7f61172 HTTP/1.0" 202 Accepted 2026-03-25 17:15:25,591 - lava_callback - INFO - Starting async job submit for node 69c4181e944faaf0e7f61172 2026-03-25 17:15:25,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:25,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4181e944faaf0e7f61172 HTTP/1.1" 200 None 2026-03-25 17:15:25,608 - lava_callback - DEBUG - Processing node 69c4181e944faaf0e7f61172: baseline-nfs-arm64 2026-03-25 17:15:25,609 - lava_callback - WARNING - Failed to upload log 2026-03-25 17:15:25,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:15:25,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:15:25,751 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4181e944faaf0e7f61172/lava-logs.yaml 2026-03-25 17:15:25,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:15:25,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:15:25,913 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4181e944faaf0e7f61172/lava_callback.json.gz 2026-03-25 17:15:25,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:25,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4181e944faaf0e7f61172 HTTP/1.1" 200 None 2026-03-25 17:15:25,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:25,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:15:25,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:25,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4181e944faaf0e7f61172 HTTP/1.1" 200 None 2026-03-25 17:15:25,978 - lava_callback - INFO - Completed processing callback for node 69c4181e944faaf0e7f61172 INFO: 172.21.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41778 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:15:42,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:42,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:15:59,549 - lava_callback - INFO - Received callback for node 69c1753f2b2b51e9ad97a61c INFO: 172.21.0.1:47824 - "POST /node/69c1753f2b2b51e9ad97a61c HTTP/1.0" 202 Accepted 2026-03-25 17:15:59,555 - lava_callback - INFO - Starting async job submit for node 69c1753f2b2b51e9ad97a61c 2026-03-25 17:15:59,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:59,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1753f2b2b51e9ad97a61c HTTP/1.1" 200 None 2026-03-25 17:15:59,573 - lava_callback - DEBUG - Processing node 69c1753f2b2b51e9ad97a61c: baseline-arm64-clabbe 2026-03-25 17:15:59,573 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1753f2b2b51e9ad97a61c 2026-03-25 17:15:59,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:59,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1753f2b2b51e9ad97a61c HTTP/1.1" 200 None 2026-03-25 17:15:59,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:59,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:15:59,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:59,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1753f2b2b51e9ad97a61c HTTP/1.1" 200 None 2026-03-25 17:15:59,636 - lava_callback - ERROR - Error processing callback for node 69c1753f2b2b51e9ad97a61c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:16:48,811 - lava_callback - INFO - Received callback for node 69c41746944faaf0e7f61140 INFO: 172.21.0.1:34518 - "POST /node/69c41746944faaf0e7f61140 HTTP/1.0" 202 Accepted 2026-03-25 17:16:48,818 - lava_callback - INFO - Starting async job submit for node 69c41746944faaf0e7f61140 2026-03-25 17:16:48,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:16:48,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41746944faaf0e7f61140 HTTP/1.1" 200 None 2026-03-25 17:16:48,868 - lava_callback - DEBUG - Processing node 69c41746944faaf0e7f61140: baseline-arm64 2026-03-25 17:16:49,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:16:49,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:16:49,436 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41746944faaf0e7f61140/log.txt.gz 2026-03-25 17:16:49,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:16:49,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:16:49,852 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41746944faaf0e7f61140/lava-logs.yaml 2026-03-25 17:16:49,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:16:50,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:16:50,011 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41746944faaf0e7f61140/lava_callback.json.gz DEBUG: Setup failed for 69c41746944faaf0e7f61140. Transitting job node result: incomplete -> fail 2026-03-25 17:16:50,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:16:50,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41746944faaf0e7f61140 HTTP/1.1" 200 None 2026-03-25 17:16:50,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:16:50,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:16:50,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:16:50,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41746944faaf0e7f61140 HTTP/1.1" 200 None 2026-03-25 17:16:50,225 - lava_callback - INFO - Completed processing callback for node 69c41746944faaf0e7f61140 INFO: 172.21.0.1:55284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:17:12,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:17:12,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58074 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:17:19,585 - lava_callback - INFO - Received callback for node 69c175992b2b51e9ad97a653 INFO: 172.21.0.1:58086 - "POST /node/69c175992b2b51e9ad97a653 HTTP/1.0" 202 Accepted 2026-03-25 17:17:19,592 - lava_callback - INFO - Starting async job submit for node 69c175992b2b51e9ad97a653 2026-03-25 17:17:19,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:17:19,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c175992b2b51e9ad97a653 HTTP/1.1" 200 None 2026-03-25 17:17:19,607 - lava_callback - DEBUG - Processing node 69c175992b2b51e9ad97a653: baseline-arm64-clabbe 2026-03-25 17:17:19,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c175992b2b51e9ad97a653 2026-03-25 17:17:19,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:17:19,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c175992b2b51e9ad97a653 HTTP/1.1" 200 None 2026-03-25 17:17:19,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:17:19,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:17:19,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:17:19,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c175992b2b51e9ad97a653 HTTP/1.1" 200 None 2026-03-25 17:17:19,662 - lava_callback - ERROR - Error processing callback for node 69c175992b2b51e9ad97a653: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:18:25,379 - lava_callback - INFO - Received callback for node 69c175dc2b2b51e9ad97a688 INFO: 172.21.0.1:58484 - "POST /node/69c175dc2b2b51e9ad97a688 HTTP/1.0" 202 Accepted 2026-03-25 17:18:25,385 - lava_callback - INFO - Starting async job submit for node 69c175dc2b2b51e9ad97a688 2026-03-25 17:18:25,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:18:25,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c175dc2b2b51e9ad97a688 HTTP/1.1" 200 None 2026-03-25 17:18:25,402 - lava_callback - DEBUG - Processing node 69c175dc2b2b51e9ad97a688: baseline-arm-baylibre 2026-03-25 17:18:25,402 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c175dc2b2b51e9ad97a688 2026-03-25 17:18:25,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:18:25,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c175dc2b2b51e9ad97a688 HTTP/1.1" 200 None 2026-03-25 17:18:25,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:18:25,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:18:25,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:18:25,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c175dc2b2b51e9ad97a688 HTTP/1.1" 200 None 2026-03-25 17:18:25,455 - lava_callback - ERROR - Error processing callback for node 69c175dc2b2b51e9ad97a688: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:19:05,360 - lava_callback - INFO - Received callback for node 69c176042b2b51e9ad97a695 INFO: 172.21.0.1:59970 - "POST /node/69c176042b2b51e9ad97a695 HTTP/1.0" 202 Accepted 2026-03-25 17:19:05,366 - lava_callback - INFO - Starting async job submit for node 69c176042b2b51e9ad97a695 2026-03-25 17:19:05,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:19:05,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c176042b2b51e9ad97a695 HTTP/1.1" 200 None 2026-03-25 17:19:05,382 - lava_callback - DEBUG - Processing node 69c176042b2b51e9ad97a695: baseline-arm-baylibre 2026-03-25 17:19:05,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c176042b2b51e9ad97a695 2026-03-25 17:19:05,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:19:05,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c176042b2b51e9ad97a695 HTTP/1.1" 200 None 2026-03-25 17:19:05,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:19:05,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:19:05,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:19:05,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c176042b2b51e9ad97a695 HTTP/1.1" 200 None 2026-03-25 17:19:05,454 - lava_callback - ERROR - Error processing callback for node 69c176042b2b51e9ad97a695: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:19:45,479 - lava_callback - INFO - Received callback for node 69c1762c2b2b51e9ad97a6a0 INFO: 172.21.0.1:36952 - "POST /node/69c1762c2b2b51e9ad97a6a0 HTTP/1.0" 202 Accepted 2026-03-25 17:19:45,485 - lava_callback - INFO - Starting async job submit for node 69c1762c2b2b51e9ad97a6a0 2026-03-25 17:19:45,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:19:45,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1762c2b2b51e9ad97a6a0 HTTP/1.1" 200 None 2026-03-25 17:19:45,501 - lava_callback - DEBUG - Processing node 69c1762c2b2b51e9ad97a6a0: baseline-arm-baylibre 2026-03-25 17:19:45,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1762c2b2b51e9ad97a6a0 2026-03-25 17:19:45,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:19:45,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1762c2b2b51e9ad97a6a0 HTTP/1.1" 200 None 2026-03-25 17:19:45,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:19:45,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:19:45,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:19:45,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1762c2b2b51e9ad97a6a0 HTTP/1.1" 200 None 2026-03-25 17:19:45,571 - lava_callback - ERROR - Error processing callback for node 69c1762c2b2b51e9ad97a6a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:20:25,433 - lava_callback - INFO - Received callback for node 69c176542b2b51e9ad97a6a9 INFO: 172.21.0.1:49862 - "POST /node/69c176542b2b51e9ad97a6a9 HTTP/1.0" 202 Accepted 2026-03-25 17:20:25,439 - lava_callback - INFO - Starting async job submit for node 69c176542b2b51e9ad97a6a9 2026-03-25 17:20:25,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:20:25,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c176542b2b51e9ad97a6a9 HTTP/1.1" 200 None 2026-03-25 17:20:25,456 - lava_callback - DEBUG - Processing node 69c176542b2b51e9ad97a6a9: baseline-arm-baylibre 2026-03-25 17:20:25,457 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c176542b2b51e9ad97a6a9 2026-03-25 17:20:25,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:20:25,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c176542b2b51e9ad97a6a9 HTTP/1.1" 200 None 2026-03-25 17:20:25,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:20:25,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:20:25,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:20:25,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c176542b2b51e9ad97a6a9 HTTP/1.1" 200 None 2026-03-25 17:20:25,523 - lava_callback - ERROR - Error processing callback for node 69c176542b2b51e9ad97a6a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50680 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:21:05,570 - lava_callback - INFO - Received callback for node 69c1767c2b2b51e9ad97a6b2 INFO: 172.21.0.1:41324 - "POST /node/69c1767c2b2b51e9ad97a6b2 HTTP/1.0" 202 Accepted 2026-03-25 17:21:05,575 - lava_callback - INFO - Starting async job submit for node 69c1767c2b2b51e9ad97a6b2 2026-03-25 17:21:05,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:21:05,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1767c2b2b51e9ad97a6b2 HTTP/1.1" 200 None 2026-03-25 17:21:05,595 - lava_callback - DEBUG - Processing node 69c1767c2b2b51e9ad97a6b2: baseline-arm-baylibre 2026-03-25 17:21:05,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1767c2b2b51e9ad97a6b2 2026-03-25 17:21:05,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:21:05,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1767c2b2b51e9ad97a6b2 HTTP/1.1" 200 None 2026-03-25 17:21:05,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:21:05,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:21:05,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:21:05,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1767c2b2b51e9ad97a6b2 HTTP/1.1" 200 None 2026-03-25 17:21:05,652 - lava_callback - ERROR - Error processing callback for node 69c1767c2b2b51e9ad97a6b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58014 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:21:45,526 - lava_callback - INFO - Received callback for node 69c176a42b2b51e9ad97a6bb INFO: 172.21.0.1:58016 - "POST /node/69c176a42b2b51e9ad97a6bb HTTP/1.0" 202 Accepted 2026-03-25 17:21:45,531 - lava_callback - INFO - Starting async job submit for node 69c176a42b2b51e9ad97a6bb 2026-03-25 17:21:45,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:21:45,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c176a42b2b51e9ad97a6bb HTTP/1.1" 200 None 2026-03-25 17:21:45,548 - lava_callback - DEBUG - Processing node 69c176a42b2b51e9ad97a6bb: baseline-arm-baylibre 2026-03-25 17:21:45,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c176a42b2b51e9ad97a6bb 2026-03-25 17:21:45,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:21:45,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c176a42b2b51e9ad97a6bb HTTP/1.1" 200 None 2026-03-25 17:21:45,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:21:45,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:21:45,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:21:45,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c176a42b2b51e9ad97a6bb HTTP/1.1" 200 None 2026-03-25 17:21:45,613 - lava_callback - ERROR - Error processing callback for node 69c176a42b2b51e9ad97a6bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37668 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:23:19,837 - lava_callback - INFO - Received callback for node 69c176f42b2b51e9ad97a6ce INFO: 172.21.0.1:38278 - "POST /node/69c176f42b2b51e9ad97a6ce HTTP/1.0" 202 Accepted 2026-03-25 17:23:19,843 - lava_callback - INFO - Starting async job submit for node 69c176f42b2b51e9ad97a6ce 2026-03-25 17:23:19,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:19,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c176f42b2b51e9ad97a6ce HTTP/1.1" 200 None 2026-03-25 17:23:19,859 - lava_callback - DEBUG - Processing node 69c176f42b2b51e9ad97a6ce: baseline-arm-clabbe 2026-03-25 17:23:19,860 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c176f42b2b51e9ad97a6ce 2026-03-25 17:23:19,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:19,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c176f42b2b51e9ad97a6ce HTTP/1.1" 200 None 2026-03-25 17:23:19,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:19,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:23:19,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:19,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c176f42b2b51e9ad97a6ce HTTP/1.1" 200 None 2026-03-25 17:23:19,946 - lava_callback - ERROR - Error processing callback for node 69c176f42b2b51e9ad97a6ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:23:48,151 - lava_callback - INFO - Received callback for node 69c4118d944faaf0e7f60de7 INFO: 172.21.0.1:58854 - "POST /node/69c4118d944faaf0e7f60de7 HTTP/1.0" 202 Accepted 2026-03-25 17:23:48,160 - lava_callback - INFO - Starting async job submit for node 69c4118d944faaf0e7f60de7 2026-03-25 17:23:48,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:48,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4118d944faaf0e7f60de7 HTTP/1.1" 200 None 2026-03-25 17:23:48,219 - lava_callback - DEBUG - Processing node 69c4118d944faaf0e7f60de7: baseline-nfs-arm64 2026-03-25 17:23:49,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:23:49,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:23:49,496 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118d944faaf0e7f60de7/log.txt.gz 2026-03-25 17:23:50,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:23:50,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:23:50,406 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118d944faaf0e7f60de7/lava-logs.yaml 2026-03-25 17:23:50,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:23:50,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:23:50,618 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118d944faaf0e7f60de7/lava_callback.json.gz DEBUG: Setup failed for 69c4118d944faaf0e7f60de7. Transitting job node result: incomplete -> fail 2026-03-25 17:23:50,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:50,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4118d944faaf0e7f60de7 HTTP/1.1" 200 None 2026-03-25 17:23:50,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:50,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:23:50,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:50,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4118d944faaf0e7f60de7 HTTP/1.1" 200 None 2026-03-25 17:23:50,881 - lava_callback - INFO - Completed processing callback for node 69c4118d944faaf0e7f60de7 INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:23:59,780 - lava_callback - INFO - Received callback for node 69c1771d2b2b51e9ad97a6d8 INFO: 172.21.0.1:41072 - "POST /node/69c1771d2b2b51e9ad97a6d8 HTTP/1.0" 202 Accepted 2026-03-25 17:23:59,786 - lava_callback - INFO - Starting async job submit for node 69c1771d2b2b51e9ad97a6d8 2026-03-25 17:23:59,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:59,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1771d2b2b51e9ad97a6d8 HTTP/1.1" 200 None 2026-03-25 17:23:59,830 - lava_callback - DEBUG - Processing node 69c1771d2b2b51e9ad97a6d8: baseline-arm-clabbe 2026-03-25 17:23:59,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1771d2b2b51e9ad97a6d8 2026-03-25 17:23:59,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:59,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1771d2b2b51e9ad97a6d8 HTTP/1.1" 200 None 2026-03-25 17:23:59,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:59,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:23:59,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:59,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1771d2b2b51e9ad97a6d8 HTTP/1.1" 200 None 2026-03-25 17:23:59,886 - lava_callback - ERROR - Error processing callback for node 69c1771d2b2b51e9ad97a6d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:24:12,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:24:12,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53806 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:24:39,855 - lava_callback - INFO - Received callback for node 69c177442b2b51e9ad97a6e2 INFO: 172.21.0.1:54258 - "POST /node/69c177442b2b51e9ad97a6e2 HTTP/1.0" 202 Accepted 2026-03-25 17:24:39,860 - lava_callback - INFO - Starting async job submit for node 69c177442b2b51e9ad97a6e2 2026-03-25 17:24:39,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:24:39,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c177442b2b51e9ad97a6e2 HTTP/1.1" 200 None 2026-03-25 17:24:39,877 - lava_callback - DEBUG - Processing node 69c177442b2b51e9ad97a6e2: baseline-arm-clabbe 2026-03-25 17:24:39,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c177442b2b51e9ad97a6e2 2026-03-25 17:24:39,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:24:39,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c177442b2b51e9ad97a6e2 HTTP/1.1" 200 None 2026-03-25 17:24:39,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:24:39,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:24:39,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:24:39,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c177442b2b51e9ad97a6e2 HTTP/1.1" 200 None 2026-03-25 17:24:39,941 - lava_callback - ERROR - Error processing callback for node 69c177442b2b51e9ad97a6e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55530 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:25:19,821 - lava_callback - INFO - Received callback for node 69c177732b2b51e9ad97a6ec INFO: 172.21.0.1:45320 - "POST /node/69c177732b2b51e9ad97a6ec HTTP/1.0" 202 Accepted 2026-03-25 17:25:19,826 - lava_callback - INFO - Starting async job submit for node 69c177732b2b51e9ad97a6ec 2026-03-25 17:25:19,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:19,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c177732b2b51e9ad97a6ec HTTP/1.1" 200 None 2026-03-25 17:25:19,843 - lava_callback - DEBUG - Processing node 69c177732b2b51e9ad97a6ec: baseline-arm-clabbe 2026-03-25 17:25:19,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c177732b2b51e9ad97a6ec 2026-03-25 17:25:19,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:19,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c177732b2b51e9ad97a6ec HTTP/1.1" 200 None 2026-03-25 17:25:19,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:19,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:25:19,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:19,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c177732b2b51e9ad97a6ec HTTP/1.1" 200 None 2026-03-25 17:25:19,915 - lava_callback - ERROR - Error processing callback for node 69c177732b2b51e9ad97a6ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45328 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:25:32,037 - lava_callback - INFO - Received callback for node 69c41a47944faaf0e7f611df INFO: 172.21.0.1:41968 - "POST /node/69c41a47944faaf0e7f611df HTTP/1.0" 202 Accepted 2026-03-25 17:25:32,044 - lava_callback - INFO - Starting async job submit for node 69c41a47944faaf0e7f611df 2026-03-25 17:25:32,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:32,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41a47944faaf0e7f611df HTTP/1.1" 200 None 2026-03-25 17:25:32,089 - lava_callback - DEBUG - Processing node 69c41a47944faaf0e7f611df: baseline-arm64 2026-03-25 17:25:32,220 - lava_callback - WARNING - Failed to upload log 2026-03-25 17:25:32,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:25:32,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:25:32,503 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41a47944faaf0e7f611df/lava-logs.yaml 2026-03-25 17:25:32,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:25:32,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:25:32,644 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41a47944faaf0e7f611df/lava_callback.json.gz 2026-03-25 17:25:32,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:32,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41a47944faaf0e7f611df HTTP/1.1" 200 None 2026-03-25 17:25:32,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:32,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:25:32,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:32,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41a47944faaf0e7f611df HTTP/1.1" 200 None 2026-03-25 17:25:32,785 - lava_callback - INFO - Completed processing callback for node 69c41a47944faaf0e7f611df INFO: 172.21.0.1:41976 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:25:42,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:42,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 17:25:42,312 - lava_callback - INFO - Received callback for node 69c4166f944faaf0e7f610f8 INFO: 172.21.0.1:43036 - "POST /node/69c4166f944faaf0e7f610f8 HTTP/1.0" 202 Accepted 2026-03-25 17:25:42,318 - lava_callback - INFO - Starting async job submit for node 69c4166f944faaf0e7f610f8 2026-03-25 17:25:42,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:42,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4166f944faaf0e7f610f8 HTTP/1.1" 200 None 2026-03-25 17:25:42,390 - lava_callback - DEBUG - Processing node 69c4166f944faaf0e7f610f8: ltp-smoke 2026-03-25 17:25:42,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:25:43,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:25:43,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c4166f944faaf0e7f610f8/log.txt.gz 2026-03-25 17:25:43,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:25:43,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:25:43,502 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c4166f944faaf0e7f610f8/lava-logs.yaml 2026-03-25 17:25:43,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:25:43,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:25:43,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c4166f944faaf0e7f610f8/lava_callback.json.gz 2026-03-25 17:25:43,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:43,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4166f944faaf0e7f610f8 HTTP/1.1" 200 None 2026-03-25 17:25:43,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:43,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ace944faaf0e7f5e40e HTTP/1.1" 200 None 2026-03-25 17:25:43,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:43,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4166f944faaf0e7f610f8 HTTP/1.1" 200 None 2026-03-25 17:25:43,998 - lava_callback - INFO - Completed processing callback for node 69c4166f944faaf0e7f610f8 INFO: 172.21.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57950 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:25:59,947 - lava_callback - INFO - Received callback for node 69c1779d2b2b51e9ad97a6fb INFO: 172.21.0.1:34924 - "POST /node/69c1779d2b2b51e9ad97a6fb HTTP/1.0" 202 Accepted 2026-03-25 17:25:59,953 - lava_callback - INFO - Starting async job submit for node 69c1779d2b2b51e9ad97a6fb 2026-03-25 17:25:59,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:59,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1779d2b2b51e9ad97a6fb HTTP/1.1" 200 None 2026-03-25 17:25:59,978 - lava_callback - DEBUG - Processing node 69c1779d2b2b51e9ad97a6fb: baseline-arm-clabbe 2026-03-25 17:25:59,978 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1779d2b2b51e9ad97a6fb 2026-03-25 17:25:59,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:26:00,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1779d2b2b51e9ad97a6fb HTTP/1.1" 200 None 2026-03-25 17:26:00,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:26:00,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:26:00,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:26:00,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1779d2b2b51e9ad97a6fb HTTP/1.1" 200 None 2026-03-25 17:26:00,053 - lava_callback - ERROR - Error processing callback for node 69c1779d2b2b51e9ad97a6fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34930 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:26:12,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:26:12,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:27:39,972 - lava_callback - INFO - Received callback for node 69c177f92b2b51e9ad97a712 INFO: 172.21.0.1:56852 - "POST /node/69c177f92b2b51e9ad97a712 HTTP/1.0" 202 Accepted 2026-03-25 17:27:39,977 - lava_callback - INFO - Starting async job submit for node 69c177f92b2b51e9ad97a712 2026-03-25 17:27:39,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:27:39,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c177f92b2b51e9ad97a712 HTTP/1.1" 200 None 2026-03-25 17:27:39,993 - lava_callback - DEBUG - Processing node 69c177f92b2b51e9ad97a712: baseline-arm64-clabbe 2026-03-25 17:27:39,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c177f92b2b51e9ad97a712 2026-03-25 17:27:39,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:27:40,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c177f92b2b51e9ad97a712 HTTP/1.1" 200 None 2026-03-25 17:27:40,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:27:40,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 17:27:40,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:27:40,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c177f92b2b51e9ad97a712 HTTP/1.1" 200 None 2026-03-25 17:27:40,070 - lava_callback - ERROR - Error processing callback for node 69c177f92b2b51e9ad97a712: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59932 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:28:16,617 - lava_callback - INFO - Received callback for node 69c417eb944faaf0e7f61166 INFO: 172.21.0.1:59938 - "POST /node/69c417eb944faaf0e7f61166 HTTP/1.0" 202 Accepted 2026-03-25 17:28:16,627 - lava_callback - INFO - Starting async job submit for node 69c417eb944faaf0e7f61166 2026-03-25 17:28:16,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:28:16,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c417eb944faaf0e7f61166 HTTP/1.1" 200 None 2026-03-25 17:28:16,727 - lava_callback - DEBUG - Processing node 69c417eb944faaf0e7f61166: baseline-arm 2026-03-25 17:28:17,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:28:17,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:28:17,474 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c417eb944faaf0e7f61166/log.txt.gz 2026-03-25 17:28:17,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:28:18,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:28:18,026 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c417eb944faaf0e7f61166/lava-logs.yaml 2026-03-25 17:28:18,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:28:18,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:28:18,251 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c417eb944faaf0e7f61166/lava_callback.json.gz DEBUG: Setup failed for 69c417eb944faaf0e7f61166. Transitting job node result: incomplete -> fail 2026-03-25 17:28:18,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:28:18,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c417eb944faaf0e7f61166 HTTP/1.1" 200 None 2026-03-25 17:28:18,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:28:18,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 17:28:18,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:28:18,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c417eb944faaf0e7f61166 HTTP/1.1" 200 None 2026-03-25 17:28:18,551 - lava_callback - INFO - Completed processing callback for node 69c417eb944faaf0e7f61166 INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35864 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:28:42,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:28:42,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50290 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:30:20,094 - lava_callback - INFO - Received callback for node 69c178a02b2b51e9ad97a72d INFO: 172.21.0.1:37394 - "POST /node/69c178a02b2b51e9ad97a72d HTTP/1.0" 202 Accepted 2026-03-25 17:30:20,100 - lava_callback - INFO - Starting async job submit for node 69c178a02b2b51e9ad97a72d 2026-03-25 17:30:20,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:30:20,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c178a02b2b51e9ad97a72d HTTP/1.1" 200 None 2026-03-25 17:30:20,117 - lava_callback - DEBUG - Processing node 69c178a02b2b51e9ad97a72d: baseline-arm64-clabbe 2026-03-25 17:30:20,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c178a02b2b51e9ad97a72d 2026-03-25 17:30:20,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:30:20,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c178a02b2b51e9ad97a72d HTTP/1.1" 200 None 2026-03-25 17:30:20,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:30:20,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 17:30:20,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:30:20,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c178a02b2b51e9ad97a72d HTTP/1.1" 200 None 2026-03-25 17:30:20,198 - lava_callback - ERROR - Error processing callback for node 69c178a02b2b51e9ad97a72d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56374 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:31:40,146 - lava_callback - INFO - Received callback for node 69c178f42b2b51e9ad97a736 INFO: 172.21.0.1:60938 - "POST /node/69c178f42b2b51e9ad97a736 HTTP/1.0" 202 Accepted 2026-03-25 17:31:40,152 - lava_callback - INFO - Starting async job submit for node 69c178f42b2b51e9ad97a736 2026-03-25 17:31:40,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:31:40,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c178f42b2b51e9ad97a736 HTTP/1.1" 200 None 2026-03-25 17:31:40,169 - lava_callback - DEBUG - Processing node 69c178f42b2b51e9ad97a736: baseline-arm64-clabbe 2026-03-25 17:31:40,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c178f42b2b51e9ad97a736 2026-03-25 17:31:40,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:31:40,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c178f42b2b51e9ad97a736 HTTP/1.1" 200 None 2026-03-25 17:31:40,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:31:40,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 17:31:40,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:31:40,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c178f42b2b51e9ad97a736 HTTP/1.1" 200 None 2026-03-25 17:31:40,223 - lava_callback - ERROR - Error processing callback for node 69c178f42b2b51e9ad97a736: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:33:20,236 - lava_callback - INFO - Received callback for node 69c1794b2b2b51e9ad97a74e INFO: 172.21.0.1:51910 - "POST /node/69c1794b2b2b51e9ad97a74e HTTP/1.0" 202 Accepted 2026-03-25 17:33:20,242 - lava_callback - INFO - Starting async job submit for node 69c1794b2b2b51e9ad97a74e 2026-03-25 17:33:20,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:33:20,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1794b2b2b51e9ad97a74e HTTP/1.1" 200 None 2026-03-25 17:33:20,258 - lava_callback - DEBUG - Processing node 69c1794b2b2b51e9ad97a74e: baseline-arm64-clabbe 2026-03-25 17:33:20,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1794b2b2b51e9ad97a74e 2026-03-25 17:33:20,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:33:20,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1794b2b2b51e9ad97a74e HTTP/1.1" 200 None 2026-03-25 17:33:20,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:33:20,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 17:33:20,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:33:20,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1794b2b2b51e9ad97a74e HTTP/1.1" 200 None 2026-03-25 17:33:20,310 - lava_callback - ERROR - Error processing callback for node 69c1794b2b2b51e9ad97a74e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:34:22,786 - lava_callback - INFO - Received callback for node 69c41c90944faaf0e7f61252 INFO: 172.21.0.1:43756 - "POST /node/69c41c90944faaf0e7f61252 HTTP/1.0" 202 Accepted 2026-03-25 17:34:22,792 - lava_callback - INFO - Starting async job submit for node 69c41c90944faaf0e7f61252 2026-03-25 17:34:22,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:34:22,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41c90944faaf0e7f61252 HTTP/1.1" 200 None 2026-03-25 17:34:22,810 - lava_callback - DEBUG - Processing node 69c41c90944faaf0e7f61252: baseline-arm 2026-03-25 17:34:22,815 - lava_callback - WARNING - Failed to upload log 2026-03-25 17:34:22,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:34:22,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:34:22,960 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c41c90944faaf0e7f61252/lava-logs.yaml 2026-03-25 17:34:22,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:34:23,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:34:23,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c41c90944faaf0e7f61252/lava_callback.json.gz 2026-03-25 17:34:23,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:34:23,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41c90944faaf0e7f61252 HTTP/1.1" 200 None 2026-03-25 17:34:23,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:34:23,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 17:34:23,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:34:23,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41c90944faaf0e7f61252 HTTP/1.1" 200 None 2026-03-25 17:34:23,187 - lava_callback - INFO - Completed processing callback for node 69c41c90944faaf0e7f61252 INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40636 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:34:42,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:34:42,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44622 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:35:20,293 - lava_callback - INFO - Received callback for node 69c179cd2b2b51e9ad97a78c INFO: 172.21.0.1:45636 - "POST /node/69c179cd2b2b51e9ad97a78c HTTP/1.0" 202 Accepted 2026-03-25 17:35:20,298 - lava_callback - INFO - Starting async job submit for node 69c179cd2b2b51e9ad97a78c 2026-03-25 17:35:20,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:35:20,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c179cd2b2b51e9ad97a78c HTTP/1.1" 200 None 2026-03-25 17:35:20,332 - lava_callback - DEBUG - Processing node 69c179cd2b2b51e9ad97a78c: baseline-arm64-clabbe 2026-03-25 17:35:20,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c179cd2b2b51e9ad97a78c 2026-03-25 17:35:20,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:35:20,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c179cd2b2b51e9ad97a78c HTTP/1.1" 200 None 2026-03-25 17:35:20,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:35:20,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 17:35:20,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:35:20,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c179cd2b2b51e9ad97a78c HTTP/1.1" 200 None 2026-03-25 17:35:20,384 - lava_callback - ERROR - Error processing callback for node 69c179cd2b2b51e9ad97a78c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54722 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 17:36:16,481 - lava_callback - INFO - Received callback for node 69c419ab944faaf0e7f611bd INFO: 172.21.0.1:54732 - "POST /node/69c419ab944faaf0e7f611bd HTTP/1.0" 202 Accepted 2026-03-25 17:36:16,488 - lava_callback - INFO - Starting async job submit for node 69c419ab944faaf0e7f611bd 2026-03-25 17:36:16,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:54742 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:36:16,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c419ab944faaf0e7f611bd HTTP/1.1" 200 None 2026-03-25 17:36:16,561 - lava_callback - DEBUG - Processing node 69c419ab944faaf0e7f611bd: baseline-nfs-arm64 2026-03-25 17:36:17,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:36:17,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:36:17,526 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c419ab944faaf0e7f611bd/log.txt.gz 2026-03-25 17:36:17,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:36:18,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:36:18,237 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c419ab944faaf0e7f611bd/lava-logs.yaml 2026-03-25 17:36:18,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:36:18,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:36:18,428 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c419ab944faaf0e7f611bd/lava_callback.json.gz DEBUG: Setup failed for 69c419ab944faaf0e7f611bd. Transitting job node result: incomplete -> fail 2026-03-25 17:36:18,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:18,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c419ab944faaf0e7f611bd HTTP/1.1" 200 None 2026-03-25 17:36:18,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:18,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:36:18,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:18,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c419ab944faaf0e7f611bd HTTP/1.1" 200 None 2026-03-25 17:36:18,725 - lava_callback - INFO - Completed processing callback for node 69c419ab944faaf0e7f611bd INFO: 172.21.0.1:38952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36648 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:36:40,379 - lava_callback - INFO - Received callback for node 69c17a242b2b51e9ad97a7bf INFO: 172.21.0.1:43080 - "POST /node/69c17a242b2b51e9ad97a7bf HTTP/1.0" 202 Accepted 2026-03-25 17:36:40,385 - lava_callback - INFO - Starting async job submit for node 69c17a242b2b51e9ad97a7bf 2026-03-25 17:36:40,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:40,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17a242b2b51e9ad97a7bf HTTP/1.1" 200 None 2026-03-25 17:36:40,401 - lava_callback - DEBUG - Processing node 69c17a242b2b51e9ad97a7bf: baseline-arm64-clabbe 2026-03-25 17:36:40,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17a242b2b51e9ad97a7bf 2026-03-25 17:36:40,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:40,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17a242b2b51e9ad97a7bf HTTP/1.1" 200 None 2026-03-25 17:36:40,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:40,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 17:36:40,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:40,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17a242b2b51e9ad97a7bf HTTP/1.1" 200 None 2026-03-25 17:36:40,455 - lava_callback - ERROR - Error processing callback for node 69c17a242b2b51e9ad97a7bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:36:42,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:42,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43100 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:36:49,476 - lava_callback - INFO - Received callback for node 69c41ce4944faaf0e7f6126c INFO: 172.21.0.1:43110 - "POST /node/69c41ce4944faaf0e7f6126c HTTP/1.0" 202 Accepted 2026-03-25 17:36:49,483 - lava_callback - INFO - Starting async job submit for node 69c41ce4944faaf0e7f6126c 2026-03-25 17:36:49,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:49,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41ce4944faaf0e7f6126c HTTP/1.1" 200 None 2026-03-25 17:36:49,527 - lava_callback - DEBUG - Processing node 69c41ce4944faaf0e7f6126c: baseline-arm64 2026-03-25 17:36:49,722 - lava_callback - WARNING - Failed to upload log 2026-03-25 17:36:49,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:36:49,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:36:50,000 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41ce4944faaf0e7f6126c/lava-logs.yaml 2026-03-25 17:36:50,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:36:50,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:36:50,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41ce4944faaf0e7f6126c/lava_callback.json.gz 2026-03-25 17:36:50,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:50,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41ce4944faaf0e7f6126c HTTP/1.1" 200 None 2026-03-25 17:36:50,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:50,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:36:50,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:50,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41ce4944faaf0e7f6126c HTTP/1.1" 200 None 2026-03-25 17:36:50,312 - lava_callback - INFO - Completed processing callback for node 69c41ce4944faaf0e7f6126c INFO: 172.21.0.1:33444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41914 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:37:12,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:12,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:37:24,859 - lava_callback - INFO - Received callback for node 69c419f9944faaf0e7f611c9 INFO: 172.21.0.1:44044 - "POST /node/69c419f9944faaf0e7f611c9 HTTP/1.0" 202 Accepted 2026-03-25 17:37:24,867 - lava_callback - INFO - Starting async job submit for node 69c419f9944faaf0e7f611c9 2026-03-25 17:37:24,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:24,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c419f9944faaf0e7f611c9 HTTP/1.1" 200 None 2026-03-25 17:37:24,930 - lava_callback - DEBUG - Processing node 69c419f9944faaf0e7f611c9: baseline-arm64 2026-03-25 17:37:25,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:37:25,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:37:25,788 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c419f9944faaf0e7f611c9/log.txt.gz 2026-03-25 17:37:26,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:37:26,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:37:26,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c419f9944faaf0e7f611c9/lava-logs.yaml 2026-03-25 17:37:26,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44060 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:37:26,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:37:26,644 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c419f9944faaf0e7f611c9/lava_callback.json.gz DEBUG: Setup failed for 69c419f9944faaf0e7f611c9. Transitting job node result: incomplete -> fail 2026-03-25 17:37:26,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:26,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c419f9944faaf0e7f611c9 HTTP/1.1" 200 None 2026-03-25 17:37:26,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:26,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:37:26,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:26,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c419f9944faaf0e7f611c9 HTTP/1.1" 200 None 2026-03-25 17:37:26,939 - lava_callback - INFO - Completed processing callback for node 69c419f9944faaf0e7f611c9 2026-03-25 17:37:28,590 - lava_callback - INFO - Received callback for node 69c4199d944faaf0e7f611b8 INFO: 172.21.0.1:44062 - "POST /node/69c4199d944faaf0e7f611b8 HTTP/1.0" 202 Accepted 2026-03-25 17:37:28,597 - lava_callback - INFO - Starting async job submit for node 69c4199d944faaf0e7f611b8 2026-03-25 17:37:28,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:28,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4199d944faaf0e7f611b8 HTTP/1.1" 200 None 2026-03-25 17:37:28,661 - lava_callback - DEBUG - Processing node 69c4199d944faaf0e7f611b8: baseline-x86 2026-03-25 17:37:29,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:37:29,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:37:29,563 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c4199d944faaf0e7f611b8/log.txt.gz 2026-03-25 17:37:30,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:37:30,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:37:30,262 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c4199d944faaf0e7f611b8/lava-logs.yaml 2026-03-25 17:37:30,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:37:30,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:37:30,451 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c4199d944faaf0e7f611b8/lava_callback.json.gz DEBUG: Setup failed for 69c4199d944faaf0e7f611b8. Transitting job node result: incomplete -> fail 2026-03-25 17:37:30,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:30,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4199d944faaf0e7f611b8 HTTP/1.1" 200 None 2026-03-25 17:37:30,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:30,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40aef944faaf0e7f5e438 HTTP/1.1" 200 None 2026-03-25 17:37:30,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:30,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4199d944faaf0e7f611b8 HTTP/1.1" 200 None 2026-03-25 17:37:30,701 - lava_callback - INFO - Completed processing callback for node 69c4199d944faaf0e7f611b8 INFO: 172.21.0.1:56162 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:37:42,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:42,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43252 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:43:26,615 - lava_callback - INFO - Received callback for node 69c41eb9944faaf0e7f612ca INFO: 172.21.0.1:43262 - "POST /node/69c41eb9944faaf0e7f612ca HTTP/1.0" 202 Accepted 2026-03-25 17:43:26,621 - lava_callback - INFO - Starting async job submit for node 69c41eb9944faaf0e7f612ca 2026-03-25 17:43:26,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:26,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41eb9944faaf0e7f612ca HTTP/1.1" 200 None 2026-03-25 17:43:26,638 - lava_callback - DEBUG - Processing node 69c41eb9944faaf0e7f612ca: baseline-nfs-arm64 2026-03-25 17:43:26,640 - lava_callback - WARNING - Failed to upload log 2026-03-25 17:43:26,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:43:26,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:43:26,799 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41eb9944faaf0e7f612ca/lava-logs.yaml 2026-03-25 17:43:26,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:43:26,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:43:26,954 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41eb9944faaf0e7f612ca/lava_callback.json.gz 2026-03-25 17:43:26,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:26,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41eb9944faaf0e7f612ca HTTP/1.1" 200 None 2026-03-25 17:43:26,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:26,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:43:26,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:27,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41eb9944faaf0e7f612ca HTTP/1.1" 200 None 2026-03-25 17:43:27,029 - lava_callback - INFO - Completed processing callback for node 69c41eb9944faaf0e7f612ca INFO: 172.21.0.1:44844 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:43:42,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:42,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 17:43:44,429 - lava_callback - INFO - Received callback for node 69c411ac944faaf0e7f60e4e INFO: 172.21.0.1:44660 - "POST /node/69c411ac944faaf0e7f60e4e HTTP/1.0" 202 Accepted 2026-03-25 17:43:44,435 - lava_callback - INFO - Starting async job submit for node 69c411ac944faaf0e7f60e4e 2026-03-25 17:43:44,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:44,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411ac944faaf0e7f60e4e HTTP/1.1" 200 None 2026-03-25 17:43:44,480 - lava_callback - DEBUG - Processing node 69c411ac944faaf0e7f60e4e: baseline-arm64-broonie 2026-03-25 17:43:44,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:43:44,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:43:44,845 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411ac944faaf0e7f60e4e/log.txt.gz 2026-03-25 17:43:44,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:43:45,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:43:45,202 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411ac944faaf0e7f60e4e/lava-logs.yaml 2026-03-25 17:43:45,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:43:45,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:43:45,386 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411ac944faaf0e7f60e4e/lava_callback.json.gz 2026-03-25 17:43:45,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:45,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411ac944faaf0e7f60e4e HTTP/1.1" 200 None 2026-03-25 17:43:45,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:45,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:43:45,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:45,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411ac944faaf0e7f60e4e HTTP/1.1" 200 None 2026-03-25 17:43:45,477 - lava_callback - INFO - Completed processing callback for node 69c411ac944faaf0e7f60e4e INFO: 172.21.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47368 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:44:12,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:44:12,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:48:07,011 - lava_callback - INFO - Received callback for node 69c17cc92b2b51e9ad97a815 INFO: 172.21.0.1:40046 - "POST /node/69c17cc92b2b51e9ad97a815 HTTP/1.0" 202 Accepted 2026-03-25 17:48:07,017 - lava_callback - INFO - Starting async job submit for node 69c17cc92b2b51e9ad97a815 2026-03-25 17:48:07,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:48:07,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17cc92b2b51e9ad97a815 HTTP/1.1" 200 None 2026-03-25 17:48:07,033 - lava_callback - DEBUG - Processing node 69c17cc92b2b51e9ad97a815: baseline-arm-baylibre 2026-03-25 17:48:07,033 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17cc92b2b51e9ad97a815 2026-03-25 17:48:07,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:48:07,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17cc92b2b51e9ad97a815 HTTP/1.1" 200 None 2026-03-25 17:48:07,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:48:07,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:48:07,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:48:07,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17cc92b2b51e9ad97a815 HTTP/1.1" 200 None 2026-03-25 17:48:07,122 - lava_callback - ERROR - Error processing callback for node 69c17cc92b2b51e9ad97a815: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44238 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:48:47,015 - lava_callback - INFO - Received callback for node 69c17cf22b2b51e9ad97a822 INFO: 172.21.0.1:44244 - "POST /node/69c17cf22b2b51e9ad97a822 HTTP/1.0" 202 Accepted 2026-03-25 17:48:47,021 - lava_callback - INFO - Starting async job submit for node 69c17cf22b2b51e9ad97a822 2026-03-25 17:48:47,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:48:47,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17cf22b2b51e9ad97a822 HTTP/1.1" 200 None 2026-03-25 17:48:47,038 - lava_callback - DEBUG - Processing node 69c17cf22b2b51e9ad97a822: baseline-arm-baylibre 2026-03-25 17:48:47,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17cf22b2b51e9ad97a822 2026-03-25 17:48:47,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:48:47,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17cf22b2b51e9ad97a822 HTTP/1.1" 200 None 2026-03-25 17:48:47,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:48:47,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:48:47,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:48:47,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17cf22b2b51e9ad97a822 HTTP/1.1" 200 None 2026-03-25 17:48:47,099 - lava_callback - ERROR - Error processing callback for node 69c17cf22b2b51e9ad97a822: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51866 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:49:27,086 - lava_callback - INFO - Received callback for node 69c17d1a2b2b51e9ad97a831 INFO: 172.21.0.1:51872 - "POST /node/69c17d1a2b2b51e9ad97a831 HTTP/1.0" 202 Accepted 2026-03-25 17:49:27,092 - lava_callback - INFO - Starting async job submit for node 69c17d1a2b2b51e9ad97a831 2026-03-25 17:49:27,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:49:27,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17d1a2b2b51e9ad97a831 HTTP/1.1" 200 None 2026-03-25 17:49:27,108 - lava_callback - DEBUG - Processing node 69c17d1a2b2b51e9ad97a831: baseline-arm-baylibre 2026-03-25 17:49:27,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17d1a2b2b51e9ad97a831 2026-03-25 17:49:27,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:49:27,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17d1a2b2b51e9ad97a831 HTTP/1.1" 200 None 2026-03-25 17:49:27,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:49:27,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:49:27,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:49:27,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17d1a2b2b51e9ad97a831 HTTP/1.1" 200 None 2026-03-25 17:49:27,175 - lava_callback - ERROR - Error processing callback for node 69c17d1a2b2b51e9ad97a831: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:49:50,897 - lava_callback - INFO - Received callback for node 69c4117a944faaf0e7f60d9f INFO: 172.21.0.1:50800 - "POST /node/69c4117a944faaf0e7f60d9f HTTP/1.0" 202 Accepted 2026-03-25 17:49:50,903 - lava_callback - INFO - Starting async job submit for node 69c4117a944faaf0e7f60d9f 2026-03-25 17:49:50,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:49:50,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117a944faaf0e7f60d9f HTTP/1.1" 200 None 2026-03-25 17:49:50,969 - lava_callback - DEBUG - Processing node 69c4117a944faaf0e7f60d9f: baseline-arm64 2026-03-25 17:49:51,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:49:51,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:49:51,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117a944faaf0e7f60d9f/log.txt.gz 2026-03-25 17:49:51,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:49:51,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:49:51,913 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117a944faaf0e7f60d9f/lava-logs.yaml 2026-03-25 17:49:51,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:49:52,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:49:52,069 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117a944faaf0e7f60d9f/lava_callback.json.gz 2026-03-25 17:49:52,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:49:52,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117a944faaf0e7f60d9f HTTP/1.1" 200 None 2026-03-25 17:49:52,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:49:52,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:49:52,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:49:52,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4117a944faaf0e7f60d9f HTTP/1.1" 200 None 2026-03-25 17:49:52,158 - lava_callback - INFO - Completed processing callback for node 69c4117a944faaf0e7f60d9f INFO: 172.21.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33374 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:50:07,055 - lava_callback - INFO - Received callback for node 69c17d422b2b51e9ad97a83d INFO: 172.21.0.1:33378 - "POST /node/69c17d422b2b51e9ad97a83d HTTP/1.0" 202 Accepted 2026-03-25 17:50:07,061 - lava_callback - INFO - Starting async job submit for node 69c17d422b2b51e9ad97a83d 2026-03-25 17:50:07,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:07,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17d422b2b51e9ad97a83d HTTP/1.1" 200 None 2026-03-25 17:50:07,077 - lava_callback - DEBUG - Processing node 69c17d422b2b51e9ad97a83d: baseline-arm-baylibre 2026-03-25 17:50:07,077 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17d422b2b51e9ad97a83d 2026-03-25 17:50:07,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:07,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17d422b2b51e9ad97a83d HTTP/1.1" 200 None 2026-03-25 17:50:07,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:07,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:50:07,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:07,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17d422b2b51e9ad97a83d HTTP/1.1" 200 None 2026-03-25 17:50:07,144 - lava_callback - ERROR - Error processing callback for node 69c17d422b2b51e9ad97a83d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:50:12,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:12,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:50:40,872 - lava_callback - INFO - Received callback for node 69c17d6e2b2b51e9ad97a849 INFO: 172.21.0.1:55282 - "POST /node/69c17d6e2b2b51e9ad97a849 HTTP/1.0" 202 Accepted 2026-03-25 17:50:40,878 - lava_callback - INFO - Starting async job submit for node 69c17d6e2b2b51e9ad97a849 2026-03-25 17:50:40,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:40,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17d6e2b2b51e9ad97a849 HTTP/1.1" 200 None 2026-03-25 17:50:40,894 - lava_callback - DEBUG - Processing node 69c17d6e2b2b51e9ad97a849: baseline-arm-clabbe 2026-03-25 17:50:40,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17d6e2b2b51e9ad97a849 2026-03-25 17:50:40,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:40,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17d6e2b2b51e9ad97a849 HTTP/1.1" 200 None 2026-03-25 17:50:40,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:40,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:50:40,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:40,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17d6e2b2b51e9ad97a849 HTTP/1.1" 200 None 2026-03-25 17:50:40,961 - lava_callback - ERROR - Error processing callback for node 69c17d6e2b2b51e9ad97a849: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38690 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:51:27,334 - lava_callback - INFO - Received callback for node 69c17d942b2b51e9ad97a857 INFO: 172.21.0.1:38704 - "POST /node/69c17d942b2b51e9ad97a857 HTTP/1.0" 202 Accepted 2026-03-25 17:51:27,339 - lava_callback - INFO - Starting async job submit for node 69c17d942b2b51e9ad97a857 2026-03-25 17:51:27,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:51:27,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17d942b2b51e9ad97a857 HTTP/1.1" 200 None 2026-03-25 17:51:27,355 - lava_callback - DEBUG - Processing node 69c17d942b2b51e9ad97a857: baseline-arm-baylibre 2026-03-25 17:51:27,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17d942b2b51e9ad97a857 2026-03-25 17:51:27,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:51:27,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17d942b2b51e9ad97a857 HTTP/1.1" 200 None 2026-03-25 17:51:27,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:51:27,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:51:27,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:51:27,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17d942b2b51e9ad97a857 HTTP/1.1" 200 None 2026-03-25 17:51:27,420 - lava_callback - ERROR - Error processing callback for node 69c17d942b2b51e9ad97a857: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:52:20,851 - lava_callback - INFO - Received callback for node 69c17dbf2b2b51e9ad97a861 INFO: 172.21.0.1:55990 - "POST /node/69c17dbf2b2b51e9ad97a861 HTTP/1.0" 202 Accepted 2026-03-25 17:52:20,856 - lava_callback - INFO - Starting async job submit for node 69c17dbf2b2b51e9ad97a861 2026-03-25 17:52:20,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:52:20,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17dbf2b2b51e9ad97a861 HTTP/1.1" 200 None 2026-03-25 17:52:20,872 - lava_callback - DEBUG - Processing node 69c17dbf2b2b51e9ad97a861: baseline-arm-clabbe 2026-03-25 17:52:20,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17dbf2b2b51e9ad97a861 2026-03-25 17:52:20,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:52:20,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17dbf2b2b51e9ad97a861 HTTP/1.1" 200 None 2026-03-25 17:52:20,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:52:20,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:52:20,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:52:20,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17dbf2b2b51e9ad97a861 HTTP/1.1" 200 None 2026-03-25 17:52:20,949 - lava_callback - ERROR - Error processing callback for node 69c17dbf2b2b51e9ad97a861: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39770 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:52:47,263 - lava_callback - INFO - Received callback for node 69c17de62b2b51e9ad97a871 INFO: 172.21.0.1:39782 - "POST /node/69c17de62b2b51e9ad97a871 HTTP/1.0" 202 Accepted 2026-03-25 17:52:47,268 - lava_callback - INFO - Starting async job submit for node 69c17de62b2b51e9ad97a871 2026-03-25 17:52:47,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:52:47,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17de62b2b51e9ad97a871 HTTP/1.1" 200 None 2026-03-25 17:52:47,286 - lava_callback - DEBUG - Processing node 69c17de62b2b51e9ad97a871: baseline-arm-baylibre 2026-03-25 17:52:47,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17de62b2b51e9ad97a871 2026-03-25 17:52:47,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:52:47,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17de62b2b51e9ad97a871 HTTP/1.1" 200 None 2026-03-25 17:52:47,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:52:47,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:52:47,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:52:47,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17de62b2b51e9ad97a871 HTTP/1.1" 200 None 2026-03-25 17:52:47,346 - lava_callback - ERROR - Error processing callback for node 69c17de62b2b51e9ad97a871: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50156 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:53:26,895 - lava_callback - INFO - Received callback for node 69c4118b944faaf0e7f60ddd INFO: 172.21.0.1:50166 - "POST /node/69c4118b944faaf0e7f60ddd HTTP/1.0" 202 Accepted 2026-03-25 17:53:26,901 - lava_callback - INFO - Starting async job submit for node 69c4118b944faaf0e7f60ddd 2026-03-25 17:53:26,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:26,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4118b944faaf0e7f60ddd HTTP/1.1" 200 None 2026-03-25 17:53:26,934 - lava_callback - DEBUG - Processing node 69c4118b944faaf0e7f60ddd: baseline-nfs-arm64 2026-03-25 17:53:27,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:53:27,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:53:27,484 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118b944faaf0e7f60ddd/log.txt.gz 2026-03-25 17:53:27,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:53:27,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:53:27,971 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118b944faaf0e7f60ddd/lava-logs.yaml 2026-03-25 17:53:27,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:53:28,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:53:28,163 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118b944faaf0e7f60ddd/lava_callback.json.gz 2026-03-25 17:53:28,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:28,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4118b944faaf0e7f60ddd HTTP/1.1" 200 None 2026-03-25 17:53:28,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:28,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:53:28,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:28,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4118b944faaf0e7f60ddd HTTP/1.1" 200 None 2026-03-25 17:53:28,246 - lava_callback - INFO - Completed processing callback for node 69c4118b944faaf0e7f60ddd 2026-03-25 17:53:30,752 - lava_callback - INFO - Received callback for node 69c41f5f944faaf0e7f612e6 INFO: 172.21.0.1:53258 - "POST /node/69c41f5f944faaf0e7f612e6 HTTP/1.0" 202 Accepted 2026-03-25 17:53:30,759 - lava_callback - INFO - Starting async job submit for node 69c41f5f944faaf0e7f612e6 2026-03-25 17:53:30,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:30,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41f5f944faaf0e7f612e6 HTTP/1.1" 200 None 2026-03-25 17:53:30,818 - lava_callback - DEBUG - Processing node 69c41f5f944faaf0e7f612e6: baseline-arm64 2026-03-25 17:53:31,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:53:31,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:53:31,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41f5f944faaf0e7f612e6/log.txt.gz 2026-03-25 17:53:31,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:53:31,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:53:31,722 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41f5f944faaf0e7f612e6/lava-logs.yaml 2026-03-25 17:53:31,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:53:31,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:53:31,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41f5f944faaf0e7f612e6/lava_callback.json.gz DEBUG: Setup failed for 69c41f5f944faaf0e7f612e6. Transitting job node result: incomplete -> fail 2026-03-25 17:53:32,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:32,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41f5f944faaf0e7f612e6 HTTP/1.1" 200 None 2026-03-25 17:53:32,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:32,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:53:32,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:32,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41f5f944faaf0e7f612e6 HTTP/1.1" 200 None 2026-03-25 17:53:32,142 - lava_callback - INFO - Completed processing callback for node 69c41f5f944faaf0e7f612e6 INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:53:40,921 - lava_callback - INFO - Received callback for node 69c17e142b2b51e9ad97a87f INFO: 172.21.0.1:56704 - "POST /node/69c17e142b2b51e9ad97a87f HTTP/1.0" 202 Accepted 2026-03-25 17:53:40,926 - lava_callback - INFO - Starting async job submit for node 69c17e142b2b51e9ad97a87f 2026-03-25 17:53:40,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:40,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e142b2b51e9ad97a87f HTTP/1.1" 200 None 2026-03-25 17:53:40,942 - lava_callback - DEBUG - Processing node 69c17e142b2b51e9ad97a87f: baseline-arm-clabbe 2026-03-25 17:53:40,942 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17e142b2b51e9ad97a87f 2026-03-25 17:53:40,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:40,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e142b2b51e9ad97a87f HTTP/1.1" 200 None 2026-03-25 17:53:40,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:40,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:53:40,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:40,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e142b2b51e9ad97a87f HTTP/1.1" 200 None 2026-03-25 17:53:40,993 - lava_callback - ERROR - Error processing callback for node 69c17e142b2b51e9ad97a87f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:53:42,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:42,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36092 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:54:20,898 - lava_callback - INFO - Received callback for node 69c17e3c2b2b51e9ad97a88a INFO: 172.21.0.1:55220 - "POST /node/69c17e3c2b2b51e9ad97a88a HTTP/1.0" 202 Accepted 2026-03-25 17:54:20,904 - lava_callback - INFO - Starting async job submit for node 69c17e3c2b2b51e9ad97a88a 2026-03-25 17:54:20,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:54:20,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e3c2b2b51e9ad97a88a HTTP/1.1" 200 None 2026-03-25 17:54:20,928 - lava_callback - DEBUG - Processing node 69c17e3c2b2b51e9ad97a88a: baseline-arm-clabbe 2026-03-25 17:54:20,928 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17e3c2b2b51e9ad97a88a 2026-03-25 17:54:20,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:54:20,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e3c2b2b51e9ad97a88a HTTP/1.1" 200 None 2026-03-25 17:54:20,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:54:20,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:54:20,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:54:20,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e3c2b2b51e9ad97a88a HTTP/1.1" 200 None 2026-03-25 17:54:20,982 - lava_callback - ERROR - Error processing callback for node 69c17e3c2b2b51e9ad97a88a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:55:20,976 - lava_callback - INFO - Received callback for node 69c17e7b2b2b51e9ad97a898 INFO: 172.21.0.1:57312 - "POST /node/69c17e7b2b2b51e9ad97a898 HTTP/1.0" 202 Accepted 2026-03-25 17:55:20,981 - lava_callback - INFO - Starting async job submit for node 69c17e7b2b2b51e9ad97a898 2026-03-25 17:55:20,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:55:21,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e7b2b2b51e9ad97a898 HTTP/1.1" 200 None 2026-03-25 17:55:21,012 - lava_callback - DEBUG - Processing node 69c17e7b2b2b51e9ad97a898: baseline-arm-clabbe 2026-03-25 17:55:21,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17e7b2b2b51e9ad97a898 2026-03-25 17:55:21,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:55:21,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e7b2b2b51e9ad97a898 HTTP/1.1" 200 None 2026-03-25 17:55:21,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:55:21,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:55:21,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:55:21,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e7b2b2b51e9ad97a898 HTTP/1.1" 200 None 2026-03-25 17:55:21,066 - lava_callback - ERROR - Error processing callback for node 69c17e7b2b2b51e9ad97a898: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39524 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:56:07,418 - lava_callback - INFO - Received callback for node 69c17eb52b2b51e9ad97a921 INFO: 172.21.0.1:39540 - "POST /node/69c17eb52b2b51e9ad97a921 HTTP/1.0" 202 Accepted 2026-03-25 17:56:07,424 - lava_callback - INFO - Starting async job submit for node 69c17eb52b2b51e9ad97a921 2026-03-25 17:56:07,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:07,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb52b2b51e9ad97a921 HTTP/1.1" 200 None 2026-03-25 17:56:07,445 - lava_callback - DEBUG - Processing node 69c17eb52b2b51e9ad97a921: baseline-arm64-baylibre 2026-03-25 17:56:07,445 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17eb52b2b51e9ad97a921 2026-03-25 17:56:07,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:07,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb52b2b51e9ad97a921 HTTP/1.1" 200 None 2026-03-25 17:56:07,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:07,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:07,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:07,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eb52b2b51e9ad97a921 HTTP/1.1" 200 None 2026-03-25 17:56:07,503 - lava_callback - ERROR - Error processing callback for node 69c17eb52b2b51e9ad97a921: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35198 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:56:27,393 - lava_callback - INFO - Received callback for node 69c17eb72b2b51e9ad97a924 INFO: 172.21.0.1:35206 - "POST /node/69c17eb72b2b51e9ad97a924 HTTP/1.0" 202 Accepted 2026-03-25 17:56:27,399 - lava_callback - INFO - Starting async job submit for node 69c17eb72b2b51e9ad97a924 2026-03-25 17:56:27,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:27,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb72b2b51e9ad97a924 HTTP/1.1" 200 None 2026-03-25 17:56:27,442 - lava_callback - DEBUG - Processing node 69c17eb72b2b51e9ad97a924: baseline-arm64-baylibre 2026-03-25 17:56:27,442 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17eb72b2b51e9ad97a924 2026-03-25 17:56:27,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:27,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb72b2b51e9ad97a924 HTTP/1.1" 200 None 2026-03-25 17:56:27,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:27,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:27,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:27,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eb72b2b51e9ad97a924 HTTP/1.1" 200 None 2026-03-25 17:56:27,520 - lava_callback - ERROR - Error processing callback for node 69c17eb72b2b51e9ad97a924: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:28,066 - lava_callback - INFO - Received callback for node 69c17eb82b2b51e9ad97a927 INFO: 172.21.0.1:35212 - "POST /node/69c17eb82b2b51e9ad97a927 HTTP/1.0" 202 Accepted 2026-03-25 17:56:28,075 - lava_callback - INFO - Starting async job submit for node 69c17eb82b2b51e9ad97a927 2026-03-25 17:56:28,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:28,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb82b2b51e9ad97a927 HTTP/1.1" 200 None 2026-03-25 17:56:28,098 - lava_callback - DEBUG - Processing node 69c17eb82b2b51e9ad97a927: baseline-arm64-baylibre 2026-03-25 17:56:28,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17eb82b2b51e9ad97a927 2026-03-25 17:56:28,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:28,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb82b2b51e9ad97a927 HTTP/1.1" 200 None 2026-03-25 17:56:28,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:28,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:28,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:28,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eb82b2b51e9ad97a927 HTTP/1.1" 200 None 2026-03-25 17:56:28,187 - lava_callback - ERROR - Error processing callback for node 69c17eb82b2b51e9ad97a927: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:28,732 - lava_callback - INFO - Received callback for node 69c17eba2b2b51e9ad97a932 INFO: 172.21.0.1:35216 - "POST /node/69c17eba2b2b51e9ad97a932 HTTP/1.0" 202 Accepted 2026-03-25 17:56:28,737 - lava_callback - INFO - Starting async job submit for node 69c17eba2b2b51e9ad97a932 2026-03-25 17:56:28,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:28,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eba2b2b51e9ad97a932 HTTP/1.1" 200 None 2026-03-25 17:56:28,753 - lava_callback - DEBUG - Processing node 69c17eba2b2b51e9ad97a932: baseline-arm64-baylibre 2026-03-25 17:56:28,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17eba2b2b51e9ad97a932 2026-03-25 17:56:28,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:28,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eba2b2b51e9ad97a932 HTTP/1.1" 200 None 2026-03-25 17:56:28,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:28,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:28,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:28,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eba2b2b51e9ad97a932 HTTP/1.1" 200 None 2026-03-25 17:56:28,806 - lava_callback - ERROR - Error processing callback for node 69c17eba2b2b51e9ad97a932: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:29,375 - lava_callback - INFO - Received callback for node 69c17ebc2b2b51e9ad97a935 INFO: 172.21.0.1:35224 - "POST /node/69c17ebc2b2b51e9ad97a935 HTTP/1.0" 202 Accepted 2026-03-25 17:56:29,381 - lava_callback - INFO - Starting async job submit for node 69c17ebc2b2b51e9ad97a935 2026-03-25 17:56:29,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:29,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ebc2b2b51e9ad97a935 HTTP/1.1" 200 None 2026-03-25 17:56:29,398 - lava_callback - DEBUG - Processing node 69c17ebc2b2b51e9ad97a935: baseline-arm64-baylibre 2026-03-25 17:56:29,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17ebc2b2b51e9ad97a935 2026-03-25 17:56:29,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:29,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ebc2b2b51e9ad97a935 HTTP/1.1" 200 None 2026-03-25 17:56:29,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:29,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:29,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:29,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ebc2b2b51e9ad97a935 HTTP/1.1" 200 None 2026-03-25 17:56:29,489 - lava_callback - ERROR - Error processing callback for node 69c17ebc2b2b51e9ad97a935: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:30,025 - lava_callback - INFO - Received callback for node 69c17ebe2b2b51e9ad97a950 INFO: 172.21.0.1:42524 - "POST /node/69c17ebe2b2b51e9ad97a950 HTTP/1.0" 202 Accepted 2026-03-25 17:56:30,031 - lava_callback - INFO - Starting async job submit for node 69c17ebe2b2b51e9ad97a950 2026-03-25 17:56:30,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:30,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ebe2b2b51e9ad97a950 HTTP/1.1" 200 None 2026-03-25 17:56:30,048 - lava_callback - DEBUG - Processing node 69c17ebe2b2b51e9ad97a950: baseline-arm64-baylibre 2026-03-25 17:56:30,049 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17ebe2b2b51e9ad97a950 2026-03-25 17:56:30,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:30,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ebe2b2b51e9ad97a950 HTTP/1.1" 200 None 2026-03-25 17:56:30,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:30,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:30,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:30,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ebe2b2b51e9ad97a950 HTTP/1.1" 200 None 2026-03-25 17:56:30,114 - lava_callback - ERROR - Error processing callback for node 69c17ebe2b2b51e9ad97a950: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:56:40,984 - lava_callback - INFO - Received callback for node 69c17ecf2b2b51e9ad97a97c INFO: 172.21.0.1:52172 - "POST /node/69c17ecf2b2b51e9ad97a97c HTTP/1.0" 202 Accepted 2026-03-25 17:56:40,990 - lava_callback - INFO - Starting async job submit for node 69c17ecf2b2b51e9ad97a97c 2026-03-25 17:56:40,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:41,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ecf2b2b51e9ad97a97c HTTP/1.1" 200 None 2026-03-25 17:56:41,013 - lava_callback - DEBUG - Processing node 69c17ecf2b2b51e9ad97a97c: baseline-arm64-clabbe 2026-03-25 17:56:41,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17ecf2b2b51e9ad97a97c 2026-03-25 17:56:41,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:41,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ecf2b2b51e9ad97a97c HTTP/1.1" 200 None 2026-03-25 17:56:41,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:41,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:41,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:41,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ecf2b2b51e9ad97a97c HTTP/1.1" 200 None 2026-03-25 17:56:41,090 - lava_callback - ERROR - Error processing callback for node 69c17ecf2b2b51e9ad97a97c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:41,670 - lava_callback - INFO - Received callback for node 69c17ed12b2b51e9ad97a97f INFO: 172.21.0.1:52186 - "POST /node/69c17ed12b2b51e9ad97a97f HTTP/1.0" 202 Accepted 2026-03-25 17:56:41,677 - lava_callback - INFO - Starting async job submit for node 69c17ed12b2b51e9ad97a97f 2026-03-25 17:56:41,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:41,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed12b2b51e9ad97a97f HTTP/1.1" 200 None 2026-03-25 17:56:41,724 - lava_callback - DEBUG - Processing node 69c17ed12b2b51e9ad97a97f: baseline-arm64-clabbe 2026-03-25 17:56:41,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17ed12b2b51e9ad97a97f 2026-03-25 17:56:41,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:41,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed12b2b51e9ad97a97f HTTP/1.1" 200 None 2026-03-25 17:56:41,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:41,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:41,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:41,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ed12b2b51e9ad97a97f HTTP/1.1" 200 None 2026-03-25 17:56:41,793 - lava_callback - ERROR - Error processing callback for node 69c17ed12b2b51e9ad97a97f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:42,350 - lava_callback - INFO - Received callback for node 69c17ed22b2b51e9ad97a982 INFO: 172.21.0.1:52200 - "POST /node/69c17ed22b2b51e9ad97a982 HTTP/1.0" 202 Accepted 2026-03-25 17:56:42,359 - lava_callback - INFO - Starting async job submit for node 69c17ed22b2b51e9ad97a982 2026-03-25 17:56:42,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:42,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed22b2b51e9ad97a982 HTTP/1.1" 200 None 2026-03-25 17:56:42,383 - lava_callback - DEBUG - Processing node 69c17ed22b2b51e9ad97a982: baseline-arm64-clabbe 2026-03-25 17:56:42,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17ed22b2b51e9ad97a982 2026-03-25 17:56:42,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:42,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed22b2b51e9ad97a982 HTTP/1.1" 200 None 2026-03-25 17:56:42,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:42,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:42,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:42,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ed22b2b51e9ad97a982 HTTP/1.1" 200 None 2026-03-25 17:56:42,453 - lava_callback - ERROR - Error processing callback for node 69c17ed22b2b51e9ad97a982: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:43,063 - lava_callback - INFO - Received callback for node 69c17ed22b2b51e9ad97a985 INFO: 172.21.0.1:52206 - "POST /node/69c17ed22b2b51e9ad97a985 HTTP/1.0" 202 Accepted 2026-03-25 17:56:43,070 - lava_callback - INFO - Starting async job submit for node 69c17ed22b2b51e9ad97a985 2026-03-25 17:56:43,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:43,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed22b2b51e9ad97a985 HTTP/1.1" 200 None 2026-03-25 17:56:43,088 - lava_callback - DEBUG - Processing node 69c17ed22b2b51e9ad97a985: baseline-arm64-clabbe 2026-03-25 17:56:43,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17ed22b2b51e9ad97a985 2026-03-25 17:56:43,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:43,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed22b2b51e9ad97a985 HTTP/1.1" 200 None 2026-03-25 17:56:43,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:43,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:43,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:43,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ed22b2b51e9ad97a985 HTTP/1.1" 200 None 2026-03-25 17:56:43,195 - lava_callback - ERROR - Error processing callback for node 69c17ed22b2b51e9ad97a985: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:43,713 - lava_callback - INFO - Received callback for node 69c17ed42b2b51e9ad97a98b INFO: 172.21.0.1:52210 - "POST /node/69c17ed42b2b51e9ad97a98b HTTP/1.0" 202 Accepted 2026-03-25 17:56:43,719 - lava_callback - INFO - Starting async job submit for node 69c17ed42b2b51e9ad97a98b 2026-03-25 17:56:43,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:43,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed42b2b51e9ad97a98b HTTP/1.1" 200 None 2026-03-25 17:56:43,745 - lava_callback - DEBUG - Processing node 69c17ed42b2b51e9ad97a98b: baseline-arm64-clabbe 2026-03-25 17:56:43,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17ed42b2b51e9ad97a98b 2026-03-25 17:56:43,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:43,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed42b2b51e9ad97a98b HTTP/1.1" 200 None 2026-03-25 17:56:43,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:43,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:43,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:43,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ed42b2b51e9ad97a98b HTTP/1.1" 200 None 2026-03-25 17:56:43,815 - lava_callback - ERROR - Error processing callback for node 69c17ed42b2b51e9ad97a98b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:44,407 - lava_callback - INFO - Received callback for node 69c17ed52b2b51e9ad97a98f INFO: 172.21.0.1:52220 - "POST /node/69c17ed52b2b51e9ad97a98f HTTP/1.0" 202 Accepted 2026-03-25 17:56:44,414 - lava_callback - INFO - Starting async job submit for node 69c17ed52b2b51e9ad97a98f 2026-03-25 17:56:44,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:44,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed52b2b51e9ad97a98f HTTP/1.1" 200 None 2026-03-25 17:56:44,433 - lava_callback - DEBUG - Processing node 69c17ed52b2b51e9ad97a98f: baseline-arm64-clabbe 2026-03-25 17:56:44,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17ed52b2b51e9ad97a98f 2026-03-25 17:56:44,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:44,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed52b2b51e9ad97a98f HTTP/1.1" 200 None 2026-03-25 17:56:44,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:44,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:44,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:44,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ed52b2b51e9ad97a98f HTTP/1.1" 200 None 2026-03-25 17:56:44,487 - lava_callback - ERROR - Error processing callback for node 69c17ed52b2b51e9ad97a98f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32890 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:59:27,643 - lava_callback - INFO - Received callback for node 69c4224c944faaf0e7f613a7 INFO: 172.21.0.1:32894 - "POST /node/69c4224c944faaf0e7f613a7 HTTP/1.0" 202 Accepted 2026-03-25 17:59:27,650 - lava_callback - INFO - Starting async job submit for node 69c4224c944faaf0e7f613a7 2026-03-25 17:59:27,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:59:27,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4224c944faaf0e7f613a7 HTTP/1.1" 200 None 2026-03-25 17:59:27,696 - lava_callback - DEBUG - Processing node 69c4224c944faaf0e7f613a7: baseline-arm64 2026-03-25 17:59:27,859 - lava_callback - WARNING - Failed to upload log 2026-03-25 17:59:27,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:59:28,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:59:28,127 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4224c944faaf0e7f613a7/lava-logs.yaml 2026-03-25 17:59:28,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:59:28,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:59:28,264 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4224c944faaf0e7f613a7/lava_callback.json.gz 2026-03-25 17:59:28,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:59:28,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4224c944faaf0e7f613a7 HTTP/1.1" 200 None 2026-03-25 17:59:28,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:59:28,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:59:28,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:59:28,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4224c944faaf0e7f613a7 HTTP/1.1" 200 None 2026-03-25 17:59:28,445 - lava_callback - INFO - Completed processing callback for node 69c4224c944faaf0e7f613a7 INFO: 172.21.0.1:52020 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:59:42,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:59:42,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:03:17,017 - lava_callback - INFO - Received callback for node 69c411b0944faaf0e7f60e5b INFO: 172.21.0.1:59624 - "POST /node/69c411b0944faaf0e7f60e5b HTTP/1.0" 202 Accepted 2026-03-25 18:03:17,024 - lava_callback - INFO - Starting async job submit for node 69c411b0944faaf0e7f60e5b 2026-03-25 18:03:17,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:03:17,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b0944faaf0e7f60e5b HTTP/1.1" 200 None 2026-03-25 18:03:17,061 - lava_callback - DEBUG - Processing node 69c411b0944faaf0e7f60e5b: baseline-arm64-broonie 2026-03-25 18:03:17,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:03:17,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:03:17,467 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411b0944faaf0e7f60e5b/log.txt.gz 2026-03-25 18:03:17,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:03:17,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:03:17,823 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411b0944faaf0e7f60e5b/lava-logs.yaml 2026-03-25 18:03:17,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:03:17,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:03:17,990 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411b0944faaf0e7f60e5b/lava_callback.json.gz 2026-03-25 18:03:18,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:03:18,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b0944faaf0e7f60e5b HTTP/1.1" 200 None 2026-03-25 18:03:18,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:03:18,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:03:18,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:03:18,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411b0944faaf0e7f60e5b HTTP/1.1" 200 None 2026-03-25 18:03:18,105 - lava_callback - INFO - Completed processing callback for node 69c411b0944faaf0e7f60e5b INFO: 172.21.0.1:33418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:03:42,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:03:42,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:04:35,744 - lava_callback - INFO - Received callback for node 69c42348944faaf0e7f613d8 INFO: 172.21.0.1:39862 - "POST /node/69c42348944faaf0e7f613d8 HTTP/1.0" 202 Accepted 2026-03-25 18:04:35,752 - lava_callback - INFO - Starting async job submit for node 69c42348944faaf0e7f613d8 2026-03-25 18:04:35,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:04:35,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42348944faaf0e7f613d8 HTTP/1.1" 200 None 2026-03-25 18:04:35,798 - lava_callback - DEBUG - Processing node 69c42348944faaf0e7f613d8: baseline-arm64 2026-03-25 18:04:35,997 - lava_callback - WARNING - Failed to upload log 2026-03-25 18:04:36,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:04:36,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:04:36,336 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c42348944faaf0e7f613d8/lava-logs.yaml 2026-03-25 18:04:36,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:04:36,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:04:36,498 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c42348944faaf0e7f613d8/lava_callback.json.gz 2026-03-25 18:04:36,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:39872 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:04:36,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42348944faaf0e7f613d8 HTTP/1.1" 200 None 2026-03-25 18:04:36,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:04:36,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:04:36,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:04:36,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42348944faaf0e7f613d8 HTTP/1.1" 200 None 2026-03-25 18:04:36,655 - lava_callback - INFO - Completed processing callback for node 69c42348944faaf0e7f613d8 2026-03-25 18:04:42,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:04:42,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:08:25,354 - lava_callback - INFO - Received callback for node 69c4242c944faaf0e7f613f5 INFO: 172.21.0.1:37888 - "POST /node/69c4242c944faaf0e7f613f5 HTTP/1.0" 202 Accepted 2026-03-25 18:08:25,360 - lava_callback - INFO - Starting async job submit for node 69c4242c944faaf0e7f613f5 2026-03-25 18:08:25,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:25,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4242c944faaf0e7f613f5 HTTP/1.1" 200 None 2026-03-25 18:08:25,394 - lava_callback - DEBUG - Processing node 69c4242c944faaf0e7f613f5: baseline-x86 2026-03-25 18:08:25,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:08:25,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:08:25,828 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c4242c944faaf0e7f613f5/log.txt.gz 2026-03-25 18:08:25,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:08:26,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:08:26,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c4242c944faaf0e7f613f5/lava-logs.yaml 2026-03-25 18:08:26,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:08:26,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:08:26,341 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c4242c944faaf0e7f613f5/lava_callback.json.gz 2026-03-25 18:08:26,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:26,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4242c944faaf0e7f613f5 HTTP/1.1" 200 None 2026-03-25 18:08:26,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:26,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40aef944faaf0e7f5e438 HTTP/1.1" 200 None 2026-03-25 18:08:26,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:26,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4242c944faaf0e7f613f5 HTTP/1.1" 200 None 2026-03-25 18:08:26,431 - lava_callback - INFO - Completed processing callback for node 69c4242c944faaf0e7f613f5 INFO: 172.21.0.1:37890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:08:42,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:42,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 18:08:44,165 - lava_callback - INFO - Received callback for node 69c410c9944faaf0e7f60c89 INFO: 172.21.0.1:56898 - "POST /node/69c410c9944faaf0e7f60c89 HTTP/1.0" 202 Accepted 2026-03-25 18:08:44,213 - lava_callback - INFO - Starting async job submit for node 69c410c9944faaf0e7f60c89 2026-03-25 18:08:44,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:44,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c9944faaf0e7f60c89 HTTP/1.1" 200 None 2026-03-25 18:08:44,253 - lava_callback - DEBUG - Processing node 69c410c9944faaf0e7f60c89: baseline-arm-pengutronix 2026-03-25 18:08:44,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:08:44,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:08:44,502 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c9944faaf0e7f60c89/log.txt.gz 2026-03-25 18:08:44,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:08:44,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:08:44,860 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c9944faaf0e7f60c89/lava-logs.yaml 2026-03-25 18:08:44,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:08:45,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:08:45,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c9944faaf0e7f60c89/lava_callback.json.gz DEBUG: Setup failed for 69c410c9944faaf0e7f60c89. Transitting job node result: incomplete -> fail 2026-03-25 18:08:45,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:45,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c9944faaf0e7f60c89 HTTP/1.1" 200 None 2026-03-25 18:08:45,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:45,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 18:08:45,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:45,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410c9944faaf0e7f60c89 HTTP/1.1" 200 None 2026-03-25 18:08:45,278 - lava_callback - INFO - Completed processing callback for node 69c410c9944faaf0e7f60c89 INFO: 172.21.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:09:12,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:09:12,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53658 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:15:14,126 - lava_callback - INFO - Received callback for node 69c42180944faaf0e7f61369 INFO: 172.21.0.1:38972 - "POST /node/69c42180944faaf0e7f61369 HTTP/1.0" 202 Accepted 2026-03-25 18:15:14,135 - lava_callback - INFO - Starting async job submit for node 69c42180944faaf0e7f61369 2026-03-25 18:15:14,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:15:14,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42180944faaf0e7f61369 HTTP/1.1" 200 None 2026-03-25 18:15:14,196 - lava_callback - DEBUG - Processing node 69c42180944faaf0e7f61369: baseline-nfs-arm64 INFO: 172.21.0.1:38982 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 18:15:15,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:15:15,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:15:15,525 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42180944faaf0e7f61369/log.txt.gz 2026-03-25 18:15:16,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:15:16,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:15:16,412 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42180944faaf0e7f61369/lava-logs.yaml 2026-03-25 18:15:16,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:38994 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:15:16,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:15:16,636 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42180944faaf0e7f61369/lava_callback.json.gz DEBUG: Setup failed for 69c42180944faaf0e7f61369. Transitting job node result: incomplete -> fail 2026-03-25 18:15:16,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:15:16,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42180944faaf0e7f61369 HTTP/1.1" 200 None 2026-03-25 18:15:16,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:15:16,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:15:16,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:15:16,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42180944faaf0e7f61369 HTTP/1.1" 200 None 2026-03-25 18:15:16,909 - lava_callback - INFO - Completed processing callback for node 69c42180944faaf0e7f61369 INFO: 172.21.0.1:47254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:15:42,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:15:42,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55588 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:16:19,468 - lava_callback - INFO - Received callback for node 69c422ff944faaf0e7f613d2 INFO: 172.21.0.1:55602 - "POST /node/69c422ff944faaf0e7f613d2 HTTP/1.0" 202 Accepted 2026-03-25 18:16:19,476 - lava_callback - INFO - Starting async job submit for node 69c422ff944faaf0e7f613d2 2026-03-25 18:16:19,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:16:19,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c422ff944faaf0e7f613d2 HTTP/1.1" 200 None 2026-03-25 18:16:19,547 - lava_callback - DEBUG - Processing node 69c422ff944faaf0e7f613d2: baseline-nfs-arm64 2026-03-25 18:16:20,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:16:21,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:16:21,670 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c422ff944faaf0e7f613d2/log.txt.gz 2026-03-25 18:16:22,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:16:22,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:16:22,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c422ff944faaf0e7f613d2/lava-logs.yaml 2026-03-25 18:16:22,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:16:22,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:16:22,609 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c422ff944faaf0e7f613d2/lava_callback.json.gz DEBUG: Setup failed for 69c422ff944faaf0e7f613d2. Transitting job node result: incomplete -> fail 2026-03-25 18:16:22,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:16:22,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c422ff944faaf0e7f613d2 HTTP/1.1" 200 None 2026-03-25 18:16:22,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:16:22,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:16:22,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:16:22,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c422ff944faaf0e7f613d2 HTTP/1.1" 200 None 2026-03-25 18:16:22,873 - lava_callback - INFO - Completed processing callback for node 69c422ff944faaf0e7f613d2 INFO: 172.21.0.1:50168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54424 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:16:42,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:16:42,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:17:40,132 - lava_callback - INFO - Received callback for node 69c42585944faaf0e7f61456 INFO: 172.21.0.1:53266 - "POST /node/69c42585944faaf0e7f61456 HTTP/1.0" 202 Accepted 2026-03-25 18:17:40,140 - lava_callback - INFO - Starting async job submit for node 69c42585944faaf0e7f61456 2026-03-25 18:17:40,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:40,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42585944faaf0e7f61456 HTTP/1.1" 200 None 2026-03-25 18:17:40,191 - lava_callback - DEBUG - Processing node 69c42585944faaf0e7f61456: baseline-arm64 2026-03-25 18:17:40,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:17:40,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:17:40,721 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c42585944faaf0e7f61456/log.txt.gz 2026-03-25 18:17:40,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:17:41,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:17:41,163 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c42585944faaf0e7f61456/lava-logs.yaml 2026-03-25 18:17:41,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:17:41,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:17:41,347 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c42585944faaf0e7f61456/lava_callback.json.gz DEBUG: Setup failed for 69c42585944faaf0e7f61456. Transitting job node result: incomplete -> fail 2026-03-25 18:17:41,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:41,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42585944faaf0e7f61456 HTTP/1.1" 200 None 2026-03-25 18:17:41,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:41,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:17:41,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:41,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42585944faaf0e7f61456 HTTP/1.1" 200 None 2026-03-25 18:17:41,559 - lava_callback - INFO - Completed processing callback for node 69c42585944faaf0e7f61456 2026-03-25 18:17:42,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:42,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 18:17:43,890 - lava_callback - INFO - Received callback for node 69c4229e944faaf0e7f613bb INFO: 172.21.0.1:53278 - "POST /node/69c4229e944faaf0e7f613bb HTTP/1.0" 202 Accepted 2026-03-25 18:17:43,897 - lava_callback - INFO - Starting async job submit for node 69c4229e944faaf0e7f613bb 2026-03-25 18:17:43,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:43,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4229e944faaf0e7f613bb HTTP/1.1" 200 None 2026-03-25 18:17:43,992 - lava_callback - DEBUG - Processing node 69c4229e944faaf0e7f613bb: ltp-smoke 2026-03-25 18:17:44,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:17:44,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:17:44,605 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c4229e944faaf0e7f613bb/log.txt.gz 2026-03-25 18:17:44,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:17:45,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:17:45,101 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c4229e944faaf0e7f613bb/lava-logs.yaml 2026-03-25 18:17:45,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:17:45,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:17:45,271 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c4229e944faaf0e7f613bb/lava_callback.json.gz 2026-03-25 18:17:45,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:45,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4229e944faaf0e7f613bb HTTP/1.1" 200 None 2026-03-25 18:17:45,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:45,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ace944faaf0e7f5e40e HTTP/1.1" 200 None 2026-03-25 18:17:45,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:45,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4229e944faaf0e7f613bb HTTP/1.1" 200 None 2026-03-25 18:17:45,613 - lava_callback - INFO - Completed processing callback for node 69c4229e944faaf0e7f613bb INFO: 172.21.0.1:53292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36656 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:18:12,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:12,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48828 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:18:18,076 - lava_callback - INFO - Received callback for node 69c422ca944faaf0e7f613c8 INFO: 172.21.0.1:48834 - "POST /node/69c422ca944faaf0e7f613c8 HTTP/1.0" 202 Accepted 2026-03-25 18:18:18,083 - lava_callback - INFO - Starting async job submit for node 69c422ca944faaf0e7f613c8 2026-03-25 18:18:18,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:18,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c422ca944faaf0e7f613c8 HTTP/1.1" 200 None 2026-03-25 18:18:18,154 - lava_callback - DEBUG - Processing node 69c422ca944faaf0e7f613c8: baseline-arm 2026-03-25 18:18:18,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:18:18,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:18:18,980 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c422ca944faaf0e7f613c8/log.txt.gz 2026-03-25 18:18:19,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:18:19,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:18:19,567 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c422ca944faaf0e7f613c8/lava-logs.yaml 2026-03-25 18:18:19,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:18:19,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:18:19,753 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c422ca944faaf0e7f613c8/lava_callback.json.gz DEBUG: Setup failed for 69c422ca944faaf0e7f613c8. Transitting job node result: incomplete -> fail 2026-03-25 18:18:19,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:19,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c422ca944faaf0e7f613c8 HTTP/1.1" 200 None 2026-03-25 18:18:19,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:19,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 18:18:19,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:19,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c422ca944faaf0e7f613c8 HTTP/1.1" 200 None 2026-03-25 18:18:20,065 - lava_callback - INFO - Completed processing callback for node 69c422ca944faaf0e7f613c8 2026-03-25 18:18:22,422 - lava_callback - INFO - Received callback for node 69c423a0944faaf0e7f613e7 INFO: 172.21.0.1:60426 - "POST /node/69c423a0944faaf0e7f613e7 HTTP/1.0" 202 Accepted 2026-03-25 18:18:22,429 - lava_callback - INFO - Starting async job submit for node 69c423a0944faaf0e7f613e7 2026-03-25 18:18:22,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:22,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c423a0944faaf0e7f613e7 HTTP/1.1" 200 None 2026-03-25 18:18:22,498 - lava_callback - DEBUG - Processing node 69c423a0944faaf0e7f613e7: baseline-arm64 2026-03-25 18:18:23,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:18:23,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:18:23,370 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c423a0944faaf0e7f613e7/log.txt.gz 2026-03-25 18:18:23,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:18:24,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:18:24,011 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c423a0944faaf0e7f613e7/lava-logs.yaml 2026-03-25 18:18:24,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:18:24,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:18:24,172 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c423a0944faaf0e7f613e7/lava_callback.json.gz DEBUG: Setup failed for 69c423a0944faaf0e7f613e7. Transitting job node result: incomplete -> fail 2026-03-25 18:18:24,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:24,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c423a0944faaf0e7f613e7 HTTP/1.1" 200 None 2026-03-25 18:18:24,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:24,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:18:24,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:24,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c423a0944faaf0e7f613e7 HTTP/1.1" 200 None 2026-03-25 18:18:24,434 - lava_callback - INFO - Completed processing callback for node 69c423a0944faaf0e7f613e7 INFO: 172.21.0.1:60436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59090 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:18:42,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:42,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41726 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:46:30,408 - lava_callback - INFO - Received callback for node 69c18a842b2b51e9ad97add9 INFO: 172.21.0.1:54134 - "POST /node/69c18a842b2b51e9ad97add9 HTTP/1.0" 202 Accepted 2026-03-25 18:46:30,413 - lava_callback - INFO - Starting async job submit for node 69c18a842b2b51e9ad97add9 2026-03-25 18:46:30,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:46:30,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18a842b2b51e9ad97add9 HTTP/1.1" 200 None 2026-03-25 18:46:30,429 - lava_callback - DEBUG - Processing node 69c18a842b2b51e9ad97add9: baseline-arm-baylibre 2026-03-25 18:46:30,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18a842b2b51e9ad97add9 2026-03-25 18:46:30,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:46:30,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18a842b2b51e9ad97add9 HTTP/1.1" 200 None 2026-03-25 18:46:30,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:46:30,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:46:30,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:46:30,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18a842b2b51e9ad97add9 HTTP/1.1" 200 None 2026-03-25 18:46:30,493 - lava_callback - ERROR - Error processing callback for node 69c18a842b2b51e9ad97add9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:47:50,362 - lava_callback - INFO - Received callback for node 69c18ac02b2b51e9ad97ade8 INFO: 172.21.0.1:33722 - "POST /node/69c18ac02b2b51e9ad97ade8 HTTP/1.0" 202 Accepted 2026-03-25 18:47:50,368 - lava_callback - INFO - Starting async job submit for node 69c18ac02b2b51e9ad97ade8 2026-03-25 18:47:50,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:47:50,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18ac02b2b51e9ad97ade8 HTTP/1.1" 200 None 2026-03-25 18:47:50,384 - lava_callback - DEBUG - Processing node 69c18ac02b2b51e9ad97ade8: baseline-arm-baylibre 2026-03-25 18:47:50,384 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18ac02b2b51e9ad97ade8 2026-03-25 18:47:50,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:47:50,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18ac02b2b51e9ad97ade8 HTTP/1.1" 200 None 2026-03-25 18:47:50,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:47:50,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:47:50,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:47:50,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18ac02b2b51e9ad97ade8 HTTP/1.1" 200 None 2026-03-25 18:47:50,444 - lava_callback - ERROR - Error processing callback for node 69c18ac02b2b51e9ad97ade8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56228 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:49:50,296 - lava_callback - INFO - Received callback for node 69c18b392b2b51e9ad97adf9 INFO: 172.21.0.1:46480 - "POST /node/69c18b392b2b51e9ad97adf9 HTTP/1.0" 202 Accepted 2026-03-25 18:49:50,301 - lava_callback - INFO - Starting async job submit for node 69c18b392b2b51e9ad97adf9 2026-03-25 18:49:50,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:49:50,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18b392b2b51e9ad97adf9 HTTP/1.1" 200 None 2026-03-25 18:49:50,318 - lava_callback - DEBUG - Processing node 69c18b392b2b51e9ad97adf9: baseline-arm-baylibre 2026-03-25 18:49:50,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18b392b2b51e9ad97adf9 2026-03-25 18:49:50,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:49:50,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18b392b2b51e9ad97adf9 HTTP/1.1" 200 None 2026-03-25 18:49:50,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:49:50,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:49:50,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:49:50,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18b392b2b51e9ad97adf9 HTTP/1.1" 200 None 2026-03-25 18:49:50,389 - lava_callback - ERROR - Error processing callback for node 69c18b392b2b51e9ad97adf9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56544 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:50:35,850 - lava_callback - INFO - Received callback for node 69c42b0c944faaf0e7f61533 INFO: 172.21.0.1:58522 - "POST /node/69c42b0c944faaf0e7f61533 HTTP/1.0" 202 Accepted 2026-03-25 18:50:35,858 - lava_callback - INFO - Starting async job submit for node 69c42b0c944faaf0e7f61533 2026-03-25 18:50:35,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:35,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42b0c944faaf0e7f61533 HTTP/1.1" 200 None 2026-03-25 18:50:35,940 - lava_callback - DEBUG - Processing node 69c42b0c944faaf0e7f61533: baseline-nfs-arm64 INFO: 172.21.0.1:58528 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:50:36,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:50:36,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:50:36,881 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42b0c944faaf0e7f61533/log.txt.gz 2026-03-25 18:50:37,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:50:37,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:50:37,551 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42b0c944faaf0e7f61533/lava-logs.yaml 2026-03-25 18:50:37,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:50:37,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:50:37,735 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42b0c944faaf0e7f61533/lava_callback.json.gz DEBUG: Setup failed for 69c42b0c944faaf0e7f61533. Transitting job node result: incomplete -> fail 2026-03-25 18:50:37,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:37,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42b0c944faaf0e7f61533 HTTP/1.1" 200 None 2026-03-25 18:50:37,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:37,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:50:37,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:37,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42b0c944faaf0e7f61533 HTTP/1.1" 200 None 2026-03-25 18:50:37,982 - lava_callback - INFO - Completed processing callback for node 69c42b0c944faaf0e7f61533 2026-03-25 18:50:42,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:42,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44108 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:50:50,302 - lava_callback - INFO - Received callback for node 69c18b762b2b51e9ad97ae07 INFO: 172.21.0.1:34404 - "POST /node/69c18b762b2b51e9ad97ae07 HTTP/1.0" 202 Accepted 2026-03-25 18:50:50,308 - lava_callback - INFO - Starting async job submit for node 69c18b762b2b51e9ad97ae07 2026-03-25 18:50:50,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:50,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18b762b2b51e9ad97ae07 HTTP/1.1" 200 None 2026-03-25 18:50:50,332 - lava_callback - DEBUG - Processing node 69c18b762b2b51e9ad97ae07: baseline-arm-baylibre 2026-03-25 18:50:50,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18b762b2b51e9ad97ae07 2026-03-25 18:50:50,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:50,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18b762b2b51e9ad97ae07 HTTP/1.1" 200 None 2026-03-25 18:50:50,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:50,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:50:50,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:50,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18b762b2b51e9ad97ae07 HTTP/1.1" 200 None 2026-03-25 18:50:50,390 - lava_callback - ERROR - Error processing callback for node 69c18b762b2b51e9ad97ae07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36458 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:51:50,397 - lava_callback - INFO - Received callback for node 69c18bb32b2b51e9ad97ae16 INFO: 172.21.0.1:52258 - "POST /node/69c18bb32b2b51e9ad97ae16 HTTP/1.0" 202 Accepted 2026-03-25 18:51:50,403 - lava_callback - INFO - Starting async job submit for node 69c18bb32b2b51e9ad97ae16 2026-03-25 18:51:50,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:51:50,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18bb32b2b51e9ad97ae16 HTTP/1.1" 200 None 2026-03-25 18:51:50,439 - lava_callback - DEBUG - Processing node 69c18bb32b2b51e9ad97ae16: baseline-arm-baylibre 2026-03-25 18:51:50,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18bb32b2b51e9ad97ae16 2026-03-25 18:51:50,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:51:50,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18bb32b2b51e9ad97ae16 HTTP/1.1" 200 None 2026-03-25 18:51:50,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:51:50,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:51:50,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:51:50,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18bb32b2b51e9ad97ae16 HTTP/1.1" 200 None 2026-03-25 18:51:50,541 - lava_callback - ERROR - Error processing callback for node 69c18bb32b2b51e9ad97ae16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59036 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:52:07,404 - lava_callback - INFO - Received callback for node 69c42b85944faaf0e7f61551 INFO: 172.21.0.1:59052 - "POST /node/69c42b85944faaf0e7f61551 HTTP/1.0" 202 Accepted 2026-03-25 18:52:07,411 - lava_callback - INFO - Starting async job submit for node 69c42b85944faaf0e7f61551 2026-03-25 18:52:07,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:52:07,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42b85944faaf0e7f61551 HTTP/1.1" 200 None 2026-03-25 18:52:07,497 - lava_callback - DEBUG - Processing node 69c42b85944faaf0e7f61551: baseline-arm64 2026-03-25 18:52:08,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:52:08,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:52:08,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c42b85944faaf0e7f61551/log.txt.gz 2026-03-25 18:52:08,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:52:09,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:52:09,077 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c42b85944faaf0e7f61551/lava-logs.yaml 2026-03-25 18:52:09,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:52:09,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:52:09,298 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c42b85944faaf0e7f61551/lava_callback.json.gz DEBUG: Setup failed for 69c42b85944faaf0e7f61551. Transitting job node result: incomplete -> fail 2026-03-25 18:52:09,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:52:09,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42b85944faaf0e7f61551 HTTP/1.1" 200 None 2026-03-25 18:52:09,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:52:09,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:52:09,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:52:09,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42b85944faaf0e7f61551 HTTP/1.1" 200 None 2026-03-25 18:52:09,579 - lava_callback - INFO - Completed processing callback for node 69c42b85944faaf0e7f61551 2026-03-25 18:52:12,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:52:12,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:53:05,943 - lava_callback - INFO - Received callback for node 69c42a90944faaf0e7f6151a INFO: 172.21.0.1:47266 - "POST /node/69c42a90944faaf0e7f6151a HTTP/1.0" 202 Accepted 2026-03-25 18:53:05,993 - lava_callback - INFO - Starting async job submit for node 69c42a90944faaf0e7f6151a 2026-03-25 18:53:06,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:53:06,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42a90944faaf0e7f6151a HTTP/1.1" 200 None 2026-03-25 18:53:06,033 - lava_callback - DEBUG - Processing node 69c42a90944faaf0e7f6151a: baseline-arm-pengutronix 2026-03-25 18:53:06,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:53:06,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:53:06,312 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c42a90944faaf0e7f6151a/log.txt.gz 2026-03-25 18:53:06,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:47280 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:53:06,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:53:06,566 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c42a90944faaf0e7f6151a/lava-logs.yaml 2026-03-25 18:53:06,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:53:06,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:53:06,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c42a90944faaf0e7f6151a/lava_callback.json.gz DEBUG: Setup failed for 69c42a90944faaf0e7f6151a. Transitting job node result: incomplete -> fail 2026-03-25 18:53:06,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:53:06,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42a90944faaf0e7f6151a HTTP/1.1" 200 None 2026-03-25 18:53:06,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:53:06,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 18:53:06,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:53:06,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42a90944faaf0e7f6151a HTTP/1.1" 200 None 2026-03-25 18:53:07,032 - lava_callback - INFO - Completed processing callback for node 69c42a90944faaf0e7f6151a 2026-03-25 18:53:12,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:53:12,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:54:31,151 - lava_callback - INFO - Received callback for node 69c42ab6944faaf0e7f61527 INFO: 172.21.0.1:53610 - "POST /node/69c42ab6944faaf0e7f61527 HTTP/1.0" 202 Accepted 2026-03-25 18:54:31,159 - lava_callback - INFO - Starting async job submit for node 69c42ab6944faaf0e7f61527 2026-03-25 18:54:31,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:31,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42ab6944faaf0e7f61527 HTTP/1.1" 200 None 2026-03-25 18:54:31,219 - lava_callback - DEBUG - Processing node 69c42ab6944faaf0e7f61527: baseline-nfs-arm64 2026-03-25 18:54:32,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:54:32,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:54:32,541 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42ab6944faaf0e7f61527/log.txt.gz 2026-03-25 18:54:33,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:54:33,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:54:33,419 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42ab6944faaf0e7f61527/lava-logs.yaml 2026-03-25 18:54:33,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:54:33,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:54:33,653 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42ab6944faaf0e7f61527/lava_callback.json.gz DEBUG: Setup failed for 69c42ab6944faaf0e7f61527. Transitting job node result: incomplete -> fail 2026-03-25 18:54:33,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:33,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42ab6944faaf0e7f61527 HTTP/1.1" 200 None 2026-03-25 18:54:33,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:33,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:54:33,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:33,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42ab6944faaf0e7f61527 HTTP/1.1" 200 None 2026-03-25 18:54:33,919 - lava_callback - INFO - Completed processing callback for node 69c42ab6944faaf0e7f61527 INFO: 172.21.0.1:53614 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:54:42,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:42,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39026 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:54:48,262 - lava_callback - INFO - Received callback for node 69c42b54944faaf0e7f6153f INFO: 172.21.0.1:39040 - "POST /node/69c42b54944faaf0e7f6153f HTTP/1.0" 202 Accepted 2026-03-25 18:54:48,269 - lava_callback - INFO - Starting async job submit for node 69c42b54944faaf0e7f6153f 2026-03-25 18:54:48,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:48,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42b54944faaf0e7f6153f HTTP/1.1" 200 None 2026-03-25 18:54:48,353 - lava_callback - DEBUG - Processing node 69c42b54944faaf0e7f6153f: ltp-smoke 2026-03-25 18:54:48,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:54:48,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:54:48,980 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c42b54944faaf0e7f6153f/log.txt.gz 2026-03-25 18:54:49,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:54:49,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:54:49,501 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c42b54944faaf0e7f6153f/lava-logs.yaml 2026-03-25 18:54:49,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:54:49,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:54:49,691 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c42b54944faaf0e7f6153f/lava_callback.json.gz 2026-03-25 18:54:49,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:49,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42b54944faaf0e7f6153f HTTP/1.1" 200 None 2026-03-25 18:54:49,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:49,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ace944faaf0e7f5e40e HTTP/1.1" 200 None 2026-03-25 18:54:49,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:49,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42b54944faaf0e7f6153f HTTP/1.1" 200 None 2026-03-25 18:54:49,957 - lava_callback - INFO - Completed processing callback for node 69c42b54944faaf0e7f6153f INFO: 172.21.0.1:46092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55700 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:55:08,179 - lava_callback - INFO - Received callback for node 69c42b56944faaf0e7f61542 INFO: 172.21.0.1:55716 - "POST /node/69c42b56944faaf0e7f61542 HTTP/1.0" 202 Accepted 2026-03-25 18:55:08,186 - lava_callback - INFO - Starting async job submit for node 69c42b56944faaf0e7f61542 2026-03-25 18:55:08,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:55:08,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42b56944faaf0e7f61542 HTTP/1.1" 200 None 2026-03-25 18:55:08,254 - lava_callback - DEBUG - Processing node 69c42b56944faaf0e7f61542: baseline-arm 2026-03-25 18:55:08,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:55:08,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:55:08,970 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c42b56944faaf0e7f61542/log.txt.gz 2026-03-25 18:55:09,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:55:09,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:55:09,552 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c42b56944faaf0e7f61542/lava-logs.yaml 2026-03-25 18:55:09,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:55:09,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:55:09,739 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c42b56944faaf0e7f61542/lava_callback.json.gz DEBUG: Setup failed for 69c42b56944faaf0e7f61542. Transitting job node result: incomplete -> fail 2026-03-25 18:55:09,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:55:09,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42b56944faaf0e7f61542 HTTP/1.1" 200 None 2026-03-25 18:55:09,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:55:09,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 18:55:09,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:55:09,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42b56944faaf0e7f61542 HTTP/1.1" 200 None 2026-03-25 18:55:10,069 - lava_callback - INFO - Completed processing callback for node 69c42b56944faaf0e7f61542 2026-03-25 18:55:12,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:55:12,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:56:03,407 - lava_callback - INFO - Received callback for node 69c18cb12b2b51e9ad97ae77 INFO: 172.21.0.1:52908 - "POST /node/69c18cb12b2b51e9ad97ae77 HTTP/1.0" 202 Accepted 2026-03-25 18:56:03,413 - lava_callback - INFO - Starting async job submit for node 69c18cb12b2b51e9ad97ae77 2026-03-25 18:56:03,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:56:03,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18cb12b2b51e9ad97ae77 HTTP/1.1" 200 None 2026-03-25 18:56:03,432 - lava_callback - DEBUG - Processing node 69c18cb12b2b51e9ad97ae77: baseline-arm-clabbe 2026-03-25 18:56:03,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18cb12b2b51e9ad97ae77 2026-03-25 18:56:03,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:56:03,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18cb12b2b51e9ad97ae77 HTTP/1.1" 200 None 2026-03-25 18:56:03,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:56:03,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:56:03,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:56:03,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18cb12b2b51e9ad97ae77 HTTP/1.1" 200 None 2026-03-25 18:56:03,483 - lava_callback - ERROR - Error processing callback for node 69c18cb12b2b51e9ad97ae77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60134 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:56:43,403 - lava_callback - INFO - Received callback for node 69c18cda2b2b51e9ad97ae7e INFO: 172.21.0.1:46594 - "POST /node/69c18cda2b2b51e9ad97ae7e HTTP/1.0" 202 Accepted 2026-03-25 18:56:43,408 - lava_callback - INFO - Starting async job submit for node 69c18cda2b2b51e9ad97ae7e 2026-03-25 18:56:43,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:56:43,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18cda2b2b51e9ad97ae7e HTTP/1.1" 200 None 2026-03-25 18:56:43,425 - lava_callback - DEBUG - Processing node 69c18cda2b2b51e9ad97ae7e: baseline-arm-clabbe 2026-03-25 18:56:43,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18cda2b2b51e9ad97ae7e 2026-03-25 18:56:43,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:56:43,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18cda2b2b51e9ad97ae7e HTTP/1.1" 200 None 2026-03-25 18:56:43,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:56:43,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:56:43,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:56:43,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18cda2b2b51e9ad97ae7e HTTP/1.1" 200 None 2026-03-25 18:56:43,482 - lava_callback - ERROR - Error processing callback for node 69c18cda2b2b51e9ad97ae7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50938 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:58:43,521 - lava_callback - INFO - Received callback for node 69c18d5a2b2b51e9ad97aeb0 INFO: 172.21.0.1:33284 - "POST /node/69c18d5a2b2b51e9ad97aeb0 HTTP/1.0" 202 Accepted 2026-03-25 18:58:43,526 - lava_callback - INFO - Starting async job submit for node 69c18d5a2b2b51e9ad97aeb0 2026-03-25 18:58:43,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:58:43,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18d5a2b2b51e9ad97aeb0 HTTP/1.1" 200 None 2026-03-25 18:58:43,542 - lava_callback - DEBUG - Processing node 69c18d5a2b2b51e9ad97aeb0: baseline-arm-clabbe 2026-03-25 18:58:43,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18d5a2b2b51e9ad97aeb0 2026-03-25 18:58:43,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:58:43,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18d5a2b2b51e9ad97aeb0 HTTP/1.1" 200 None 2026-03-25 18:58:43,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:58:43,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:58:43,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:58:43,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18d5a2b2b51e9ad97aeb0 HTTP/1.1" 200 None 2026-03-25 18:58:43,623 - lava_callback - ERROR - Error processing callback for node 69c18d5a2b2b51e9ad97aeb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42972 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:59:23,472 - lava_callback - INFO - Received callback for node 69c18d832b2b51e9ad97aec4 INFO: 172.21.0.1:35512 - "POST /node/69c18d832b2b51e9ad97aec4 HTTP/1.0" 202 Accepted 2026-03-25 18:59:23,477 - lava_callback - INFO - Starting async job submit for node 69c18d832b2b51e9ad97aec4 2026-03-25 18:59:23,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:59:23,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18d832b2b51e9ad97aec4 HTTP/1.1" 200 None 2026-03-25 18:59:23,494 - lava_callback - DEBUG - Processing node 69c18d832b2b51e9ad97aec4: baseline-arm-clabbe 2026-03-25 18:59:23,494 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18d832b2b51e9ad97aec4 2026-03-25 18:59:23,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:59:23,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18d832b2b51e9ad97aec4 HTTP/1.1" 200 None 2026-03-25 18:59:23,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:59:23,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:59:23,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:59:23,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18d832b2b51e9ad97aec4 HTTP/1.1" 200 None 2026-03-25 18:59:23,590 - lava_callback - ERROR - Error processing callback for node 69c18d832b2b51e9ad97aec4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:00:03,688 - lava_callback - INFO - Received callback for node 69c18dad2b2b51e9ad97aecf INFO: 172.21.0.1:33676 - "POST /node/69c18dad2b2b51e9ad97aecf HTTP/1.0" 202 Accepted 2026-03-25 19:00:03,694 - lava_callback - INFO - Starting async job submit for node 69c18dad2b2b51e9ad97aecf 2026-03-25 19:00:03,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:00:03,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18dad2b2b51e9ad97aecf HTTP/1.1" 200 None 2026-03-25 19:00:03,736 - lava_callback - DEBUG - Processing node 69c18dad2b2b51e9ad97aecf: baseline-arm-clabbe 2026-03-25 19:00:03,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18dad2b2b51e9ad97aecf 2026-03-25 19:00:03,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:00:03,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18dad2b2b51e9ad97aecf HTTP/1.1" 200 None 2026-03-25 19:00:03,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:00:03,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 19:00:03,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:00:03,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18dad2b2b51e9ad97aecf HTTP/1.1" 200 None 2026-03-25 19:00:03,811 - lava_callback - ERROR - Error processing callback for node 69c18dad2b2b51e9ad97aecf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58314 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:12:26,692 - lava_callback - INFO - Received callback for node 69c42f20944faaf0e7f61626 INFO: 172.21.0.1:58330 - "POST /node/69c42f20944faaf0e7f61626 HTTP/1.0" 202 Accepted 2026-03-25 19:12:26,745 - lava_callback - INFO - Starting async job submit for node 69c42f20944faaf0e7f61626 2026-03-25 19:12:26,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:12:26,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42f20944faaf0e7f61626 HTTP/1.1" 200 None 2026-03-25 19:12:26,814 - lava_callback - DEBUG - Processing node 69c42f20944faaf0e7f61626: baseline-arm-pengutronix 2026-03-25 19:12:26,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:12:27,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:12:27,142 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c42f20944faaf0e7f61626/log.txt.gz 2026-03-25 19:12:27,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:12:27,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:12:27,407 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c42f20944faaf0e7f61626/lava-logs.yaml 2026-03-25 19:12:27,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:12:27,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:12:27,567 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c42f20944faaf0e7f61626/lava_callback.json.gz DEBUG: Setup failed for 69c42f20944faaf0e7f61626. Transitting job node result: incomplete -> fail 2026-03-25 19:12:27,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:12:27,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42f20944faaf0e7f61626 HTTP/1.1" 200 None 2026-03-25 19:12:27,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:12:27,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:12:27,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:12:27,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42f20944faaf0e7f61626 HTTP/1.1" 200 None 2026-03-25 19:12:27,797 - lava_callback - INFO - Completed processing callback for node 69c42f20944faaf0e7f61626 INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:12:42,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:12:42,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:14:36,752 - lava_callback - INFO - Received callback for node 69c42f72944faaf0e7f61637 INFO: 172.21.0.1:58570 - "POST /node/69c42f72944faaf0e7f61637 HTTP/1.0" 202 Accepted 2026-03-25 19:14:36,760 - lava_callback - INFO - Starting async job submit for node 69c42f72944faaf0e7f61637 2026-03-25 19:14:36,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:14:36,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42f72944faaf0e7f61637 HTTP/1.1" 200 None 2026-03-25 19:14:36,818 - lava_callback - DEBUG - Processing node 69c42f72944faaf0e7f61637: baseline-nfs-arm64 2026-03-25 19:14:37,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:14:38,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:14:38,081 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42f72944faaf0e7f61637/log.txt.gz 2026-03-25 19:14:38,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:14:38,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:14:39,001 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42f72944faaf0e7f61637/lava-logs.yaml 2026-03-25 19:14:39,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:14:39,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:14:39,221 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42f72944faaf0e7f61637/lava_callback.json.gz DEBUG: Setup failed for 69c42f72944faaf0e7f61637. Transitting job node result: incomplete -> fail 2026-03-25 19:14:39,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:14:39,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42f72944faaf0e7f61637 HTTP/1.1" 200 None 2026-03-25 19:14:39,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:14:39,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 19:14:39,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:14:39,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42f72944faaf0e7f61637 HTTP/1.1" 200 None 2026-03-25 19:14:39,457 - lava_callback - INFO - Completed processing callback for node 69c42f72944faaf0e7f61637 2026-03-25 19:14:42,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:14:42,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59070 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:17:51,904 - lava_callback - INFO - Received callback for node 69c191de2b2b51e9ad97af01 INFO: 172.21.0.1:51288 - "POST /node/69c191de2b2b51e9ad97af01 HTTP/1.0" 202 Accepted 2026-03-25 19:17:51,909 - lava_callback - INFO - Starting async job submit for node 69c191de2b2b51e9ad97af01 2026-03-25 19:17:51,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:17:51,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c191de2b2b51e9ad97af01 HTTP/1.1" 200 None 2026-03-25 19:17:51,929 - lava_callback - DEBUG - Processing node 69c191de2b2b51e9ad97af01: baseline-arm64-baylibre 2026-03-25 19:17:51,929 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c191de2b2b51e9ad97af01 2026-03-25 19:17:51,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:17:51,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c191de2b2b51e9ad97af01 HTTP/1.1" 200 None 2026-03-25 19:17:51,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:17:51,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:17:51,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:17:51,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c191de2b2b51e9ad97af01 HTTP/1.1" 200 None 2026-03-25 19:17:51,980 - lava_callback - ERROR - Error processing callback for node 69c191de2b2b51e9ad97af01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:19:51,955 - lava_callback - INFO - Received callback for node 69c192442b2b51e9ad97af17 INFO: 172.21.0.1:38562 - "POST /node/69c192442b2b51e9ad97af17 HTTP/1.0" 202 Accepted 2026-03-25 19:19:51,960 - lava_callback - INFO - Starting async job submit for node 69c192442b2b51e9ad97af17 2026-03-25 19:19:51,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:19:51,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c192442b2b51e9ad97af17 HTTP/1.1" 200 None 2026-03-25 19:19:51,987 - lava_callback - DEBUG - Processing node 69c192442b2b51e9ad97af17: baseline-arm64-baylibre 2026-03-25 19:19:51,987 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c192442b2b51e9ad97af17 2026-03-25 19:19:51,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:19:52,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c192442b2b51e9ad97af17 HTTP/1.1" 200 None 2026-03-25 19:19:52,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:19:52,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:19:52,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:19:52,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c192442b2b51e9ad97af17 HTTP/1.1" 200 None 2026-03-25 19:19:52,039 - lava_callback - ERROR - Error processing callback for node 69c192442b2b51e9ad97af17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46750 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:21:11,954 - lava_callback - INFO - Received callback for node 69c192992b2b51e9ad97af2f INFO: 172.21.0.1:44680 - "POST /node/69c192992b2b51e9ad97af2f HTTP/1.0" 202 Accepted 2026-03-25 19:21:11,960 - lava_callback - INFO - Starting async job submit for node 69c192992b2b51e9ad97af2f 2026-03-25 19:21:11,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:21:11,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c192992b2b51e9ad97af2f HTTP/1.1" 200 None 2026-03-25 19:21:11,978 - lava_callback - DEBUG - Processing node 69c192992b2b51e9ad97af2f: baseline-arm64-baylibre 2026-03-25 19:21:11,978 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c192992b2b51e9ad97af2f 2026-03-25 19:21:11,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:21:11,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c192992b2b51e9ad97af2f HTTP/1.1" 200 None 2026-03-25 19:21:11,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:21:12,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:21:12,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:21:12,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c192992b2b51e9ad97af2f HTTP/1.1" 200 None 2026-03-25 19:21:12,041 - lava_callback - ERROR - Error processing callback for node 69c192992b2b51e9ad97af2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55622 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:22:44,645 - lava_callback - INFO - Received callback for node 69c192fc2b2b51e9ad97af46 INFO: 172.21.0.1:57570 - "POST /node/69c192fc2b2b51e9ad97af46 HTTP/1.0" 202 Accepted 2026-03-25 19:22:44,651 - lava_callback - INFO - Starting async job submit for node 69c192fc2b2b51e9ad97af46 2026-03-25 19:22:44,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:22:44,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c192fc2b2b51e9ad97af46 HTTP/1.1" 200 None 2026-03-25 19:22:44,671 - lava_callback - DEBUG - Processing node 69c192fc2b2b51e9ad97af46: baseline-arm64-clabbe 2026-03-25 19:22:44,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c192fc2b2b51e9ad97af46 2026-03-25 19:22:44,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:22:44,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c192fc2b2b51e9ad97af46 HTTP/1.1" 200 None 2026-03-25 19:22:44,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:22:44,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:22:44,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:22:44,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c192fc2b2b51e9ad97af46 HTTP/1.1" 200 None 2026-03-25 19:22:44,729 - lava_callback - ERROR - Error processing callback for node 69c192fc2b2b51e9ad97af46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:24:24,715 - lava_callback - INFO - Received callback for node 69c193562b2b51e9ad97af68 INFO: 172.21.0.1:42558 - "POST /node/69c193562b2b51e9ad97af68 HTTP/1.0" 202 Accepted 2026-03-25 19:24:24,720 - lava_callback - INFO - Starting async job submit for node 69c193562b2b51e9ad97af68 2026-03-25 19:24:24,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:24:24,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c193562b2b51e9ad97af68 HTTP/1.1" 200 None 2026-03-25 19:24:24,737 - lava_callback - DEBUG - Processing node 69c193562b2b51e9ad97af68: baseline-arm64-clabbe 2026-03-25 19:24:24,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c193562b2b51e9ad97af68 2026-03-25 19:24:24,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:24:24,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c193562b2b51e9ad97af68 HTTP/1.1" 200 None 2026-03-25 19:24:24,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:24:24,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:24:24,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:24:24,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c193562b2b51e9ad97af68 HTTP/1.1" 200 None 2026-03-25 19:24:24,800 - lava_callback - ERROR - Error processing callback for node 69c193562b2b51e9ad97af68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40792 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:27:04,906 - lava_callback - INFO - Received callback for node 69c194032b2b51e9ad97af84 INFO: 172.21.0.1:43312 - "POST /node/69c194032b2b51e9ad97af84 HTTP/1.0" 202 Accepted 2026-03-25 19:27:04,911 - lava_callback - INFO - Starting async job submit for node 69c194032b2b51e9ad97af84 2026-03-25 19:27:04,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:27:04,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c194032b2b51e9ad97af84 HTTP/1.1" 200 None 2026-03-25 19:27:04,927 - lava_callback - DEBUG - Processing node 69c194032b2b51e9ad97af84: baseline-arm64-clabbe 2026-03-25 19:27:04,927 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c194032b2b51e9ad97af84 2026-03-25 19:27:04,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:27:04,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c194032b2b51e9ad97af84 HTTP/1.1" 200 None 2026-03-25 19:27:04,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:27:04,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:27:04,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:27:04,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c194032b2b51e9ad97af84 HTTP/1.1" 200 None 2026-03-25 19:27:04,985 - lava_callback - ERROR - Error processing callback for node 69c194032b2b51e9ad97af84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:28:44,935 - lava_callback - INFO - Received callback for node 69c1945b2b2b51e9ad97af91 INFO: 172.21.0.1:50758 - "POST /node/69c1945b2b2b51e9ad97af91 HTTP/1.0" 202 Accepted 2026-03-25 19:28:44,941 - lava_callback - INFO - Starting async job submit for node 69c1945b2b2b51e9ad97af91 2026-03-25 19:28:44,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:28:44,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1945b2b2b51e9ad97af91 HTTP/1.1" 200 None 2026-03-25 19:28:44,957 - lava_callback - DEBUG - Processing node 69c1945b2b2b51e9ad97af91: baseline-arm64-clabbe 2026-03-25 19:28:44,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1945b2b2b51e9ad97af91 2026-03-25 19:28:44,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:28:44,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1945b2b2b51e9ad97af91 HTTP/1.1" 200 None 2026-03-25 19:28:44,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:28:44,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:28:44,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:28:45,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1945b2b2b51e9ad97af91 HTTP/1.1" 200 None 2026-03-25 19:28:45,028 - lava_callback - ERROR - Error processing callback for node 69c1945b2b2b51e9ad97af91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54010 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:30:05,143 - lava_callback - INFO - Received callback for node 69c194b32b2b51e9ad97af99 INFO: 172.21.0.1:34528 - "POST /node/69c194b32b2b51e9ad97af99 HTTP/1.0" 202 Accepted 2026-03-25 19:30:05,149 - lava_callback - INFO - Starting async job submit for node 69c194b32b2b51e9ad97af99 2026-03-25 19:30:05,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:30:05,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c194b32b2b51e9ad97af99 HTTP/1.1" 200 None 2026-03-25 19:30:05,165 - lava_callback - DEBUG - Processing node 69c194b32b2b51e9ad97af99: baseline-arm64-clabbe 2026-03-25 19:30:05,165 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c194b32b2b51e9ad97af99 2026-03-25 19:30:05,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:30:05,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c194b32b2b51e9ad97af99 HTTP/1.1" 200 None 2026-03-25 19:30:05,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:30:05,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:30:05,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:30:05,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c194b32b2b51e9ad97af99 HTTP/1.1" 200 None 2026-03-25 19:30:05,229 - lava_callback - ERROR - Error processing callback for node 69c194b32b2b51e9ad97af99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48182 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:31:38,836 - lava_callback - INFO - Received callback for node 69c41144944faaf0e7f60d4c INFO: 172.21.0.1:48198 - "POST /node/69c41144944faaf0e7f60d4c HTTP/1.0" 202 Accepted 2026-03-25 19:31:38,842 - lava_callback - INFO - Starting async job submit for node 69c41144944faaf0e7f60d4c 2026-03-25 19:31:38,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:38,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41144944faaf0e7f60d4c HTTP/1.1" 200 None 2026-03-25 19:31:38,883 - lava_callback - DEBUG - Processing node 69c41144944faaf0e7f60d4c: baseline-x86 2026-03-25 19:31:39,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:31:39,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:31:39,439 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c41144944faaf0e7f60d4c/log.txt.gz 2026-03-25 19:31:39,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:31:39,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:31:39,823 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c41144944faaf0e7f60d4c/lava-logs.yaml 2026-03-25 19:31:39,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:31:40,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:31:40,008 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c41144944faaf0e7f60d4c/lava_callback.json.gz 2026-03-25 19:31:40,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:40,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41144944faaf0e7f60d4c HTTP/1.1" 200 None 2026-03-25 19:31:40,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:40,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40aef944faaf0e7f5e438 HTTP/1.1" 200 None 2026-03-25 19:31:40,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:40,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41144944faaf0e7f60d4c HTTP/1.1" 200 None 2026-03-25 19:31:40,087 - lava_callback - INFO - Completed processing callback for node 69c41144944faaf0e7f60d4c 2026-03-25 19:31:42,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:42,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 19:31:45,029 - lava_callback - INFO - Received callback for node 69c1950c2b2b51e9ad97afa8 INFO: 172.21.0.1:39496 - "POST /node/69c1950c2b2b51e9ad97afa8 HTTP/1.0" 202 Accepted 2026-03-25 19:31:45,035 - lava_callback - INFO - Starting async job submit for node 69c1950c2b2b51e9ad97afa8 2026-03-25 19:31:45,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:45,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1950c2b2b51e9ad97afa8 HTTP/1.1" 200 None 2026-03-25 19:31:45,054 - lava_callback - DEBUG - Processing node 69c1950c2b2b51e9ad97afa8: baseline-arm64-clabbe 2026-03-25 19:31:45,055 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1950c2b2b51e9ad97afa8 2026-03-25 19:31:45,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:45,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1950c2b2b51e9ad97afa8 HTTP/1.1" 200 None 2026-03-25 19:31:45,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:45,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:31:45,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:45,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1950c2b2b51e9ad97afa8 HTTP/1.1" 200 None 2026-03-25 19:31:45,137 - lava_callback - ERROR - Error processing callback for node 69c1950c2b2b51e9ad97afa8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39198 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:39:37,717 - lava_callback - INFO - Received callback for node 69c410b4944faaf0e7f60c22 INFO: 172.21.0.1:39206 - "POST /node/69c410b4944faaf0e7f60c22 HTTP/1.0" 202 Accepted 2026-03-25 19:39:37,723 - lava_callback - INFO - Starting async job submit for node 69c410b4944faaf0e7f60c22 2026-03-25 19:39:37,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:39:37,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b4944faaf0e7f60c22 HTTP/1.1" 200 None 2026-03-25 19:39:37,762 - lava_callback - DEBUG - Processing node 69c410b4944faaf0e7f60c22: baseline-arm-broonie 2026-03-25 19:39:37,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:39:38,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:39:38,124 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b4944faaf0e7f60c22/log.txt.gz 2026-03-25 19:39:38,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:39:38,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:39:38,449 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b4944faaf0e7f60c22/lava-logs.yaml 2026-03-25 19:39:38,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:39:38,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:39:38,626 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b4944faaf0e7f60c22/lava_callback.json.gz 2026-03-25 19:39:38,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:39:38,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b4944faaf0e7f60c22 HTTP/1.1" 200 None 2026-03-25 19:39:38,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:39:38,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:39:38,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:39:38,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410b4944faaf0e7f60c22 HTTP/1.1" 200 None 2026-03-25 19:39:38,733 - lava_callback - INFO - Completed processing callback for node 69c410b4944faaf0e7f60c22 2026-03-25 19:39:42,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:39:42,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46644 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:42:07,092 - lava_callback - INFO - Received callback for node 69c410de944faaf0e7f60ca0 INFO: 172.21.0.1:46654 - "POST /node/69c410de944faaf0e7f60ca0 HTTP/1.0" 202 Accepted 2026-03-25 19:42:07,099 - lava_callback - INFO - Starting async job submit for node 69c410de944faaf0e7f60ca0 2026-03-25 19:42:07,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:42:07,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410de944faaf0e7f60ca0 HTTP/1.1" 200 None 2026-03-25 19:42:07,158 - lava_callback - DEBUG - Processing node 69c410de944faaf0e7f60ca0: ltp-cap_bounds 2026-03-25 19:42:07,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:42:07,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:42:07,684 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69c410de944faaf0e7f60ca0/log.txt.gz 2026-03-25 19:42:07,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:42:08,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:42:08,175 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69c410de944faaf0e7f60ca0/lava-logs.yaml 2026-03-25 19:42:08,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:42:08,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:42:08,346 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69c410de944faaf0e7f60ca0/lava_callback.json.gz 2026-03-25 19:42:08,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:42:08,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410de944faaf0e7f60ca0 HTTP/1.1" 200 None 2026-03-25 19:42:08,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:42:08,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:42:08,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:42:08,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410de944faaf0e7f60ca0 HTTP/1.1" 200 None 2026-03-25 19:42:08,428 - lava_callback - INFO - Completed processing callback for node 69c410de944faaf0e7f60ca0 2026-03-25 19:42:12,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:42:12,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56524 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:43:37,912 - lava_callback - INFO - Received callback for node 69c410e0944faaf0e7f60ca3 INFO: 172.21.0.1:56536 - "POST /node/69c410e0944faaf0e7f60ca3 HTTP/1.0" 202 Accepted 2026-03-25 19:43:37,918 - lava_callback - INFO - Starting async job submit for node 69c410e0944faaf0e7f60ca3 2026-03-25 19:43:37,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:43:37,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e0944faaf0e7f60ca3 HTTP/1.1" 200 None 2026-03-25 19:43:37,958 - lava_callback - DEBUG - Processing node 69c410e0944faaf0e7f60ca3: ltp-containers 2026-03-25 19:43:38,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:43:38,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:43:38,581 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69c410e0944faaf0e7f60ca3/log.txt.gz 2026-03-25 19:43:38,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:43:39,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:43:39,043 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69c410e0944faaf0e7f60ca3/lava-logs.yaml 2026-03-25 19:43:39,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:43:39,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:43:39,207 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69c410e0944faaf0e7f60ca3/lava_callback.json.gz 2026-03-25 19:43:39,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:43:39,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e0944faaf0e7f60ca3 HTTP/1.1" 200 None 2026-03-25 19:43:39,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:43:39,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:43:39,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:43:39,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410e0944faaf0e7f60ca3 HTTP/1.1" 200 None 2026-03-25 19:43:39,306 - lava_callback - INFO - Completed processing callback for node 69c410e0944faaf0e7f60ca3 2026-03-25 19:43:42,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:43:42,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:45:38,967 - lava_callback - INFO - Received callback for node 69c410e1944faaf0e7f60ca6 INFO: 172.21.0.1:46286 - "POST /node/69c410e1944faaf0e7f60ca6 HTTP/1.0" 202 Accepted 2026-03-25 19:45:38,974 - lava_callback - INFO - Starting async job submit for node 69c410e1944faaf0e7f60ca6 2026-03-25 19:45:38,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:45:39,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e1944faaf0e7f60ca6 HTTP/1.1" 200 None 2026-03-25 19:45:39,017 - lava_callback - DEBUG - Processing node 69c410e1944faaf0e7f60ca6: ltp-controllers 2026-03-25 19:45:39,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:45:39,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:45:39,631 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69c410e1944faaf0e7f60ca6/log.txt.gz 2026-03-25 19:45:39,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:45:40,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:45:40,203 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69c410e1944faaf0e7f60ca6/lava-logs.yaml 2026-03-25 19:45:40,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:45:40,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:45:40,398 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69c410e1944faaf0e7f60ca6/lava_callback.json.gz 2026-03-25 19:45:40,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:45:40,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e1944faaf0e7f60ca6 HTTP/1.1" 200 None 2026-03-25 19:45:40,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:45:40,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:45:40,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:45:40,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410e1944faaf0e7f60ca6 HTTP/1.1" 200 None 2026-03-25 19:45:40,490 - lava_callback - INFO - Completed processing callback for node 69c410e1944faaf0e7f60ca6 2026-03-25 19:45:42,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:45:42,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42296 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:48:27,138 - lava_callback - INFO - Received callback for node 69c410e4944faaf0e7f60ca9 INFO: 172.21.0.1:42304 - "POST /node/69c410e4944faaf0e7f60ca9 HTTP/1.0" 202 Accepted 2026-03-25 19:48:27,145 - lava_callback - INFO - Starting async job submit for node 69c410e4944faaf0e7f60ca9 2026-03-25 19:48:27,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:27,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e4944faaf0e7f60ca9 HTTP/1.1" 200 None 2026-03-25 19:48:27,213 - lava_callback - DEBUG - Processing node 69c410e4944faaf0e7f60ca9: ltp-cve 2026-03-25 19:48:27,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:48:27,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:48:27,768 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69c410e4944faaf0e7f60ca9/log.txt.gz 2026-03-25 19:48:27,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:48:28,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:48:28,209 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69c410e4944faaf0e7f60ca9/lava-logs.yaml 2026-03-25 19:48:28,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:48:28,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:48:28,375 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69c410e4944faaf0e7f60ca9/lava_callback.json.gz 2026-03-25 19:48:28,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:28,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e4944faaf0e7f60ca9 HTTP/1.1" 200 None 2026-03-25 19:48:28,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:28,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:48:28,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:28,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410e4944faaf0e7f60ca9 HTTP/1.1" 200 None 2026-03-25 19:48:28,471 - lava_callback - INFO - Completed processing callback for node 69c410e4944faaf0e7f60ca9 INFO: 172.21.0.1:58330 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:48:42,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:42,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48016 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:48:58,163 - lava_callback - INFO - Received callback for node 69c410e8944faaf0e7f60cc0 INFO: 172.21.0.1:48026 - "POST /node/69c410e8944faaf0e7f60cc0 HTTP/1.0" 202 Accepted 2026-03-25 19:48:58,169 - lava_callback - INFO - Starting async job submit for node 69c410e8944faaf0e7f60cc0 2026-03-25 19:48:58,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:58,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e8944faaf0e7f60cc0 HTTP/1.1" 200 None 2026-03-25 19:48:58,210 - lava_callback - DEBUG - Processing node 69c410e8944faaf0e7f60cc0: ltp-fs_bind 2026-03-25 19:48:58,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:48:58,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:48:58,809 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69c410e8944faaf0e7f60cc0/log.txt.gz 2026-03-25 19:48:59,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:48:59,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:48:59,302 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69c410e8944faaf0e7f60cc0/lava-logs.yaml 2026-03-25 19:48:59,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:48:59,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:48:59,474 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69c410e8944faaf0e7f60cc0/lava_callback.json.gz 2026-03-25 19:48:59,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:59,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e8944faaf0e7f60cc0 HTTP/1.1" 200 None 2026-03-25 19:48:59,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:59,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:48:59,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:59,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410e8944faaf0e7f60cc0 HTTP/1.1" 200 None 2026-03-25 19:48:59,557 - lava_callback - INFO - Completed processing callback for node 69c410e8944faaf0e7f60cc0 INFO: 172.21.0.1:54554 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:49:12,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:49:12,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45888 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:52:47,578 - lava_callback - INFO - Received callback for node 69c410ec944faaf0e7f60cc8 INFO: 172.21.0.1:45900 - "POST /node/69c410ec944faaf0e7f60cc8 HTTP/1.0" 202 Accepted 2026-03-25 19:52:47,585 - lava_callback - INFO - Starting async job submit for node 69c410ec944faaf0e7f60cc8 2026-03-25 19:52:47,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:52:47,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ec944faaf0e7f60cc8 HTTP/1.1" 200 None 2026-03-25 19:52:47,627 - lava_callback - DEBUG - Processing node 69c410ec944faaf0e7f60cc8: ltp-input 2026-03-25 19:52:47,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:52:48,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:52:48,109 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69c410ec944faaf0e7f60cc8/log.txt.gz 2026-03-25 19:52:48,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:52:48,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:52:48,563 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69c410ec944faaf0e7f60cc8/lava-logs.yaml 2026-03-25 19:52:48,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:52:48,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:52:48,753 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69c410ec944faaf0e7f60cc8/lava_callback.json.gz 2026-03-25 19:52:48,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:52:48,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ec944faaf0e7f60cc8 HTTP/1.1" 200 None 2026-03-25 19:52:48,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:52:48,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:52:48,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:52:48,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410ec944faaf0e7f60cc8 HTTP/1.1" 200 None 2026-03-25 19:52:48,863 - lava_callback - INFO - Completed processing callback for node 69c410ec944faaf0e7f60cc8 INFO: 172.21.0.1:36194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:53:12,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:53:12,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:53:38,371 - lava_callback - INFO - Received callback for node 69c410ee944faaf0e7f60ccb INFO: 172.21.0.1:37240 - "POST /node/69c410ee944faaf0e7f60ccb HTTP/1.0" 202 Accepted 2026-03-25 19:53:38,378 - lava_callback - INFO - Starting async job submit for node 69c410ee944faaf0e7f60ccb 2026-03-25 19:53:38,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:53:38,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ee944faaf0e7f60ccb HTTP/1.1" 200 None 2026-03-25 19:53:38,419 - lava_callback - DEBUG - Processing node 69c410ee944faaf0e7f60ccb: ltp-ipc 2026-03-25 19:53:38,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:53:38,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:53:38,949 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69c410ee944faaf0e7f60ccb/log.txt.gz 2026-03-25 19:53:39,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:53:39,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:53:39,401 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69c410ee944faaf0e7f60ccb/lava-logs.yaml 2026-03-25 19:53:39,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:53:39,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:53:39,581 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69c410ee944faaf0e7f60ccb/lava_callback.json.gz 2026-03-25 19:53:39,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:53:39,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ee944faaf0e7f60ccb HTTP/1.1" 200 None 2026-03-25 19:53:39,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:53:39,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:53:39,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:53:39,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410ee944faaf0e7f60ccb HTTP/1.1" 200 None 2026-03-25 19:53:39,664 - lava_callback - INFO - Completed processing callback for node 69c410ee944faaf0e7f60ccb 2026-03-25 19:53:42,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:53:42,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58662 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:54:18,623 - lava_callback - INFO - Received callback for node 69c410f0944faaf0e7f60cce INFO: 172.21.0.1:58676 - "POST /node/69c410f0944faaf0e7f60cce HTTP/1.0" 202 Accepted 2026-03-25 19:54:18,630 - lava_callback - INFO - Starting async job submit for node 69c410f0944faaf0e7f60cce 2026-03-25 19:54:18,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:54:18,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f0944faaf0e7f60cce HTTP/1.1" 200 None 2026-03-25 19:54:18,670 - lava_callback - DEBUG - Processing node 69c410f0944faaf0e7f60cce: ltp-pty 2026-03-25 19:54:19,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:54:23,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:54:23,196 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69c410f0944faaf0e7f60cce/log.txt.gz 2026-03-25 19:54:23,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:54:23,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:54:23,639 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69c410f0944faaf0e7f60cce/lava-logs.yaml 2026-03-25 19:54:23,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:54:23,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:54:23,819 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69c410f0944faaf0e7f60cce/lava_callback.json.gz 2026-03-25 19:54:23,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:54:23,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f0944faaf0e7f60cce HTTP/1.1" 200 None 2026-03-25 19:54:23,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:54:23,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:54:23,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:54:23,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410f0944faaf0e7f60cce HTTP/1.1" 200 None 2026-03-25 19:54:23,912 - lava_callback - INFO - Completed processing callback for node 69c410f0944faaf0e7f60cce INFO: 172.21.0.1:59302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38662 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:54:42,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:54:43,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36582 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:54:59,011 - lava_callback - INFO - Received callback for node 69c410ea944faaf0e7f60cc5 INFO: 172.21.0.1:36594 - "POST /node/69c410ea944faaf0e7f60cc5 HTTP/1.0" 202 Accepted 2026-03-25 19:54:59,017 - lava_callback - INFO - Starting async job submit for node 69c410ea944faaf0e7f60cc5 2026-03-25 19:54:59,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:54:59,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ea944faaf0e7f60cc5 HTTP/1.1" 200 None 2026-03-25 19:54:59,068 - lava_callback - DEBUG - Processing node 69c410ea944faaf0e7f60cc5: ltp-fsx 2026-03-25 19:54:59,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:54:59,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:54:59,602 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69c410ea944faaf0e7f60cc5/log.txt.gz 2026-03-25 19:54:59,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:55:00,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:55:00,069 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69c410ea944faaf0e7f60cc5/lava-logs.yaml 2026-03-25 19:55:00,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:55:00,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:55:00,251 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69c410ea944faaf0e7f60cc5/lava_callback.json.gz 2026-03-25 19:55:00,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:55:00,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ea944faaf0e7f60cc5 HTTP/1.1" 200 None 2026-03-25 19:55:00,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:55:00,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:55:00,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:55:00,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410ea944faaf0e7f60cc5 HTTP/1.1" 200 None 2026-03-25 19:55:00,343 - lava_callback - INFO - Completed processing callback for node 69c410ea944faaf0e7f60cc5 INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:55:13,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:55:13,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36000 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:56:47,442 - lava_callback - INFO - Received callback for node 69c410f2944faaf0e7f60cd5 INFO: 172.21.0.1:36014 - "POST /node/69c410f2944faaf0e7f60cd5 HTTP/1.0" 202 Accepted 2026-03-25 19:56:47,448 - lava_callback - INFO - Starting async job submit for node 69c410f2944faaf0e7f60cd5 2026-03-25 19:56:47,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:36030 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:56:47,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f2944faaf0e7f60cd5 HTTP/1.1" 200 None 2026-03-25 19:56:47,498 - lava_callback - DEBUG - Processing node 69c410f2944faaf0e7f60cd5: ltp-sched 2026-03-25 19:56:47,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:56:48,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:56:48,004 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69c410f2944faaf0e7f60cd5/log.txt.gz 2026-03-25 19:56:48,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:56:48,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:56:48,423 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69c410f2944faaf0e7f60cd5/lava-logs.yaml 2026-03-25 19:56:48,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:56:48,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:56:48,645 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69c410f2944faaf0e7f60cd5/lava_callback.json.gz 2026-03-25 19:56:48,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:56:48,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f2944faaf0e7f60cd5 HTTP/1.1" 200 None 2026-03-25 19:56:48,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:56:48,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:56:48,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:56:48,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410f2944faaf0e7f60cd5 HTTP/1.1" 200 None 2026-03-25 19:56:48,771 - lava_callback - INFO - Completed processing callback for node 69c410f2944faaf0e7f60cd5 INFO: 172.21.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41212 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:57:13,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:57:13,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:58:07,740 - lava_callback - INFO - Received callback for node 69c411a4944faaf0e7f60e3c INFO: 172.21.0.1:46264 - "POST /node/69c411a4944faaf0e7f60e3c HTTP/1.0" 202 Accepted 2026-03-25 19:58:07,746 - lava_callback - INFO - Starting async job submit for node 69c411a4944faaf0e7f60e3c 2026-03-25 19:58:07,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:07,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411a4944faaf0e7f60e3c HTTP/1.1" 200 None 2026-03-25 19:58:07,792 - lava_callback - DEBUG - Processing node 69c411a4944faaf0e7f60e3c: baseline-arm64-broonie 2026-03-25 19:58:08,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:08,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:08,159 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411a4944faaf0e7f60e3c/log.txt.gz 2026-03-25 19:58:08,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:08,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:08,499 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411a4944faaf0e7f60e3c/lava-logs.yaml 2026-03-25 19:58:08,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:08,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:08,675 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411a4944faaf0e7f60e3c/lava_callback.json.gz 2026-03-25 19:58:08,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:08,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411a4944faaf0e7f60e3c HTTP/1.1" 200 None 2026-03-25 19:58:08,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:08,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 19:58:08,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:08,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411a4944faaf0e7f60e3c HTTP/1.1" 200 None 2026-03-25 19:58:08,765 - lava_callback - INFO - Completed processing callback for node 69c411a4944faaf0e7f60e3c 2026-03-25 19:58:13,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:13,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:58:18,489 - lava_callback - INFO - Received callback for node 69c410f4944faaf0e7f60cd8 INFO: 172.21.0.1:51518 - "POST /node/69c410f4944faaf0e7f60cd8 HTTP/1.0" 202 Accepted 2026-03-25 19:58:18,495 - lava_callback - INFO - Starting async job submit for node 69c410f4944faaf0e7f60cd8 2026-03-25 19:58:18,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:18,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f4944faaf0e7f60cd8 HTTP/1.1" 200 None 2026-03-25 19:58:18,536 - lava_callback - DEBUG - Processing node 69c410f4944faaf0e7f60cd8: ltp-smoke 2026-03-25 19:58:18,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:19,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:19,082 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c410f4944faaf0e7f60cd8/log.txt.gz 2026-03-25 19:58:19,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:19,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:19,527 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c410f4944faaf0e7f60cd8/lava-logs.yaml 2026-03-25 19:58:19,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:19,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:19,693 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c410f4944faaf0e7f60cd8/lava_callback.json.gz 2026-03-25 19:58:19,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:19,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f4944faaf0e7f60cd8 HTTP/1.1" 200 None 2026-03-25 19:58:19,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:19,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:58:19,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:19,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410f4944faaf0e7f60cd8 HTTP/1.1" 200 None 2026-03-25 19:58:19,788 - lava_callback - INFO - Completed processing callback for node 69c410f4944faaf0e7f60cd8 2026-03-25 19:58:20,146 - lava_callback - INFO - Received callback for node 69c410f7944faaf0e7f60ce1 INFO: 172.21.0.1:51096 - "POST /node/69c410f7944faaf0e7f60ce1 HTTP/1.0" 202 Accepted 2026-03-25 19:58:20,152 - lava_callback - INFO - Starting async job submit for node 69c410f7944faaf0e7f60ce1 2026-03-25 19:58:20,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:20,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f7944faaf0e7f60ce1 HTTP/1.1" 200 None 2026-03-25 19:58:20,196 - lava_callback - DEBUG - Processing node 69c410f7944faaf0e7f60ce1: ltp-syscalls-ipc 2026-03-25 19:58:20,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:20,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:20,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69c410f7944faaf0e7f60ce1/log.txt.gz 2026-03-25 19:58:20,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:21,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:21,122 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69c410f7944faaf0e7f60ce1/lava-logs.yaml 2026-03-25 19:58:21,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:21,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:21,297 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69c410f7944faaf0e7f60ce1/lava_callback.json.gz 2026-03-25 19:58:21,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:21,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f7944faaf0e7f60ce1 HTTP/1.1" 200 None 2026-03-25 19:58:21,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:21,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:58:21,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:21,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410f7944faaf0e7f60ce1 HTTP/1.1" 200 None 2026-03-25 19:58:21,388 - lava_callback - INFO - Completed processing callback for node 69c410f7944faaf0e7f60ce1 INFO: 172.21.0.1:51098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:58:43,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:43,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:00:47,490 - lava_callback - INFO - Received callback for node 69c410fb944faaf0e7f60ced INFO: 172.21.0.1:55054 - "POST /node/69c410fb944faaf0e7f60ced HTTP/1.0" 202 Accepted 2026-03-25 20:00:47,497 - lava_callback - INFO - Starting async job submit for node 69c410fb944faaf0e7f60ced 2026-03-25 20:00:47,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:00:47,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410fb944faaf0e7f60ced HTTP/1.1" 200 None 2026-03-25 20:00:47,564 - lava_callback - DEBUG - Processing node 69c410fb944faaf0e7f60ced: ltp-watchqueue 2026-03-25 20:00:47,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 20:00:48,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 20:00:48,057 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69c410fb944faaf0e7f60ced/log.txt.gz 2026-03-25 20:00:48,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 20:00:48,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 20:00:48,498 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69c410fb944faaf0e7f60ced/lava-logs.yaml 2026-03-25 20:00:48,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 20:00:48,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 20:00:48,689 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69c410fb944faaf0e7f60ced/lava_callback.json.gz 2026-03-25 20:00:48,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:00:48,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410fb944faaf0e7f60ced HTTP/1.1" 200 None 2026-03-25 20:00:48,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:00:48,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 20:00:48,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:00:48,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410fb944faaf0e7f60ced HTTP/1.1" 200 None 2026-03-25 20:00:48,843 - lava_callback - INFO - Completed processing callback for node 69c410fb944faaf0e7f60ced INFO: 172.21.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47320 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:01:13,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:01:13,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47338 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:47346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53492 - "GET /security.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:45754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43200 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:02:20,065 - lava_callback - INFO - Received callback for node 69c410f9944faaf0e7f60ce4 INFO: 172.21.0.1:56234 - "POST /node/69c410f9944faaf0e7f60ce4 HTTP/1.0" 202 Accepted 2026-03-25 20:02:20,072 - lava_callback - INFO - Starting async job submit for node 69c410f9944faaf0e7f60ce4 2026-03-25 20:02:20,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:02:20,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f9944faaf0e7f60ce4 HTTP/1.1" 200 None 2026-03-25 20:02:20,149 - lava_callback - DEBUG - Processing node 69c410f9944faaf0e7f60ce4: ltp-timers 2026-03-25 20:02:20,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 20:02:20,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 20:02:20,712 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69c410f9944faaf0e7f60ce4/log.txt.gz 2026-03-25 20:02:20,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 20:02:21,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 20:02:21,172 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69c410f9944faaf0e7f60ce4/lava-logs.yaml 2026-03-25 20:02:21,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 20:02:21,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 20:02:21,405 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69c410f9944faaf0e7f60ce4/lava_callback.json.gz 2026-03-25 20:02:21,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:02:21,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f9944faaf0e7f60ce4 HTTP/1.1" 200 None 2026-03-25 20:02:21,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:02:21,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 20:02:21,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:02:21,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410f9944faaf0e7f60ce4 HTTP/1.1" 200 None 2026-03-25 20:02:21,509 - lava_callback - INFO - Completed processing callback for node 69c410f9944faaf0e7f60ce4 INFO: 172.21.0.1:56248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:02:43,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:02:43,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:48740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51820 - "GET /security.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:45216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42220 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:41:56,901 - lava_callback - INFO - Received callback for node 69c1a5822b2b51e9ad97b03c INFO: 172.21.0.1:42230 - "POST /node/69c1a5822b2b51e9ad97b03c HTTP/1.0" 202 Accepted 2026-03-25 20:41:56,906 - lava_callback - INFO - Starting async job submit for node 69c1a5822b2b51e9ad97b03c 2026-03-25 20:41:56,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:41:56,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a5822b2b51e9ad97b03c HTTP/1.1" 200 None 2026-03-25 20:41:56,922 - lava_callback - DEBUG - Processing node 69c1a5822b2b51e9ad97b03c: baseline-arm-baylibre 2026-03-25 20:41:56,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a5822b2b51e9ad97b03c 2026-03-25 20:41:56,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:41:56,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a5822b2b51e9ad97b03c HTTP/1.1" 200 None 2026-03-25 20:41:56,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:41:56,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:41:56,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:41:56,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a5822b2b51e9ad97b03c HTTP/1.1" 200 None 2026-03-25 20:41:56,985 - lava_callback - ERROR - Error processing callback for node 69c1a5822b2b51e9ad97b03c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54734 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:42:36,427 - lava_callback - INFO - Received callback for node 69c1a5ab2b2b51e9ad97b048 INFO: 172.21.0.1:48492 - "POST /node/69c1a5ab2b2b51e9ad97b048 HTTP/1.0" 202 Accepted 2026-03-25 20:42:36,435 - lava_callback - INFO - Starting async job submit for node 69c1a5ab2b2b51e9ad97b048 2026-03-25 20:42:36,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:42:36,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a5ab2b2b51e9ad97b048 HTTP/1.1" 200 None 2026-03-25 20:42:36,455 - lava_callback - DEBUG - Processing node 69c1a5ab2b2b51e9ad97b048: baseline-arm-baylibre 2026-03-25 20:42:36,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a5ab2b2b51e9ad97b048 2026-03-25 20:42:36,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:42:36,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a5ab2b2b51e9ad97b048 HTTP/1.1" 200 None 2026-03-25 20:42:36,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:42:36,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:42:36,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:42:36,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a5ab2b2b51e9ad97b048 HTTP/1.1" 200 None 2026-03-25 20:42:36,516 - lava_callback - ERROR - Error processing callback for node 69c1a5ab2b2b51e9ad97b048: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 20:43:16,530 - lava_callback - INFO - Received callback for node 69c1a5d52b2b51e9ad97b057 INFO: 172.21.0.1:36694 - "POST /node/69c1a5d52b2b51e9ad97b057 HTTP/1.0" 202 Accepted 2026-03-25 20:43:16,540 - lava_callback - INFO - Starting async job submit for node 69c1a5d52b2b51e9ad97b057 2026-03-25 20:43:16,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:36698 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:43:16,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a5d52b2b51e9ad97b057 HTTP/1.1" 200 None 2026-03-25 20:43:16,562 - lava_callback - DEBUG - Processing node 69c1a5d52b2b51e9ad97b057: baseline-arm-baylibre 2026-03-25 20:43:16,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a5d52b2b51e9ad97b057 2026-03-25 20:43:16,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:43:16,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a5d52b2b51e9ad97b057 HTTP/1.1" 200 None 2026-03-25 20:43:16,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:43:16,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:43:16,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:43:16,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a5d52b2b51e9ad97b057 HTTP/1.1" 200 None 2026-03-25 20:43:16,617 - lava_callback - ERROR - Error processing callback for node 69c1a5d52b2b51e9ad97b057: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47880 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:43:56,557 - lava_callback - INFO - Received callback for node 69c1a5ff2b2b51e9ad97b067 INFO: 172.21.0.1:47894 - "POST /node/69c1a5ff2b2b51e9ad97b067 HTTP/1.0" 202 Accepted 2026-03-25 20:43:56,563 - lava_callback - INFO - Starting async job submit for node 69c1a5ff2b2b51e9ad97b067 2026-03-25 20:43:56,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:43:56,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a5ff2b2b51e9ad97b067 HTTP/1.1" 200 None 2026-03-25 20:43:56,583 - lava_callback - DEBUG - Processing node 69c1a5ff2b2b51e9ad97b067: baseline-arm-baylibre 2026-03-25 20:43:56,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a5ff2b2b51e9ad97b067 2026-03-25 20:43:56,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:43:56,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a5ff2b2b51e9ad97b067 HTTP/1.1" 200 None 2026-03-25 20:43:56,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:43:56,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:43:56,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:43:56,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a5ff2b2b51e9ad97b067 HTTP/1.1" 200 None 2026-03-25 20:43:56,664 - lava_callback - ERROR - Error processing callback for node 69c1a5ff2b2b51e9ad97b067: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34400 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:44:36,668 - lava_callback - INFO - Received callback for node 69c1a6262b2b51e9ad97b071 INFO: 172.21.0.1:34416 - "POST /node/69c1a6262b2b51e9ad97b071 HTTP/1.0" 202 Accepted 2026-03-25 20:44:36,673 - lava_callback - INFO - Starting async job submit for node 69c1a6262b2b51e9ad97b071 2026-03-25 20:44:36,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:44:36,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a6262b2b51e9ad97b071 HTTP/1.1" 200 None 2026-03-25 20:44:36,688 - lava_callback - DEBUG - Processing node 69c1a6262b2b51e9ad97b071: baseline-arm-baylibre 2026-03-25 20:44:36,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a6262b2b51e9ad97b071 2026-03-25 20:44:36,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:44:36,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a6262b2b51e9ad97b071 HTTP/1.1" 200 None 2026-03-25 20:44:36,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:44:36,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:44:36,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:44:36,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a6262b2b51e9ad97b071 HTTP/1.1" 200 None 2026-03-25 20:44:36,746 - lava_callback - ERROR - Error processing callback for node 69c1a6262b2b51e9ad97b071: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38794 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:45:16,597 - lava_callback - INFO - Received callback for node 69c1a64e2b2b51e9ad97b07e INFO: 172.21.0.1:38798 - "POST /node/69c1a64e2b2b51e9ad97b07e HTTP/1.0" 202 Accepted 2026-03-25 20:45:16,603 - lava_callback - INFO - Starting async job submit for node 69c1a64e2b2b51e9ad97b07e 2026-03-25 20:45:16,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:45:16,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a64e2b2b51e9ad97b07e HTTP/1.1" 200 None 2026-03-25 20:45:16,619 - lava_callback - DEBUG - Processing node 69c1a64e2b2b51e9ad97b07e: baseline-arm-baylibre 2026-03-25 20:45:16,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a64e2b2b51e9ad97b07e 2026-03-25 20:45:16,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:45:16,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a64e2b2b51e9ad97b07e HTTP/1.1" 200 None 2026-03-25 20:45:16,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:45:16,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:45:16,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:45:16,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a64e2b2b51e9ad97b07e HTTP/1.1" 200 None 2026-03-25 20:45:16,671 - lava_callback - ERROR - Error processing callback for node 69c1a64e2b2b51e9ad97b07e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:45:56,713 - lava_callback - INFO - Received callback for node 69c1a6762b2b51e9ad97b08e INFO: 172.21.0.1:54836 - "POST /node/69c1a6762b2b51e9ad97b08e HTTP/1.0" 202 Accepted 2026-03-25 20:45:56,718 - lava_callback - INFO - Starting async job submit for node 69c1a6762b2b51e9ad97b08e 2026-03-25 20:45:56,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:45:56,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a6762b2b51e9ad97b08e HTTP/1.1" 200 None 2026-03-25 20:45:56,734 - lava_callback - DEBUG - Processing node 69c1a6762b2b51e9ad97b08e: baseline-arm-baylibre 2026-03-25 20:45:56,735 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a6762b2b51e9ad97b08e 2026-03-25 20:45:56,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:45:56,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a6762b2b51e9ad97b08e HTTP/1.1" 200 None 2026-03-25 20:45:56,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:45:56,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:45:56,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:45:56,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a6762b2b51e9ad97b08e HTTP/1.1" 200 None 2026-03-25 20:45:56,800 - lava_callback - ERROR - Error processing callback for node 69c1a6762b2b51e9ad97b08e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42258 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:46:36,673 - lava_callback - INFO - Received callback for node 69c1a69d2b2b51e9ad97b098 INFO: 172.21.0.1:42274 - "POST /node/69c1a69d2b2b51e9ad97b098 HTTP/1.0" 202 Accepted 2026-03-25 20:46:36,679 - lava_callback - INFO - Starting async job submit for node 69c1a69d2b2b51e9ad97b098 2026-03-25 20:46:36,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:46:36,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a69d2b2b51e9ad97b098 HTTP/1.1" 200 None 2026-03-25 20:46:36,698 - lava_callback - DEBUG - Processing node 69c1a69d2b2b51e9ad97b098: baseline-arm-baylibre 2026-03-25 20:46:36,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a69d2b2b51e9ad97b098 2026-03-25 20:46:36,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:46:36,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a69d2b2b51e9ad97b098 HTTP/1.1" 200 None 2026-03-25 20:46:36,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:46:36,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:46:36,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:46:36,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a69d2b2b51e9ad97b098 HTTP/1.1" 200 None 2026-03-25 20:46:36,754 - lava_callback - ERROR - Error processing callback for node 69c1a69d2b2b51e9ad97b098: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57962 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:47:16,790 - lava_callback - INFO - Received callback for node 69c1a6c52b2b51e9ad97b0a5 INFO: 172.21.0.1:57968 - "POST /node/69c1a6c52b2b51e9ad97b0a5 HTTP/1.0" 202 Accepted 2026-03-25 20:47:16,795 - lava_callback - INFO - Starting async job submit for node 69c1a6c52b2b51e9ad97b0a5 2026-03-25 20:47:16,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:47:16,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a6c52b2b51e9ad97b0a5 HTTP/1.1" 200 None 2026-03-25 20:47:16,814 - lava_callback - DEBUG - Processing node 69c1a6c52b2b51e9ad97b0a5: baseline-arm-baylibre 2026-03-25 20:47:16,814 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a6c52b2b51e9ad97b0a5 2026-03-25 20:47:16,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:47:16,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a6c52b2b51e9ad97b0a5 HTTP/1.1" 200 None 2026-03-25 20:47:16,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:47:16,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:47:16,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:47:16,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a6c52b2b51e9ad97b0a5 HTTP/1.1" 200 None 2026-03-25 20:47:16,868 - lava_callback - ERROR - Error processing callback for node 69c1a6c52b2b51e9ad97b0a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55686 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:47:56,752 - lava_callback - INFO - Received callback for node 69c1a6ed2b2b51e9ad97b0b7 INFO: 172.21.0.1:55688 - "POST /node/69c1a6ed2b2b51e9ad97b0b7 HTTP/1.0" 202 Accepted 2026-03-25 20:47:56,758 - lava_callback - INFO - Starting async job submit for node 69c1a6ed2b2b51e9ad97b0b7 2026-03-25 20:47:56,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:47:56,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a6ed2b2b51e9ad97b0b7 HTTP/1.1" 200 None 2026-03-25 20:47:56,775 - lava_callback - DEBUG - Processing node 69c1a6ed2b2b51e9ad97b0b7: baseline-arm-baylibre 2026-03-25 20:47:56,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a6ed2b2b51e9ad97b0b7 2026-03-25 20:47:56,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:47:56,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a6ed2b2b51e9ad97b0b7 HTTP/1.1" 200 None 2026-03-25 20:47:56,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:47:56,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:47:56,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:47:56,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a6ed2b2b51e9ad97b0b7 HTTP/1.1" 200 None 2026-03-25 20:47:56,828 - lava_callback - ERROR - Error processing callback for node 69c1a6ed2b2b51e9ad97b0b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:48:48,569 - lava_callback - INFO - Received callback for node 69c1a71a2b2b51e9ad97b0c6 INFO: 172.21.0.1:35862 - "POST /node/69c1a71a2b2b51e9ad97b0c6 HTTP/1.0" 202 Accepted 2026-03-25 20:48:48,575 - lava_callback - INFO - Starting async job submit for node 69c1a71a2b2b51e9ad97b0c6 2026-03-25 20:48:48,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:48:48,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a71a2b2b51e9ad97b0c6 HTTP/1.1" 200 None 2026-03-25 20:48:48,592 - lava_callback - DEBUG - Processing node 69c1a71a2b2b51e9ad97b0c6: baseline-arm-clabbe 2026-03-25 20:48:48,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a71a2b2b51e9ad97b0c6 2026-03-25 20:48:48,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:48:48,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a71a2b2b51e9ad97b0c6 HTTP/1.1" 200 None 2026-03-25 20:48:48,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:48:48,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:48:48,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:48:48,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a71a2b2b51e9ad97b0c6 HTTP/1.1" 200 None 2026-03-25 20:48:48,658 - lava_callback - ERROR - Error processing callback for node 69c1a71a2b2b51e9ad97b0c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35456 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:49:16,956 - lava_callback - INFO - Received callback for node 69c1a7412b2b51e9ad97b0d6 INFO: 172.21.0.1:35468 - "POST /node/69c1a7412b2b51e9ad97b0d6 HTTP/1.0" 202 Accepted 2026-03-25 20:49:16,962 - lava_callback - INFO - Starting async job submit for node 69c1a7412b2b51e9ad97b0d6 2026-03-25 20:49:16,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:49:16,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a7412b2b51e9ad97b0d6 HTTP/1.1" 200 None 2026-03-25 20:49:16,999 - lava_callback - DEBUG - Processing node 69c1a7412b2b51e9ad97b0d6: baseline-arm-baylibre 2026-03-25 20:49:17,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a7412b2b51e9ad97b0d6 2026-03-25 20:49:17,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:49:17,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a7412b2b51e9ad97b0d6 HTTP/1.1" 200 None 2026-03-25 20:49:17,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:49:17,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:49:17,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:49:17,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a7412b2b51e9ad97b0d6 HTTP/1.1" 200 None 2026-03-25 20:49:17,084 - lava_callback - ERROR - Error processing callback for node 69c1a7412b2b51e9ad97b0d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57956 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:50:48,619 - lava_callback - INFO - Received callback for node 69c1a79c2b2b51e9ad97b0f3 INFO: 172.21.0.1:57960 - "POST /node/69c1a79c2b2b51e9ad97b0f3 HTTP/1.0" 202 Accepted 2026-03-25 20:50:48,625 - lava_callback - INFO - Starting async job submit for node 69c1a79c2b2b51e9ad97b0f3 2026-03-25 20:50:48,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:50:48,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a79c2b2b51e9ad97b0f3 HTTP/1.1" 200 None 2026-03-25 20:50:48,650 - lava_callback - DEBUG - Processing node 69c1a79c2b2b51e9ad97b0f3: baseline-arm-clabbe 2026-03-25 20:50:48,650 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a79c2b2b51e9ad97b0f3 2026-03-25 20:50:48,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:50:48,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a79c2b2b51e9ad97b0f3 HTTP/1.1" 200 None 2026-03-25 20:50:48,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:50:48,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:50:48,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:50:48,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a79c2b2b51e9ad97b0f3 HTTP/1.1" 200 None 2026-03-25 20:50:48,734 - lava_callback - ERROR - Error processing callback for node 69c1a79c2b2b51e9ad97b0f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55558 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:51:28,593 - lava_callback - INFO - Received callback for node 69c1a7c52b2b51e9ad97b107 INFO: 172.21.0.1:55564 - "POST /node/69c1a7c52b2b51e9ad97b107 HTTP/1.0" 202 Accepted 2026-03-25 20:51:28,598 - lava_callback - INFO - Starting async job submit for node 69c1a7c52b2b51e9ad97b107 2026-03-25 20:51:28,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:51:28,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a7c52b2b51e9ad97b107 HTTP/1.1" 200 None 2026-03-25 20:51:28,623 - lava_callback - DEBUG - Processing node 69c1a7c52b2b51e9ad97b107: baseline-arm-clabbe 2026-03-25 20:51:28,624 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a7c52b2b51e9ad97b107 2026-03-25 20:51:28,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:51:28,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a7c52b2b51e9ad97b107 HTTP/1.1" 200 None 2026-03-25 20:51:28,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:51:28,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:51:28,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:51:28,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a7c52b2b51e9ad97b107 HTTP/1.1" 200 None 2026-03-25 20:51:28,711 - lava_callback - ERROR - Error processing callback for node 69c1a7c52b2b51e9ad97b107: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38534 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:52:48,732 - lava_callback - INFO - Received callback for node 69c1a8162b2b51e9ad97b11e INFO: 172.21.0.1:38536 - "POST /node/69c1a8162b2b51e9ad97b11e HTTP/1.0" 202 Accepted 2026-03-25 20:52:48,738 - lava_callback - INFO - Starting async job submit for node 69c1a8162b2b51e9ad97b11e 2026-03-25 20:52:48,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:52:48,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a8162b2b51e9ad97b11e HTTP/1.1" 200 None 2026-03-25 20:52:48,768 - lava_callback - DEBUG - Processing node 69c1a8162b2b51e9ad97b11e: baseline-arm-clabbe 2026-03-25 20:52:48,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a8162b2b51e9ad97b11e 2026-03-25 20:52:48,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:52:48,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a8162b2b51e9ad97b11e HTTP/1.1" 200 None 2026-03-25 20:52:48,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:52:48,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:52:48,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:52:48,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a8162b2b51e9ad97b11e HTTP/1.1" 200 None 2026-03-25 20:52:48,836 - lava_callback - ERROR - Error processing callback for node 69c1a8162b2b51e9ad97b11e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58350 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:53:28,715 - lava_callback - INFO - Received callback for node 69c1a83e2b2b51e9ad97b130 INFO: 172.21.0.1:58364 - "POST /node/69c1a83e2b2b51e9ad97b130 HTTP/1.0" 202 Accepted 2026-03-25 20:53:28,721 - lava_callback - INFO - Starting async job submit for node 69c1a83e2b2b51e9ad97b130 2026-03-25 20:53:28,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:53:28,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a83e2b2b51e9ad97b130 HTTP/1.1" 200 None 2026-03-25 20:53:28,737 - lava_callback - DEBUG - Processing node 69c1a83e2b2b51e9ad97b130: baseline-arm-clabbe 2026-03-25 20:53:28,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a83e2b2b51e9ad97b130 2026-03-25 20:53:28,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:53:28,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a83e2b2b51e9ad97b130 HTTP/1.1" 200 None 2026-03-25 20:53:28,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:53:28,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:53:28,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:53:28,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a83e2b2b51e9ad97b130 HTTP/1.1" 200 None 2026-03-25 20:53:28,791 - lava_callback - ERROR - Error processing callback for node 69c1a83e2b2b51e9ad97b130: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43868 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:54:08,817 - lava_callback - INFO - Received callback for node 69c1a8662b2b51e9ad97b13d INFO: 172.21.0.1:43882 - "POST /node/69c1a8662b2b51e9ad97b13d HTTP/1.0" 202 Accepted 2026-03-25 20:54:08,822 - lava_callback - INFO - Starting async job submit for node 69c1a8662b2b51e9ad97b13d 2026-03-25 20:54:08,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:54:08,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a8662b2b51e9ad97b13d HTTP/1.1" 200 None 2026-03-25 20:54:08,839 - lava_callback - DEBUG - Processing node 69c1a8662b2b51e9ad97b13d: baseline-arm-clabbe 2026-03-25 20:54:08,839 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a8662b2b51e9ad97b13d 2026-03-25 20:54:08,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:54:08,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a8662b2b51e9ad97b13d HTTP/1.1" 200 None 2026-03-25 20:54:08,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:54:08,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:54:08,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:54:08,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a8662b2b51e9ad97b13d HTTP/1.1" 200 None 2026-03-25 20:54:08,895 - lava_callback - ERROR - Error processing callback for node 69c1a8662b2b51e9ad97b13d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40936 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:54:48,793 - lava_callback - INFO - Received callback for node 69c1a88e2b2b51e9ad97b14b INFO: 172.21.0.1:40948 - "POST /node/69c1a88e2b2b51e9ad97b14b HTTP/1.0" 202 Accepted 2026-03-25 20:54:48,799 - lava_callback - INFO - Starting async job submit for node 69c1a88e2b2b51e9ad97b14b 2026-03-25 20:54:48,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:54:48,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a88e2b2b51e9ad97b14b HTTP/1.1" 200 None 2026-03-25 20:54:48,815 - lava_callback - DEBUG - Processing node 69c1a88e2b2b51e9ad97b14b: baseline-arm-clabbe 2026-03-25 20:54:48,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a88e2b2b51e9ad97b14b 2026-03-25 20:54:48,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:54:48,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a88e2b2b51e9ad97b14b HTTP/1.1" 200 None 2026-03-25 20:54:48,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:54:48,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:54:48,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:54:48,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a88e2b2b51e9ad97b14b HTTP/1.1" 200 None 2026-03-25 20:54:48,915 - lava_callback - ERROR - Error processing callback for node 69c1a88e2b2b51e9ad97b14b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34056 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:56:08,876 - lava_callback - INFO - Received callback for node 69c1a8df2b2b51e9ad97b167 INFO: 172.21.0.1:34072 - "POST /node/69c1a8df2b2b51e9ad97b167 HTTP/1.0" 202 Accepted 2026-03-25 20:56:08,882 - lava_callback - INFO - Starting async job submit for node 69c1a8df2b2b51e9ad97b167 2026-03-25 20:56:08,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:56:08,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a8df2b2b51e9ad97b167 HTTP/1.1" 200 None 2026-03-25 20:56:08,897 - lava_callback - DEBUG - Processing node 69c1a8df2b2b51e9ad97b167: baseline-arm-clabbe 2026-03-25 20:56:08,898 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a8df2b2b51e9ad97b167 2026-03-25 20:56:08,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:56:08,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a8df2b2b51e9ad97b167 HTTP/1.1" 200 None 2026-03-25 20:56:08,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:56:08,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:56:08,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:56:08,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a8df2b2b51e9ad97b167 HTTP/1.1" 200 None 2026-03-25 20:56:09,004 - lava_callback - ERROR - Error processing callback for node 69c1a8df2b2b51e9ad97b167: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:57:48,965 - lava_callback - INFO - Received callback for node 69c1a9372b2b51e9ad97b187 INFO: 172.21.0.1:45854 - "POST /node/69c1a9372b2b51e9ad97b187 HTTP/1.0" 202 Accepted 2026-03-25 20:57:48,971 - lava_callback - INFO - Starting async job submit for node 69c1a9372b2b51e9ad97b187 2026-03-25 20:57:48,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:57:48,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9372b2b51e9ad97b187 HTTP/1.1" 200 None 2026-03-25 20:57:48,987 - lava_callback - DEBUG - Processing node 69c1a9372b2b51e9ad97b187: baseline-arm-clabbe 2026-03-25 20:57:48,987 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a9372b2b51e9ad97b187 2026-03-25 20:57:48,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:57:49,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9372b2b51e9ad97b187 HTTP/1.1" 200 None 2026-03-25 20:57:49,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:57:49,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:57:49,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:57:49,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a9372b2b51e9ad97b187 HTTP/1.1" 200 None 2026-03-25 20:57:49,054 - lava_callback - ERROR - Error processing callback for node 69c1a9372b2b51e9ad97b187: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:58:17,451 - lava_callback - INFO - Received callback for node 69c1a9592b2b51e9ad97b196 INFO: 172.21.0.1:45970 - "POST /node/69c1a9592b2b51e9ad97b196 HTTP/1.0" 202 Accepted 2026-03-25 20:58:17,456 - lava_callback - INFO - Starting async job submit for node 69c1a9592b2b51e9ad97b196 2026-03-25 20:58:17,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:58:17,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9592b2b51e9ad97b196 HTTP/1.1" 200 None 2026-03-25 20:58:17,481 - lava_callback - DEBUG - Processing node 69c1a9592b2b51e9ad97b196: baseline-arm-baylibre 2026-03-25 20:58:17,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a9592b2b51e9ad97b196 2026-03-25 20:58:17,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:58:17,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9592b2b51e9ad97b196 HTTP/1.1" 200 None 2026-03-25 20:58:17,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:58:17,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 20:58:17,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:58:17,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a9592b2b51e9ad97b196 HTTP/1.1" 200 None 2026-03-25 20:58:17,536 - lava_callback - ERROR - Error processing callback for node 69c1a9592b2b51e9ad97b196: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58148 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:58:57,345 - lava_callback - INFO - Received callback for node 69c1a9822b2b51e9ad97b1a7 INFO: 172.21.0.1:58154 - "POST /node/69c1a9822b2b51e9ad97b1a7 HTTP/1.0" 202 Accepted 2026-03-25 20:58:57,350 - lava_callback - INFO - Starting async job submit for node 69c1a9822b2b51e9ad97b1a7 2026-03-25 20:58:57,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:58:57,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9822b2b51e9ad97b1a7 HTTP/1.1" 200 None 2026-03-25 20:58:57,366 - lava_callback - DEBUG - Processing node 69c1a9822b2b51e9ad97b1a7: baseline-arm-baylibre 2026-03-25 20:58:57,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a9822b2b51e9ad97b1a7 2026-03-25 20:58:57,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:58:57,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9822b2b51e9ad97b1a7 HTTP/1.1" 200 None 2026-03-25 20:58:57,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:58:57,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 20:58:57,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:58:57,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a9822b2b51e9ad97b1a7 HTTP/1.1" 200 None 2026-03-25 20:58:57,425 - lava_callback - ERROR - Error processing callback for node 69c1a9822b2b51e9ad97b1a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59262 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:59:37,403 - lava_callback - INFO - Received callback for node 69c1a9a92b2b51e9ad97b1b0 INFO: 172.21.0.1:59274 - "POST /node/69c1a9a92b2b51e9ad97b1b0 HTTP/1.0" 202 Accepted 2026-03-25 20:59:37,409 - lava_callback - INFO - Starting async job submit for node 69c1a9a92b2b51e9ad97b1b0 2026-03-25 20:59:37,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:59:37,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9a92b2b51e9ad97b1b0 HTTP/1.1" 200 None 2026-03-25 20:59:37,426 - lava_callback - DEBUG - Processing node 69c1a9a92b2b51e9ad97b1b0: baseline-arm-baylibre 2026-03-25 20:59:37,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a9a92b2b51e9ad97b1b0 2026-03-25 20:59:37,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:59:37,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9a92b2b51e9ad97b1b0 HTTP/1.1" 200 None 2026-03-25 20:59:37,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:59:37,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 20:59:37,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:59:37,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a9a92b2b51e9ad97b1b0 HTTP/1.1" 200 None 2026-03-25 20:59:37,482 - lava_callback - ERROR - Error processing callback for node 69c1a9a92b2b51e9ad97b1b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51680 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:00:17,472 - lava_callback - INFO - Received callback for node 69c1a9d12b2b51e9ad97b1bc INFO: 172.21.0.1:51692 - "POST /node/69c1a9d12b2b51e9ad97b1bc HTTP/1.0" 202 Accepted 2026-03-25 21:00:17,477 - lava_callback - INFO - Starting async job submit for node 69c1a9d12b2b51e9ad97b1bc 2026-03-25 21:00:17,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:00:17,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9d12b2b51e9ad97b1bc HTTP/1.1" 200 None 2026-03-25 21:00:17,493 - lava_callback - DEBUG - Processing node 69c1a9d12b2b51e9ad97b1bc: baseline-arm-baylibre 2026-03-25 21:00:17,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a9d12b2b51e9ad97b1bc 2026-03-25 21:00:17,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:00:17,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9d12b2b51e9ad97b1bc HTTP/1.1" 200 None 2026-03-25 21:00:17,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:00:17,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 21:00:17,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:00:17,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a9d12b2b51e9ad97b1bc HTTP/1.1" 200 None 2026-03-25 21:00:17,568 - lava_callback - ERROR - Error processing callback for node 69c1a9d12b2b51e9ad97b1bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32806 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:00:57,614 - lava_callback - INFO - Received callback for node 69c1a9fa2b2b51e9ad97b1cc INFO: 172.21.0.1:32808 - "POST /node/69c1a9fa2b2b51e9ad97b1cc HTTP/1.0" 202 Accepted 2026-03-25 21:00:57,620 - lava_callback - INFO - Starting async job submit for node 69c1a9fa2b2b51e9ad97b1cc 2026-03-25 21:00:57,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:00:57,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9fa2b2b51e9ad97b1cc HTTP/1.1" 200 None 2026-03-25 21:00:57,636 - lava_callback - DEBUG - Processing node 69c1a9fa2b2b51e9ad97b1cc: baseline-arm-baylibre 2026-03-25 21:00:57,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a9fa2b2b51e9ad97b1cc 2026-03-25 21:00:57,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:00:57,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9fa2b2b51e9ad97b1cc HTTP/1.1" 200 None 2026-03-25 21:00:57,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:00:57,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 21:00:57,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:00:57,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a9fa2b2b51e9ad97b1cc HTTP/1.1" 200 None 2026-03-25 21:00:57,692 - lava_callback - ERROR - Error processing callback for node 69c1a9fa2b2b51e9ad97b1cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:01:37,519 - lava_callback - INFO - Received callback for node 69c1aa212b2b51e9ad97b1d8 INFO: 172.21.0.1:58616 - "POST /node/69c1aa212b2b51e9ad97b1d8 HTTP/1.0" 202 Accepted 2026-03-25 21:01:37,524 - lava_callback - INFO - Starting async job submit for node 69c1aa212b2b51e9ad97b1d8 2026-03-25 21:01:37,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:01:37,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aa212b2b51e9ad97b1d8 HTTP/1.1" 200 None 2026-03-25 21:01:37,546 - lava_callback - DEBUG - Processing node 69c1aa212b2b51e9ad97b1d8: baseline-arm-baylibre 2026-03-25 21:01:37,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1aa212b2b51e9ad97b1d8 2026-03-25 21:01:37,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:01:37,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aa212b2b51e9ad97b1d8 HTTP/1.1" 200 None 2026-03-25 21:01:37,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:01:37,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 21:01:37,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:01:37,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1aa212b2b51e9ad97b1d8 HTTP/1.1" 200 None 2026-03-25 21:01:37,602 - lava_callback - ERROR - Error processing callback for node 69c1aa212b2b51e9ad97b1d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46352 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:02:09,358 - lava_callback - INFO - Received callback for node 69c1aa4d2b2b51e9ad97b1e6 INFO: 172.21.0.1:46358 - "POST /node/69c1aa4d2b2b51e9ad97b1e6 HTTP/1.0" 202 Accepted 2026-03-25 21:02:09,364 - lava_callback - INFO - Starting async job submit for node 69c1aa4d2b2b51e9ad97b1e6 2026-03-25 21:02:09,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:02:09,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aa4d2b2b51e9ad97b1e6 HTTP/1.1" 200 None 2026-03-25 21:02:09,379 - lava_callback - DEBUG - Processing node 69c1aa4d2b2b51e9ad97b1e6: baseline-arm-clabbe 2026-03-25 21:02:09,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1aa4d2b2b51e9ad97b1e6 2026-03-25 21:02:09,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:02:09,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aa4d2b2b51e9ad97b1e6 HTTP/1.1" 200 None 2026-03-25 21:02:09,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:02:09,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 21:02:09,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:02:09,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1aa4d2b2b51e9ad97b1e6 HTTP/1.1" 200 None 2026-03-25 21:02:09,440 - lava_callback - ERROR - Error processing callback for node 69c1aa4d2b2b51e9ad97b1e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:04:09,237 - lava_callback - INFO - Received callback for node 69c1aac62b2b51e9ad97b218 INFO: 172.21.0.1:55948 - "POST /node/69c1aac62b2b51e9ad97b218 HTTP/1.0" 202 Accepted 2026-03-25 21:04:09,242 - lava_callback - INFO - Starting async job submit for node 69c1aac62b2b51e9ad97b218 2026-03-25 21:04:09,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:04:09,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aac62b2b51e9ad97b218 HTTP/1.1" 200 None 2026-03-25 21:04:09,269 - lava_callback - DEBUG - Processing node 69c1aac62b2b51e9ad97b218: baseline-arm-clabbe 2026-03-25 21:04:09,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1aac62b2b51e9ad97b218 2026-03-25 21:04:09,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:04:09,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aac62b2b51e9ad97b218 HTTP/1.1" 200 None 2026-03-25 21:04:09,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:04:09,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 21:04:09,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:04:09,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1aac62b2b51e9ad97b218 HTTP/1.1" 200 None 2026-03-25 21:04:09,330 - lava_callback - ERROR - Error processing callback for node 69c1aac62b2b51e9ad97b218: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51260 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:05:09,284 - lava_callback - INFO - Received callback for node 69c1aaef2b2b51e9ad97b230 INFO: 172.21.0.1:51262 - "POST /node/69c1aaef2b2b51e9ad97b230 HTTP/1.0" 202 Accepted 2026-03-25 21:05:09,289 - lava_callback - INFO - Starting async job submit for node 69c1aaef2b2b51e9ad97b230 2026-03-25 21:05:09,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:05:09,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aaef2b2b51e9ad97b230 HTTP/1.1" 200 None 2026-03-25 21:05:09,310 - lava_callback - DEBUG - Processing node 69c1aaef2b2b51e9ad97b230: baseline-arm-clabbe 2026-03-25 21:05:09,311 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1aaef2b2b51e9ad97b230 2026-03-25 21:05:09,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:05:09,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aaef2b2b51e9ad97b230 HTTP/1.1" 200 None 2026-03-25 21:05:09,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:05:09,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 21:05:09,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:05:09,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1aaef2b2b51e9ad97b230 HTTP/1.1" 200 None 2026-03-25 21:05:09,373 - lava_callback - ERROR - Error processing callback for node 69c1aaef2b2b51e9ad97b230: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48556 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:05:49,248 - lava_callback - INFO - Received callback for node 69c1ab172b2b51e9ad97b238 INFO: 172.21.0.1:48560 - "POST /node/69c1ab172b2b51e9ad97b238 HTTP/1.0" 202 Accepted 2026-03-25 21:05:49,254 - lava_callback - INFO - Starting async job submit for node 69c1ab172b2b51e9ad97b238 2026-03-25 21:05:49,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:05:49,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ab172b2b51e9ad97b238 HTTP/1.1" 200 None 2026-03-25 21:05:49,274 - lava_callback - DEBUG - Processing node 69c1ab172b2b51e9ad97b238: baseline-arm-clabbe 2026-03-25 21:05:49,274 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ab172b2b51e9ad97b238 2026-03-25 21:05:49,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:05:49,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ab172b2b51e9ad97b238 HTTP/1.1" 200 None 2026-03-25 21:05:49,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:05:49,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 21:05:49,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:05:49,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ab172b2b51e9ad97b238 HTTP/1.1" 200 None 2026-03-25 21:05:49,333 - lava_callback - ERROR - Error processing callback for node 69c1ab172b2b51e9ad97b238: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:06:29,349 - lava_callback - INFO - Received callback for node 69c1ab402b2b51e9ad97b249 INFO: 172.21.0.1:44400 - "POST /node/69c1ab402b2b51e9ad97b249 HTTP/1.0" 202 Accepted 2026-03-25 21:06:29,355 - lava_callback - INFO - Starting async job submit for node 69c1ab402b2b51e9ad97b249 2026-03-25 21:06:29,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:06:29,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ab402b2b51e9ad97b249 HTTP/1.1" 200 None 2026-03-25 21:06:29,371 - lava_callback - DEBUG - Processing node 69c1ab402b2b51e9ad97b249: baseline-arm-clabbe 2026-03-25 21:06:29,371 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ab402b2b51e9ad97b249 2026-03-25 21:06:29,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:06:29,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ab402b2b51e9ad97b249 HTTP/1.1" 200 None 2026-03-25 21:06:29,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:06:29,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 21:06:29,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:06:29,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ab402b2b51e9ad97b249 HTTP/1.1" 200 None 2026-03-25 21:06:29,437 - lava_callback - ERROR - Error processing callback for node 69c1ab402b2b51e9ad97b249: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52080 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:07:09,319 - lava_callback - INFO - Received callback for node 69c1ab682b2b51e9ad97b25b INFO: 172.21.0.1:52088 - "POST /node/69c1ab682b2b51e9ad97b25b HTTP/1.0" 202 Accepted 2026-03-25 21:07:09,324 - lava_callback - INFO - Starting async job submit for node 69c1ab682b2b51e9ad97b25b 2026-03-25 21:07:09,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:07:09,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ab682b2b51e9ad97b25b HTTP/1.1" 200 None 2026-03-25 21:07:09,342 - lava_callback - DEBUG - Processing node 69c1ab682b2b51e9ad97b25b: baseline-arm-clabbe 2026-03-25 21:07:09,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ab682b2b51e9ad97b25b 2026-03-25 21:07:09,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:07:09,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ab682b2b51e9ad97b25b HTTP/1.1" 200 None 2026-03-25 21:07:09,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:07:09,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 21:07:09,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:07:09,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ab682b2b51e9ad97b25b HTTP/1.1" 200 None 2026-03-25 21:07:09,403 - lava_callback - ERROR - Error processing callback for node 69c1ab682b2b51e9ad97b25b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33764 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:07:49,371 - lava_callback - INFO - Received callback for node 69c1ab8f2b2b51e9ad97b264 INFO: 172.21.0.1:33780 - "POST /node/69c1ab8f2b2b51e9ad97b264 HTTP/1.0" 202 Accepted 2026-03-25 21:07:49,376 - lava_callback - INFO - Starting async job submit for node 69c1ab8f2b2b51e9ad97b264 2026-03-25 21:07:49,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:07:49,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ab8f2b2b51e9ad97b264 HTTP/1.1" 200 None 2026-03-25 21:07:49,407 - lava_callback - DEBUG - Processing node 69c1ab8f2b2b51e9ad97b264: baseline-arm-clabbe 2026-03-25 21:07:49,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ab8f2b2b51e9ad97b264 2026-03-25 21:07:49,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:07:49,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ab8f2b2b51e9ad97b264 HTTP/1.1" 200 None 2026-03-25 21:07:49,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:07:49,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 21:07:49,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:07:49,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ab8f2b2b51e9ad97b264 HTTP/1.1" 200 None 2026-03-25 21:07:49,469 - lava_callback - ERROR - Error processing callback for node 69c1ab8f2b2b51e9ad97b264: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32968 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:08:29,348 - lava_callback - INFO - Received callback for node 69c1abb72b2b51e9ad97b26f INFO: 172.21.0.1:32978 - "POST /node/69c1abb72b2b51e9ad97b26f HTTP/1.0" 202 Accepted 2026-03-25 21:08:29,355 - lava_callback - INFO - Starting async job submit for node 69c1abb72b2b51e9ad97b26f 2026-03-25 21:08:29,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:29,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1abb72b2b51e9ad97b26f HTTP/1.1" 200 None 2026-03-25 21:08:29,381 - lava_callback - DEBUG - Processing node 69c1abb72b2b51e9ad97b26f: baseline-arm-clabbe 2026-03-25 21:08:29,381 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1abb72b2b51e9ad97b26f 2026-03-25 21:08:29,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:29,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1abb72b2b51e9ad97b26f HTTP/1.1" 200 None 2026-03-25 21:08:29,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:29,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 21:08:29,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:29,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1abb72b2b51e9ad97b26f HTTP/1.1" 200 None 2026-03-25 21:08:29,433 - lava_callback - ERROR - Error processing callback for node 69c1abb72b2b51e9ad97b26f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 21:08:31,691 - lava_callback - INFO - Received callback for node 69c433a9944faaf0e7f6167d INFO: 172.21.0.1:38488 - "POST /node/69c433a9944faaf0e7f6167d HTTP/1.0" 202 Accepted 2026-03-25 21:08:31,737 - lava_callback - INFO - Starting async job submit for node 69c433a9944faaf0e7f6167d 2026-03-25 21:08:31,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:31,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c433a9944faaf0e7f6167d HTTP/1.1" 200 None 2026-03-25 21:08:31,777 - lava_callback - DEBUG - Processing node 69c433a9944faaf0e7f6167d: baseline-arm-pengutronix 2026-03-25 21:08:31,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 21:08:32,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 21:08:32,104 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c433a9944faaf0e7f6167d/log.txt.gz 2026-03-25 21:08:32,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 21:08:32,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 21:08:32,395 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c433a9944faaf0e7f6167d/lava-logs.yaml 2026-03-25 21:08:32,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 21:08:32,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 21:08:32,536 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c433a9944faaf0e7f6167d/lava_callback.json.gz DEBUG: Setup failed for 69c433a9944faaf0e7f6167d. Transitting job node result: incomplete -> fail 2026-03-25 21:08:32,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:32,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c433a9944faaf0e7f6167d HTTP/1.1" 200 None 2026-03-25 21:08:32,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:32,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 21:08:32,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:32,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c433a9944faaf0e7f6167d HTTP/1.1" 200 None 2026-03-25 21:08:32,709 - lava_callback - INFO - Completed processing callback for node 69c433a9944faaf0e7f6167d INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:08:43,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:43,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:09:09,465 - lava_callback - INFO - Received callback for node 69c1abe02b2b51e9ad97b281 INFO: 172.21.0.1:55334 - "POST /node/69c1abe02b2b51e9ad97b281 HTTP/1.0" 202 Accepted 2026-03-25 21:09:09,470 - lava_callback - INFO - Starting async job submit for node 69c1abe02b2b51e9ad97b281 2026-03-25 21:09:09,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:09:09,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1abe02b2b51e9ad97b281 HTTP/1.1" 200 None 2026-03-25 21:09:09,486 - lava_callback - DEBUG - Processing node 69c1abe02b2b51e9ad97b281: baseline-arm-clabbe 2026-03-25 21:09:09,486 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1abe02b2b51e9ad97b281 2026-03-25 21:09:09,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:09:09,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1abe02b2b51e9ad97b281 HTTP/1.1" 200 None 2026-03-25 21:09:09,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:09:09,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 21:09:09,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:09:09,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1abe02b2b51e9ad97b281 HTTP/1.1" 200 None 2026-03-25 21:09:09,552 - lava_callback - ERROR - Error processing callback for node 69c1abe02b2b51e9ad97b281: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:09:49,393 - lava_callback - INFO - Received callback for node 69c1ac082b2b51e9ad97b289 INFO: 172.21.0.1:48860 - "POST /node/69c1ac082b2b51e9ad97b289 HTTP/1.0" 202 Accepted 2026-03-25 21:09:49,398 - lava_callback - INFO - Starting async job submit for node 69c1ac082b2b51e9ad97b289 2026-03-25 21:09:49,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:09:49,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ac082b2b51e9ad97b289 HTTP/1.1" 200 None 2026-03-25 21:09:49,415 - lava_callback - DEBUG - Processing node 69c1ac082b2b51e9ad97b289: baseline-arm-clabbe 2026-03-25 21:09:49,415 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ac082b2b51e9ad97b289 2026-03-25 21:09:49,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:09:49,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ac082b2b51e9ad97b289 HTTP/1.1" 200 None 2026-03-25 21:09:49,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:09:49,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 21:09:49,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:09:49,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ac082b2b51e9ad97b289 HTTP/1.1" 200 None 2026-03-25 21:09:49,467 - lava_callback - ERROR - Error processing callback for node 69c1ac082b2b51e9ad97b289: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38400 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:18:58,803 - lava_callback - INFO - Received callback for node 69c1ae332b2b51e9ad97b2e5 INFO: 172.21.0.1:38406 - "POST /node/69c1ae332b2b51e9ad97b2e5 HTTP/1.0" 202 Accepted 2026-03-25 21:18:58,808 - lava_callback - INFO - Starting async job submit for node 69c1ae332b2b51e9ad97b2e5 2026-03-25 21:18:58,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:18:58,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ae332b2b51e9ad97b2e5 HTTP/1.1" 200 None 2026-03-25 21:18:58,824 - lava_callback - DEBUG - Processing node 69c1ae332b2b51e9ad97b2e5: baseline-arm64-baylibre 2026-03-25 21:18:58,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ae332b2b51e9ad97b2e5 2026-03-25 21:18:58,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:18:58,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ae332b2b51e9ad97b2e5 HTTP/1.1" 200 None 2026-03-25 21:18:58,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:18:58,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:18:58,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:18:58,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ae332b2b51e9ad97b2e5 HTTP/1.1" 200 None 2026-03-25 21:18:58,876 - lava_callback - ERROR - Error processing callback for node 69c1ae332b2b51e9ad97b2e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:20:18,573 - lava_callback - INFO - Received callback for node 69c1ae8a2b2b51e9ad97b2f3 INFO: 172.21.0.1:48514 - "POST /node/69c1ae8a2b2b51e9ad97b2f3 HTTP/1.0" 202 Accepted 2026-03-25 21:20:18,579 - lava_callback - INFO - Starting async job submit for node 69c1ae8a2b2b51e9ad97b2f3 2026-03-25 21:20:18,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:20:18,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ae8a2b2b51e9ad97b2f3 HTTP/1.1" 200 None 2026-03-25 21:20:18,595 - lava_callback - DEBUG - Processing node 69c1ae8a2b2b51e9ad97b2f3: baseline-arm64-baylibre 2026-03-25 21:20:18,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ae8a2b2b51e9ad97b2f3 2026-03-25 21:20:18,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:20:18,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ae8a2b2b51e9ad97b2f3 HTTP/1.1" 200 None 2026-03-25 21:20:18,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:20:18,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:20:18,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:20:18,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ae8a2b2b51e9ad97b2f3 HTTP/1.1" 200 None 2026-03-25 21:20:18,655 - lava_callback - ERROR - Error processing callback for node 69c1ae8a2b2b51e9ad97b2f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43276 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:21:38,655 - lava_callback - INFO - Received callback for node 69c1aee02b2b51e9ad97b2fc INFO: 172.21.0.1:43282 - "POST /node/69c1aee02b2b51e9ad97b2fc HTTP/1.0" 202 Accepted 2026-03-25 21:21:38,661 - lava_callback - INFO - Starting async job submit for node 69c1aee02b2b51e9ad97b2fc 2026-03-25 21:21:38,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:21:38,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aee02b2b51e9ad97b2fc HTTP/1.1" 200 None 2026-03-25 21:21:38,699 - lava_callback - DEBUG - Processing node 69c1aee02b2b51e9ad97b2fc: baseline-arm64-baylibre 2026-03-25 21:21:38,699 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1aee02b2b51e9ad97b2fc 2026-03-25 21:21:38,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:21:38,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aee02b2b51e9ad97b2fc HTTP/1.1" 200 None 2026-03-25 21:21:38,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:21:38,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:21:38,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:21:38,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1aee02b2b51e9ad97b2fc HTTP/1.1" 200 None 2026-03-25 21:21:38,750 - lava_callback - ERROR - Error processing callback for node 69c1aee02b2b51e9ad97b2fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36116 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:24:38,882 - lava_callback - INFO - Received callback for node 69c1af892b2b51e9ad97b31a INFO: 172.21.0.1:36122 - "POST /node/69c1af892b2b51e9ad97b31a HTTP/1.0" 202 Accepted 2026-03-25 21:24:38,892 - lava_callback - INFO - Starting async job submit for node 69c1af892b2b51e9ad97b31a 2026-03-25 21:24:38,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:24:38,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1af892b2b51e9ad97b31a HTTP/1.1" 200 None 2026-03-25 21:24:38,918 - lava_callback - DEBUG - Processing node 69c1af892b2b51e9ad97b31a: baseline-arm64-baylibre 2026-03-25 21:24:38,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1af892b2b51e9ad97b31a 2026-03-25 21:24:38,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:24:38,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1af892b2b51e9ad97b31a HTTP/1.1" 200 None 2026-03-25 21:24:38,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:24:38,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:24:38,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:24:38,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1af892b2b51e9ad97b31a HTTP/1.1" 200 None 2026-03-25 21:24:38,974 - lava_callback - ERROR - Error processing callback for node 69c1af892b2b51e9ad97b31a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:25:58,869 - lava_callback - INFO - Received callback for node 69c1afe02b2b51e9ad97b327 INFO: 172.21.0.1:60844 - "POST /node/69c1afe02b2b51e9ad97b327 HTTP/1.0" 202 Accepted 2026-03-25 21:25:58,874 - lava_callback - INFO - Starting async job submit for node 69c1afe02b2b51e9ad97b327 2026-03-25 21:25:58,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:25:58,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1afe02b2b51e9ad97b327 HTTP/1.1" 200 None 2026-03-25 21:25:58,901 - lava_callback - DEBUG - Processing node 69c1afe02b2b51e9ad97b327: baseline-arm64-baylibre 2026-03-25 21:25:58,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1afe02b2b51e9ad97b327 2026-03-25 21:25:58,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:25:58,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1afe02b2b51e9ad97b327 HTTP/1.1" 200 None 2026-03-25 21:25:58,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:25:58,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:25:58,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:25:58,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1afe02b2b51e9ad97b327 HTTP/1.1" 200 None 2026-03-25 21:25:58,971 - lava_callback - ERROR - Error processing callback for node 69c1afe02b2b51e9ad97b327: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56500 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:27:39,201 - lava_callback - INFO - Received callback for node 69c1b0362b2b51e9ad97b335 INFO: 172.21.0.1:56516 - "POST /node/69c1b0362b2b51e9ad97b335 HTTP/1.0" 202 Accepted 2026-03-25 21:27:39,207 - lava_callback - INFO - Starting async job submit for node 69c1b0362b2b51e9ad97b335 2026-03-25 21:27:39,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:27:39,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b0362b2b51e9ad97b335 HTTP/1.1" 200 None 2026-03-25 21:27:39,227 - lava_callback - DEBUG - Processing node 69c1b0362b2b51e9ad97b335: baseline-arm64-baylibre 2026-03-25 21:27:39,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b0362b2b51e9ad97b335 2026-03-25 21:27:39,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:27:39,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b0362b2b51e9ad97b335 HTTP/1.1" 200 None 2026-03-25 21:27:39,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:27:39,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:27:39,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:27:39,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b0362b2b51e9ad97b335 HTTP/1.1" 200 None 2026-03-25 21:27:39,294 - lava_callback - ERROR - Error processing callback for node 69c1b0362b2b51e9ad97b335: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48420 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:28:50,302 - lava_callback - INFO - Received callback for node 69c1b0842b2b51e9ad97b33b INFO: 172.21.0.1:39582 - "POST /node/69c1b0842b2b51e9ad97b33b HTTP/1.0" 202 Accepted 2026-03-25 21:28:50,308 - lava_callback - INFO - Starting async job submit for node 69c1b0842b2b51e9ad97b33b 2026-03-25 21:28:50,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:28:50,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b0842b2b51e9ad97b33b HTTP/1.1" 200 None 2026-03-25 21:28:50,325 - lava_callback - DEBUG - Processing node 69c1b0842b2b51e9ad97b33b: baseline-arm-clabbe 2026-03-25 21:28:50,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b0842b2b51e9ad97b33b 2026-03-25 21:28:50,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:28:50,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b0842b2b51e9ad97b33b HTTP/1.1" 200 None 2026-03-25 21:28:50,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:28:50,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 21:28:50,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:28:50,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b0842b2b51e9ad97b33b HTTP/1.1" 200 None 2026-03-25 21:28:50,383 - lava_callback - ERROR - Error processing callback for node 69c1b0842b2b51e9ad97b33b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60622 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:29:22,033 - lava_callback - INFO - Received callback for node 69c411ae944faaf0e7f60e58 INFO: 172.21.0.1:44296 - "POST /node/69c411ae944faaf0e7f60e58 HTTP/1.0" 202 Accepted 2026-03-25 21:29:22,039 - lava_callback - INFO - Starting async job submit for node 69c411ae944faaf0e7f60e58 2026-03-25 21:29:22,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:22,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411ae944faaf0e7f60e58 HTTP/1.1" 200 None 2026-03-25 21:29:22,084 - lava_callback - DEBUG - Processing node 69c411ae944faaf0e7f60e58: baseline-arm64-broonie 2026-03-25 21:29:22,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 21:29:22,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 21:29:22,526 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411ae944faaf0e7f60e58/log.txt.gz 2026-03-25 21:29:22,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 21:29:22,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 21:29:22,899 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411ae944faaf0e7f60e58/lava-logs.yaml 2026-03-25 21:29:22,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 21:29:23,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 21:29:23,066 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411ae944faaf0e7f60e58/lava_callback.json.gz 2026-03-25 21:29:23,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:23,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411ae944faaf0e7f60e58 HTTP/1.1" 200 None 2026-03-25 21:29:23,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:23,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 21:29:23,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:23,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411ae944faaf0e7f60e58 HTTP/1.1" 200 None 2026-03-25 21:29:23,151 - lava_callback - INFO - Completed processing callback for node 69c411ae944faaf0e7f60e58 INFO: 172.21.0.1:44306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58820 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:29:43,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:43,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60948 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:29:50,301 - lava_callback - INFO - Received callback for node 69c1b0bb2b2b51e9ad97b34b INFO: 172.21.0.1:33130 - "POST /node/69c1b0bb2b2b51e9ad97b34b HTTP/1.0" 202 Accepted 2026-03-25 21:29:50,307 - lava_callback - INFO - Starting async job submit for node 69c1b0bb2b2b51e9ad97b34b 2026-03-25 21:29:50,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:50,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b0bb2b2b51e9ad97b34b HTTP/1.1" 200 None 2026-03-25 21:29:50,323 - lava_callback - DEBUG - Processing node 69c1b0bb2b2b51e9ad97b34b: baseline-arm64-clabbe 2026-03-25 21:29:50,323 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b0bb2b2b51e9ad97b34b 2026-03-25 21:29:50,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:50,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b0bb2b2b51e9ad97b34b HTTP/1.1" 200 None 2026-03-25 21:29:50,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:50,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:29:50,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:50,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b0bb2b2b51e9ad97b34b HTTP/1.1" 200 None 2026-03-25 21:29:50,380 - lava_callback - ERROR - Error processing callback for node 69c1b0bb2b2b51e9ad97b34b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:31:10,329 - lava_callback - INFO - Received callback for node 69c1b1102b2b51e9ad97b358 INFO: 172.21.0.1:41978 - "POST /node/69c1b1102b2b51e9ad97b358 HTTP/1.0" 202 Accepted 2026-03-25 21:31:10,334 - lava_callback - INFO - Starting async job submit for node 69c1b1102b2b51e9ad97b358 2026-03-25 21:31:10,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:31:10,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b1102b2b51e9ad97b358 HTTP/1.1" 200 None 2026-03-25 21:31:10,363 - lava_callback - DEBUG - Processing node 69c1b1102b2b51e9ad97b358: baseline-arm64-clabbe 2026-03-25 21:31:10,363 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b1102b2b51e9ad97b358 2026-03-25 21:31:10,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:31:10,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b1102b2b51e9ad97b358 HTTP/1.1" 200 None 2026-03-25 21:31:10,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:31:10,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:31:10,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:31:10,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b1102b2b51e9ad97b358 HTTP/1.1" 200 None 2026-03-25 21:31:10,420 - lava_callback - ERROR - Error processing callback for node 69c1b1102b2b51e9ad97b358: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:32:30,364 - lava_callback - INFO - Received callback for node 69c1b1652b2b51e9ad97b36a INFO: 172.21.0.1:52530 - "POST /node/69c1b1652b2b51e9ad97b36a HTTP/1.0" 202 Accepted 2026-03-25 21:32:30,370 - lava_callback - INFO - Starting async job submit for node 69c1b1652b2b51e9ad97b36a 2026-03-25 21:32:30,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:32:30,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b1652b2b51e9ad97b36a HTTP/1.1" 200 None 2026-03-25 21:32:30,395 - lava_callback - DEBUG - Processing node 69c1b1652b2b51e9ad97b36a: baseline-arm64-clabbe 2026-03-25 21:32:30,395 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b1652b2b51e9ad97b36a 2026-03-25 21:32:30,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:32:30,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b1652b2b51e9ad97b36a HTTP/1.1" 200 None 2026-03-25 21:32:30,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:32:30,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:32:30,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:32:30,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b1652b2b51e9ad97b36a HTTP/1.1" 200 None 2026-03-25 21:32:30,459 - lava_callback - ERROR - Error processing callback for node 69c1b1652b2b51e9ad97b36a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:34:10,491 - lava_callback - INFO - Received callback for node 69c1b1bd2b2b51e9ad97b378 INFO: 172.21.0.1:38974 - "POST /node/69c1b1bd2b2b51e9ad97b378 HTTP/1.0" 202 Accepted 2026-03-25 21:34:10,497 - lava_callback - INFO - Starting async job submit for node 69c1b1bd2b2b51e9ad97b378 2026-03-25 21:34:10,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:34:10,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b1bd2b2b51e9ad97b378 HTTP/1.1" 200 None 2026-03-25 21:34:10,515 - lava_callback - DEBUG - Processing node 69c1b1bd2b2b51e9ad97b378: baseline-arm64-clabbe 2026-03-25 21:34:10,515 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b1bd2b2b51e9ad97b378 2026-03-25 21:34:10,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:34:10,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b1bd2b2b51e9ad97b378 HTTP/1.1" 200 None 2026-03-25 21:34:10,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:34:10,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:34:10,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:34:10,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b1bd2b2b51e9ad97b378 HTTP/1.1" 200 None 2026-03-25 21:34:10,572 - lava_callback - ERROR - Error processing callback for node 69c1b1bd2b2b51e9ad97b378: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:35:30,537 - lava_callback - INFO - Received callback for node 69c1b2152b2b51e9ad97b382 INFO: 172.21.0.1:59156 - "POST /node/69c1b2152b2b51e9ad97b382 HTTP/1.0" 202 Accepted 2026-03-25 21:35:30,542 - lava_callback - INFO - Starting async job submit for node 69c1b2152b2b51e9ad97b382 2026-03-25 21:35:30,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:35:30,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b2152b2b51e9ad97b382 HTTP/1.1" 200 None 2026-03-25 21:35:30,558 - lava_callback - DEBUG - Processing node 69c1b2152b2b51e9ad97b382: baseline-arm64-clabbe 2026-03-25 21:35:30,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b2152b2b51e9ad97b382 2026-03-25 21:35:30,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:35:30,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b2152b2b51e9ad97b382 HTTP/1.1" 200 None 2026-03-25 21:35:30,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:35:30,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:35:30,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:35:30,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b2152b2b51e9ad97b382 HTTP/1.1" 200 None 2026-03-25 21:35:30,617 - lava_callback - ERROR - Error processing callback for node 69c1b2152b2b51e9ad97b382: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53102 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:36:50,603 - lava_callback - INFO - Received callback for node 69c1b26b2b2b51e9ad97b38f INFO: 172.21.0.1:48780 - "POST /node/69c1b26b2b2b51e9ad97b38f HTTP/1.0" 202 Accepted 2026-03-25 21:36:50,610 - lava_callback - INFO - Starting async job submit for node 69c1b26b2b2b51e9ad97b38f 2026-03-25 21:36:50,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:36:50,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b26b2b2b51e9ad97b38f HTTP/1.1" 200 None 2026-03-25 21:36:50,626 - lava_callback - DEBUG - Processing node 69c1b26b2b2b51e9ad97b38f: baseline-arm64-clabbe 2026-03-25 21:36:50,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b26b2b2b51e9ad97b38f 2026-03-25 21:36:50,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:36:50,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b26b2b2b51e9ad97b38f HTTP/1.1" 200 None 2026-03-25 21:36:50,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:36:50,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:36:50,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:36:50,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b26b2b2b51e9ad97b38f HTTP/1.1" 200 None 2026-03-25 21:36:50,685 - lava_callback - ERROR - Error processing callback for node 69c1b26b2b2b51e9ad97b38f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:58:20,802 - lava_callback - INFO - Received callback for node 69c1b77a2b2b51e9ad97b3df INFO: 172.21.0.1:39434 - "POST /node/69c1b77a2b2b51e9ad97b3df HTTP/1.0" 202 Accepted 2026-03-25 21:58:20,807 - lava_callback - INFO - Starting async job submit for node 69c1b77a2b2b51e9ad97b3df 2026-03-25 21:58:20,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:58:20,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b77a2b2b51e9ad97b3df HTTP/1.1" 200 None 2026-03-25 21:58:20,825 - lava_callback - DEBUG - Processing node 69c1b77a2b2b51e9ad97b3df: baseline-arm64-baylibre 2026-03-25 21:58:20,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b77a2b2b51e9ad97b3df 2026-03-25 21:58:20,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:58:20,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b77a2b2b51e9ad97b3df HTTP/1.1" 200 None 2026-03-25 21:58:20,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:58:20,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 21:58:20,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:58:20,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b77a2b2b51e9ad97b3df HTTP/1.1" 200 None 2026-03-25 21:58:20,886 - lava_callback - ERROR - Error processing callback for node 69c1b77a2b2b51e9ad97b3df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:00:00,725 - lava_callback - INFO - Received callback for node 69c1b7d02b2b51e9ad97b3ef INFO: 172.21.0.1:43144 - "POST /node/69c1b7d02b2b51e9ad97b3ef HTTP/1.0" 202 Accepted 2026-03-25 22:00:00,731 - lava_callback - INFO - Starting async job submit for node 69c1b7d02b2b51e9ad97b3ef 2026-03-25 22:00:00,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:00:00,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b7d02b2b51e9ad97b3ef HTTP/1.1" 200 None 2026-03-25 22:00:00,747 - lava_callback - DEBUG - Processing node 69c1b7d02b2b51e9ad97b3ef: baseline-arm64-baylibre 2026-03-25 22:00:00,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b7d02b2b51e9ad97b3ef 2026-03-25 22:00:00,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:00:00,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b7d02b2b51e9ad97b3ef HTTP/1.1" 200 None 2026-03-25 22:00:00,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:00:00,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:00:00,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:00:00,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b7d02b2b51e9ad97b3ef HTTP/1.1" 200 None 2026-03-25 22:00:00,820 - lava_callback - ERROR - Error processing callback for node 69c1b7d02b2b51e9ad97b3ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:02:20,841 - lava_callback - INFO - Received callback for node 69c1b8572b2b51e9ad97b405 INFO: 172.21.0.1:50120 - "POST /node/69c1b8572b2b51e9ad97b405 HTTP/1.0" 202 Accepted 2026-03-25 22:02:20,847 - lava_callback - INFO - Starting async job submit for node 69c1b8572b2b51e9ad97b405 2026-03-25 22:02:20,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:02:20,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b8572b2b51e9ad97b405 HTTP/1.1" 200 None 2026-03-25 22:02:20,862 - lava_callback - DEBUG - Processing node 69c1b8572b2b51e9ad97b405: baseline-arm64-baylibre 2026-03-25 22:02:20,863 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b8572b2b51e9ad97b405 2026-03-25 22:02:20,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:02:20,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b8572b2b51e9ad97b405 HTTP/1.1" 200 None 2026-03-25 22:02:20,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:02:20,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:02:20,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:02:20,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b8572b2b51e9ad97b405 HTTP/1.1" 200 None 2026-03-25 22:02:20,965 - lava_callback - ERROR - Error processing callback for node 69c1b8572b2b51e9ad97b405: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38664 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:03:40,928 - lava_callback - INFO - Received callback for node 69c1b8af2b2b51e9ad97b41b INFO: 172.21.0.1:49750 - "POST /node/69c1b8af2b2b51e9ad97b41b HTTP/1.0" 202 Accepted 2026-03-25 22:03:40,933 - lava_callback - INFO - Starting async job submit for node 69c1b8af2b2b51e9ad97b41b 2026-03-25 22:03:40,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:03:40,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b8af2b2b51e9ad97b41b HTTP/1.1" 200 None 2026-03-25 22:03:40,949 - lava_callback - DEBUG - Processing node 69c1b8af2b2b51e9ad97b41b: baseline-arm64-baylibre 2026-03-25 22:03:40,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b8af2b2b51e9ad97b41b 2026-03-25 22:03:40,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:03:40,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b8af2b2b51e9ad97b41b HTTP/1.1" 200 None 2026-03-25 22:03:40,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:03:40,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:03:40,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:03:41,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b8af2b2b51e9ad97b41b HTTP/1.1" 200 None 2026-03-25 22:03:41,007 - lava_callback - ERROR - Error processing callback for node 69c1b8af2b2b51e9ad97b41b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33670 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:05:01,030 - lava_callback - INFO - Received callback for node 69c1b9072b2b51e9ad97b42f INFO: 172.21.0.1:36156 - "POST /node/69c1b9072b2b51e9ad97b42f HTTP/1.0" 202 Accepted 2026-03-25 22:05:01,036 - lava_callback - INFO - Starting async job submit for node 69c1b9072b2b51e9ad97b42f 2026-03-25 22:05:01,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:05:01,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b9072b2b51e9ad97b42f HTTP/1.1" 200 None 2026-03-25 22:05:01,073 - lava_callback - DEBUG - Processing node 69c1b9072b2b51e9ad97b42f: baseline-arm64-baylibre 2026-03-25 22:05:01,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b9072b2b51e9ad97b42f 2026-03-25 22:05:01,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:05:01,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b9072b2b51e9ad97b42f HTTP/1.1" 200 None 2026-03-25 22:05:01,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:05:01,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:05:01,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:05:01,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b9072b2b51e9ad97b42f HTTP/1.1" 200 None 2026-03-25 22:05:01,128 - lava_callback - ERROR - Error processing callback for node 69c1b9072b2b51e9ad97b42f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42622 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:06:31,841 - lava_callback - INFO - Received callback for node 69c1b9612b2b51e9ad97b442 INFO: 172.21.0.1:39520 - "POST /node/69c1b9612b2b51e9ad97b442 HTTP/1.0" 202 Accepted 2026-03-25 22:06:31,848 - lava_callback - INFO - Starting async job submit for node 69c1b9612b2b51e9ad97b442 2026-03-25 22:06:31,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:06:31,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b9612b2b51e9ad97b442 HTTP/1.1" 200 None 2026-03-25 22:06:31,865 - lava_callback - DEBUG - Processing node 69c1b9612b2b51e9ad97b442: baseline-arm64-clabbe 2026-03-25 22:06:31,865 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b9612b2b51e9ad97b442 2026-03-25 22:06:31,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:06:31,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b9612b2b51e9ad97b442 HTTP/1.1" 200 None 2026-03-25 22:06:31,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:06:31,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:06:31,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:06:31,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b9612b2b51e9ad97b442 HTTP/1.1" 200 None 2026-03-25 22:06:31,932 - lava_callback - ERROR - Error processing callback for node 69c1b9612b2b51e9ad97b442: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55918 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:08:11,784 - lava_callback - INFO - Received callback for node 69c1b9b62b2b51e9ad97b457 INFO: 172.21.0.1:43778 - "POST /node/69c1b9b62b2b51e9ad97b457 HTTP/1.0" 202 Accepted 2026-03-25 22:08:11,789 - lava_callback - INFO - Starting async job submit for node 69c1b9b62b2b51e9ad97b457 2026-03-25 22:08:11,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:08:11,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b9b62b2b51e9ad97b457 HTTP/1.1" 200 None 2026-03-25 22:08:11,805 - lava_callback - DEBUG - Processing node 69c1b9b62b2b51e9ad97b457: baseline-arm64-clabbe 2026-03-25 22:08:11,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b9b62b2b51e9ad97b457 2026-03-25 22:08:11,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:08:11,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b9b62b2b51e9ad97b457 HTTP/1.1" 200 None 2026-03-25 22:08:11,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:08:11,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:08:11,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:08:11,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b9b62b2b51e9ad97b457 HTTP/1.1" 200 None 2026-03-25 22:08:11,863 - lava_callback - ERROR - Error processing callback for node 69c1b9b62b2b51e9ad97b457: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:09:31,839 - lava_callback - INFO - Received callback for node 69c1ba0e2b2b51e9ad97b465 INFO: 172.21.0.1:45768 - "POST /node/69c1ba0e2b2b51e9ad97b465 HTTP/1.0" 202 Accepted 2026-03-25 22:09:31,844 - lava_callback - INFO - Starting async job submit for node 69c1ba0e2b2b51e9ad97b465 2026-03-25 22:09:31,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:09:31,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ba0e2b2b51e9ad97b465 HTTP/1.1" 200 None 2026-03-25 22:09:31,860 - lava_callback - DEBUG - Processing node 69c1ba0e2b2b51e9ad97b465: baseline-arm64-clabbe 2026-03-25 22:09:31,860 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ba0e2b2b51e9ad97b465 2026-03-25 22:09:31,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:09:31,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ba0e2b2b51e9ad97b465 HTTP/1.1" 200 None 2026-03-25 22:09:31,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:09:31,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:09:31,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:09:31,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ba0e2b2b51e9ad97b465 HTTP/1.1" 200 None 2026-03-25 22:09:31,921 - lava_callback - ERROR - Error processing callback for node 69c1ba0e2b2b51e9ad97b465: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:10:51,861 - lava_callback - INFO - Received callback for node 69c1ba682b2b51e9ad97b47b INFO: 172.21.0.1:41736 - "POST /node/69c1ba682b2b51e9ad97b47b HTTP/1.0" 202 Accepted 2026-03-25 22:10:51,867 - lava_callback - INFO - Starting async job submit for node 69c1ba682b2b51e9ad97b47b 2026-03-25 22:10:51,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:10:51,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ba682b2b51e9ad97b47b HTTP/1.1" 200 None 2026-03-25 22:10:51,883 - lava_callback - DEBUG - Processing node 69c1ba682b2b51e9ad97b47b: baseline-arm64-clabbe 2026-03-25 22:10:51,883 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ba682b2b51e9ad97b47b 2026-03-25 22:10:51,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:10:51,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ba682b2b51e9ad97b47b HTTP/1.1" 200 None 2026-03-25 22:10:51,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:10:51,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:10:51,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:10:51,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ba682b2b51e9ad97b47b HTTP/1.1" 200 None 2026-03-25 22:10:51,934 - lava_callback - ERROR - Error processing callback for node 69c1ba682b2b51e9ad97b47b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60534 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:12:31,922 - lava_callback - INFO - Received callback for node 69c1bac02b2b51e9ad97b48e INFO: 172.21.0.1:36146 - "POST /node/69c1bac02b2b51e9ad97b48e HTTP/1.0" 202 Accepted 2026-03-25 22:12:31,928 - lava_callback - INFO - Starting async job submit for node 69c1bac02b2b51e9ad97b48e 2026-03-25 22:12:31,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:12:31,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1bac02b2b51e9ad97b48e HTTP/1.1" 200 None 2026-03-25 22:12:31,947 - lava_callback - DEBUG - Processing node 69c1bac02b2b51e9ad97b48e: baseline-arm64-clabbe 2026-03-25 22:12:31,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1bac02b2b51e9ad97b48e 2026-03-25 22:12:31,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:12:31,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1bac02b2b51e9ad97b48e HTTP/1.1" 200 None 2026-03-25 22:12:31,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:12:31,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:12:31,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:12:32,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1bac02b2b51e9ad97b48e HTTP/1.1" 200 None 2026-03-25 22:12:32,007 - lava_callback - ERROR - Error processing callback for node 69c1bac02b2b51e9ad97b48e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59876 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:13:51,964 - lava_callback - INFO - Received callback for node 69c1bb172b2b51e9ad97b4a0 INFO: 172.21.0.1:48520 - "POST /node/69c1bb172b2b51e9ad97b4a0 HTTP/1.0" 202 Accepted 2026-03-25 22:13:51,969 - lava_callback - INFO - Starting async job submit for node 69c1bb172b2b51e9ad97b4a0 2026-03-25 22:13:51,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:13:51,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1bb172b2b51e9ad97b4a0 HTTP/1.1" 200 None 2026-03-25 22:13:51,985 - lava_callback - DEBUG - Processing node 69c1bb172b2b51e9ad97b4a0: baseline-arm64-clabbe 2026-03-25 22:13:51,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1bb172b2b51e9ad97b4a0 2026-03-25 22:13:51,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:13:51,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1bb172b2b51e9ad97b4a0 HTTP/1.1" 200 None 2026-03-25 22:13:52,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:13:52,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:13:52,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:13:52,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1bb172b2b51e9ad97b4a0 HTTP/1.1" 200 None 2026-03-25 22:13:52,037 - lava_callback - ERROR - Error processing callback for node 69c1bb172b2b51e9ad97b4a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58174 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:15:12,087 - lava_callback - INFO - Received callback for node 69c1bb6c2b2b51e9ad97b4b5 INFO: 172.21.0.1:51100 - "POST /node/69c1bb6c2b2b51e9ad97b4b5 HTTP/1.0" 202 Accepted 2026-03-25 22:15:12,092 - lava_callback - INFO - Starting async job submit for node 69c1bb6c2b2b51e9ad97b4b5 2026-03-25 22:15:12,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:15:12,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1bb6c2b2b51e9ad97b4b5 HTTP/1.1" 200 None 2026-03-25 22:15:12,108 - lava_callback - DEBUG - Processing node 69c1bb6c2b2b51e9ad97b4b5: baseline-arm64-clabbe 2026-03-25 22:15:12,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1bb6c2b2b51e9ad97b4b5 2026-03-25 22:15:12,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:15:12,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1bb6c2b2b51e9ad97b4b5 HTTP/1.1" 200 None 2026-03-25 22:15:12,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:15:12,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:15:12,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:15:12,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1bb6c2b2b51e9ad97b4b5 HTTP/1.1" 200 None 2026-03-25 22:15:12,173 - lava_callback - ERROR - Error processing callback for node 69c1bb6c2b2b51e9ad97b4b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36790 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:41:22,996 - lava_callback - INFO - Received callback for node 69c1c1852b2b51e9ad97b51d INFO: 172.21.0.1:39580 - "POST /node/69c1c1852b2b51e9ad97b51d HTTP/1.0" 202 Accepted 2026-03-25 22:41:23,002 - lava_callback - INFO - Starting async job submit for node 69c1c1852b2b51e9ad97b51d 2026-03-25 22:41:23,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:41:23,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c1852b2b51e9ad97b51d HTTP/1.1" 200 None 2026-03-25 22:41:23,018 - lava_callback - DEBUG - Processing node 69c1c1852b2b51e9ad97b51d: baseline-arm-baylibre 2026-03-25 22:41:23,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c1852b2b51e9ad97b51d 2026-03-25 22:41:23,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:41:23,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c1852b2b51e9ad97b51d HTTP/1.1" 200 None 2026-03-25 22:41:23,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:41:23,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:41:23,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:41:23,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c1852b2b51e9ad97b51d HTTP/1.1" 200 None 2026-03-25 22:41:23,075 - lava_callback - ERROR - Error processing callback for node 69c1c1852b2b51e9ad97b51d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35904 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:42:02,940 - lava_callback - INFO - Received callback for node 69c1c1ae2b2b51e9ad97b529 INFO: 172.21.0.1:60222 - "POST /node/69c1c1ae2b2b51e9ad97b529 HTTP/1.0" 202 Accepted 2026-03-25 22:42:02,945 - lava_callback - INFO - Starting async job submit for node 69c1c1ae2b2b51e9ad97b529 2026-03-25 22:42:02,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:42:02,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c1ae2b2b51e9ad97b529 HTTP/1.1" 200 None 2026-03-25 22:42:02,966 - lava_callback - DEBUG - Processing node 69c1c1ae2b2b51e9ad97b529: baseline-arm-baylibre 2026-03-25 22:42:02,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c1ae2b2b51e9ad97b529 2026-03-25 22:42:02,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:42:02,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c1ae2b2b51e9ad97b529 HTTP/1.1" 200 None 2026-03-25 22:42:02,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:42:02,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:42:02,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:42:03,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c1ae2b2b51e9ad97b529 HTTP/1.1" 200 None 2026-03-25 22:42:03,023 - lava_callback - ERROR - Error processing callback for node 69c1c1ae2b2b51e9ad97b529: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:42:43,025 - lava_callback - INFO - Received callback for node 69c1c1d52b2b51e9ad97b530 INFO: 172.21.0.1:47078 - "POST /node/69c1c1d52b2b51e9ad97b530 HTTP/1.0" 202 Accepted 2026-03-25 22:42:43,033 - lava_callback - INFO - Starting async job submit for node 69c1c1d52b2b51e9ad97b530 2026-03-25 22:42:43,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:42:43,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c1d52b2b51e9ad97b530 HTTP/1.1" 200 None 2026-03-25 22:42:43,062 - lava_callback - DEBUG - Processing node 69c1c1d52b2b51e9ad97b530: baseline-arm-baylibre 2026-03-25 22:42:43,063 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c1d52b2b51e9ad97b530 2026-03-25 22:42:43,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:42:43,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c1d52b2b51e9ad97b530 HTTP/1.1" 200 None 2026-03-25 22:42:43,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:42:43,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:42:43,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:42:43,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c1d52b2b51e9ad97b530 HTTP/1.1" 200 None 2026-03-25 22:42:43,123 - lava_callback - ERROR - Error processing callback for node 69c1c1d52b2b51e9ad97b530: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44268 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:43:22,997 - lava_callback - INFO - Received callback for node 69c1c1fe2b2b51e9ad97b53a INFO: 172.21.0.1:57408 - "POST /node/69c1c1fe2b2b51e9ad97b53a HTTP/1.0" 202 Accepted 2026-03-25 22:43:23,004 - lava_callback - INFO - Starting async job submit for node 69c1c1fe2b2b51e9ad97b53a 2026-03-25 22:43:23,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:43:23,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c1fe2b2b51e9ad97b53a HTTP/1.1" 200 None 2026-03-25 22:43:23,021 - lava_callback - DEBUG - Processing node 69c1c1fe2b2b51e9ad97b53a: baseline-arm-baylibre 2026-03-25 22:43:23,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c1fe2b2b51e9ad97b53a 2026-03-25 22:43:23,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:43:23,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c1fe2b2b51e9ad97b53a HTTP/1.1" 200 None 2026-03-25 22:43:23,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:43:23,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:43:23,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:43:23,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c1fe2b2b51e9ad97b53a HTTP/1.1" 200 None 2026-03-25 22:43:23,083 - lava_callback - ERROR - Error processing callback for node 69c1c1fe2b2b51e9ad97b53a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40936 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:44:03,115 - lava_callback - INFO - Received callback for node 69c1c22a2b2b51e9ad97b546 INFO: 172.21.0.1:41990 - "POST /node/69c1c22a2b2b51e9ad97b546 HTTP/1.0" 202 Accepted 2026-03-25 22:44:03,120 - lava_callback - INFO - Starting async job submit for node 69c1c22a2b2b51e9ad97b546 2026-03-25 22:44:03,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:44:03,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c22a2b2b51e9ad97b546 HTTP/1.1" 200 None 2026-03-25 22:44:03,139 - lava_callback - DEBUG - Processing node 69c1c22a2b2b51e9ad97b546: baseline-arm-baylibre 2026-03-25 22:44:03,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c22a2b2b51e9ad97b546 2026-03-25 22:44:03,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:44:03,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c22a2b2b51e9ad97b546 HTTP/1.1" 200 None 2026-03-25 22:44:03,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:44:03,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:44:03,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:44:03,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c22a2b2b51e9ad97b546 HTTP/1.1" 200 None 2026-03-25 22:44:03,232 - lava_callback - ERROR - Error processing callback for node 69c1c22a2b2b51e9ad97b546: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56328 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:44:43,069 - lava_callback - INFO - Received callback for node 69c1c2512b2b51e9ad97b550 INFO: 172.21.0.1:35150 - "POST /node/69c1c2512b2b51e9ad97b550 HTTP/1.0" 202 Accepted 2026-03-25 22:44:43,075 - lava_callback - INFO - Starting async job submit for node 69c1c2512b2b51e9ad97b550 2026-03-25 22:44:43,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:44:43,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c2512b2b51e9ad97b550 HTTP/1.1" 200 None 2026-03-25 22:44:43,091 - lava_callback - DEBUG - Processing node 69c1c2512b2b51e9ad97b550: baseline-arm-baylibre 2026-03-25 22:44:43,091 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c2512b2b51e9ad97b550 2026-03-25 22:44:43,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:44:43,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c2512b2b51e9ad97b550 HTTP/1.1" 200 None 2026-03-25 22:44:43,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:44:43,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:44:43,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:44:43,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c2512b2b51e9ad97b550 HTTP/1.1" 200 None 2026-03-25 22:44:43,144 - lava_callback - ERROR - Error processing callback for node 69c1c2512b2b51e9ad97b550: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40522 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:46:53,387 - lava_callback - INFO - Received callback for node 69c1c2ca2b2b51e9ad97b56f INFO: 172.21.0.1:40538 - "POST /node/69c1c2ca2b2b51e9ad97b56f HTTP/1.0" 202 Accepted 2026-03-25 22:46:53,393 - lava_callback - INFO - Starting async job submit for node 69c1c2ca2b2b51e9ad97b56f 2026-03-25 22:46:53,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:46:53,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c2ca2b2b51e9ad97b56f HTTP/1.1" 200 None 2026-03-25 22:46:53,413 - lava_callback - DEBUG - Processing node 69c1c2ca2b2b51e9ad97b56f: baseline-arm-clabbe 2026-03-25 22:46:53,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c2ca2b2b51e9ad97b56f 2026-03-25 22:46:53,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:46:53,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c2ca2b2b51e9ad97b56f HTTP/1.1" 200 None 2026-03-25 22:46:53,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:46:53,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:46:53,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:46:53,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c2ca2b2b51e9ad97b56f HTTP/1.1" 200 None 2026-03-25 22:46:53,468 - lava_callback - ERROR - Error processing callback for node 69c1c2ca2b2b51e9ad97b56f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49212 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:47:33,371 - lava_callback - INFO - Received callback for node 69c1c2f22b2b51e9ad97b578 INFO: 172.21.0.1:41496 - "POST /node/69c1c2f22b2b51e9ad97b578 HTTP/1.0" 202 Accepted 2026-03-25 22:47:33,377 - lava_callback - INFO - Starting async job submit for node 69c1c2f22b2b51e9ad97b578 2026-03-25 22:47:33,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:47:33,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c2f22b2b51e9ad97b578 HTTP/1.1" 200 None 2026-03-25 22:47:33,392 - lava_callback - DEBUG - Processing node 69c1c2f22b2b51e9ad97b578: baseline-arm-clabbe 2026-03-25 22:47:33,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c2f22b2b51e9ad97b578 2026-03-25 22:47:33,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:47:33,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c2f22b2b51e9ad97b578 HTTP/1.1" 200 None 2026-03-25 22:47:33,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:47:33,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:47:33,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:47:33,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c2f22b2b51e9ad97b578 HTTP/1.1" 200 None 2026-03-25 22:47:33,465 - lava_callback - ERROR - Error processing callback for node 69c1c2f22b2b51e9ad97b578: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:48:13,469 - lava_callback - INFO - Received callback for node 69c1c31a2b2b51e9ad97b584 INFO: 172.21.0.1:56590 - "POST /node/69c1c31a2b2b51e9ad97b584 HTTP/1.0" 202 Accepted 2026-03-25 22:48:13,474 - lava_callback - INFO - Starting async job submit for node 69c1c31a2b2b51e9ad97b584 2026-03-25 22:48:13,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:48:13,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c31a2b2b51e9ad97b584 HTTP/1.1" 200 None 2026-03-25 22:48:13,490 - lava_callback - DEBUG - Processing node 69c1c31a2b2b51e9ad97b584: baseline-arm-clabbe 2026-03-25 22:48:13,490 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c31a2b2b51e9ad97b584 2026-03-25 22:48:13,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:48:13,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c31a2b2b51e9ad97b584 HTTP/1.1" 200 None 2026-03-25 22:48:13,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:48:13,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:48:13,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:48:13,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c31a2b2b51e9ad97b584 HTTP/1.1" 200 None 2026-03-25 22:48:13,540 - lava_callback - ERROR - Error processing callback for node 69c1c31a2b2b51e9ad97b584: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39492 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:48:53,411 - lava_callback - INFO - Received callback for node 69c1c3432b2b51e9ad97b58b INFO: 172.21.0.1:39506 - "POST /node/69c1c3432b2b51e9ad97b58b HTTP/1.0" 202 Accepted 2026-03-25 22:48:53,417 - lava_callback - INFO - Starting async job submit for node 69c1c3432b2b51e9ad97b58b 2026-03-25 22:48:53,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:48:53,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c3432b2b51e9ad97b58b HTTP/1.1" 200 None 2026-03-25 22:48:53,433 - lava_callback - DEBUG - Processing node 69c1c3432b2b51e9ad97b58b: baseline-arm-clabbe 2026-03-25 22:48:53,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c3432b2b51e9ad97b58b 2026-03-25 22:48:53,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:48:53,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c3432b2b51e9ad97b58b HTTP/1.1" 200 None 2026-03-25 22:48:53,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:48:53,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:48:53,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:48:53,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c3432b2b51e9ad97b58b HTTP/1.1" 200 None 2026-03-25 22:48:53,499 - lava_callback - ERROR - Error processing callback for node 69c1c3432b2b51e9ad97b58b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51438 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:49:33,511 - lava_callback - INFO - Received callback for node 69c1c36a2b2b51e9ad97b597 INFO: 172.21.0.1:57782 - "POST /node/69c1c36a2b2b51e9ad97b597 HTTP/1.0" 202 Accepted 2026-03-25 22:49:33,517 - lava_callback - INFO - Starting async job submit for node 69c1c36a2b2b51e9ad97b597 2026-03-25 22:49:33,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:49:33,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c36a2b2b51e9ad97b597 HTTP/1.1" 200 None 2026-03-25 22:49:33,534 - lava_callback - DEBUG - Processing node 69c1c36a2b2b51e9ad97b597: baseline-arm-clabbe 2026-03-25 22:49:33,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c36a2b2b51e9ad97b597 2026-03-25 22:49:33,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:49:33,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c36a2b2b51e9ad97b597 HTTP/1.1" 200 None 2026-03-25 22:49:33,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:49:33,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:49:33,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:49:33,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c36a2b2b51e9ad97b597 HTTP/1.1" 200 None 2026-03-25 22:49:33,609 - lava_callback - ERROR - Error processing callback for node 69c1c36a2b2b51e9ad97b597: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:59:44,048 - lava_callback - INFO - Received callback for node 69c1c5dd2b2b51e9ad97b5b1 INFO: 172.21.0.1:60742 - "POST /node/69c1c5dd2b2b51e9ad97b5b1 HTTP/1.0" 202 Accepted 2026-03-25 22:59:44,054 - lava_callback - INFO - Starting async job submit for node 69c1c5dd2b2b51e9ad97b5b1 2026-03-25 22:59:44,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:59:44,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c5dd2b2b51e9ad97b5b1 HTTP/1.1" 200 None 2026-03-25 22:59:44,071 - lava_callback - DEBUG - Processing node 69c1c5dd2b2b51e9ad97b5b1: baseline-arm64-baylibre 2026-03-25 22:59:44,071 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c5dd2b2b51e9ad97b5b1 2026-03-25 22:59:44,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:59:44,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c5dd2b2b51e9ad97b5b1 HTTP/1.1" 200 None 2026-03-25 22:59:44,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:59:44,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 22:59:44,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:59:44,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c5dd2b2b51e9ad97b5b1 HTTP/1.1" 200 None 2026-03-25 22:59:44,131 - lava_callback - ERROR - Error processing callback for node 69c1c5dd2b2b51e9ad97b5b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41422 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:01:24,024 - lava_callback - INFO - Received callback for node 69c1c6352b2b51e9ad97b5c4 INFO: 172.21.0.1:34224 - "POST /node/69c1c6352b2b51e9ad97b5c4 HTTP/1.0" 202 Accepted 2026-03-25 23:01:24,029 - lava_callback - INFO - Starting async job submit for node 69c1c6352b2b51e9ad97b5c4 2026-03-25 23:01:24,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:01:24,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c6352b2b51e9ad97b5c4 HTTP/1.1" 200 None 2026-03-25 23:01:24,046 - lava_callback - DEBUG - Processing node 69c1c6352b2b51e9ad97b5c4: baseline-arm64-baylibre 2026-03-25 23:01:24,046 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c6352b2b51e9ad97b5c4 2026-03-25 23:01:24,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:01:24,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c6352b2b51e9ad97b5c4 HTTP/1.1" 200 None 2026-03-25 23:01:24,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:01:24,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:01:24,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:01:24,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c6352b2b51e9ad97b5c4 HTTP/1.1" 200 None 2026-03-25 23:01:24,115 - lava_callback - ERROR - Error processing callback for node 69c1c6352b2b51e9ad97b5c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:02:44,103 - lava_callback - INFO - Received callback for node 69c1c6882b2b51e9ad97b5da INFO: 172.21.0.1:57314 - "POST /node/69c1c6882b2b51e9ad97b5da HTTP/1.0" 202 Accepted 2026-03-25 23:02:44,109 - lava_callback - INFO - Starting async job submit for node 69c1c6882b2b51e9ad97b5da 2026-03-25 23:02:44,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:02:44,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c6882b2b51e9ad97b5da HTTP/1.1" 200 None 2026-03-25 23:02:44,126 - lava_callback - DEBUG - Processing node 69c1c6882b2b51e9ad97b5da: baseline-arm64-baylibre 2026-03-25 23:02:44,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c6882b2b51e9ad97b5da 2026-03-25 23:02:44,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:02:44,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c6882b2b51e9ad97b5da HTTP/1.1" 200 None 2026-03-25 23:02:44,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:02:44,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:02:44,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:02:44,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c6882b2b51e9ad97b5da HTTP/1.1" 200 None 2026-03-25 23:02:44,203 - lava_callback - ERROR - Error processing callback for node 69c1c6882b2b51e9ad97b5da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:04:04,285 - lava_callback - INFO - Received callback for node 69c1c6db2b2b51e9ad97b5ee INFO: 172.21.0.1:53524 - "POST /node/69c1c6db2b2b51e9ad97b5ee HTTP/1.0" 202 Accepted 2026-03-25 23:04:04,300 - lava_callback - INFO - Starting async job submit for node 69c1c6db2b2b51e9ad97b5ee 2026-03-25 23:04:04,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:04:04,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c6db2b2b51e9ad97b5ee HTTP/1.1" 200 None 2026-03-25 23:04:04,337 - lava_callback - DEBUG - Processing node 69c1c6db2b2b51e9ad97b5ee: baseline-arm64-baylibre 2026-03-25 23:04:04,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c6db2b2b51e9ad97b5ee 2026-03-25 23:04:04,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:04:04,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c6db2b2b51e9ad97b5ee HTTP/1.1" 200 None 2026-03-25 23:04:04,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:04:04,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:04:04,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:04:04,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c6db2b2b51e9ad97b5ee HTTP/1.1" 200 None 2026-03-25 23:04:04,427 - lava_callback - ERROR - Error processing callback for node 69c1c6db2b2b51e9ad97b5ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:05:24,358 - lava_callback - INFO - Received callback for node 69c1c72f2b2b51e9ad97b5ff INFO: 172.21.0.1:53966 - "POST /node/69c1c72f2b2b51e9ad97b5ff HTTP/1.0" 202 Accepted 2026-03-25 23:05:24,364 - lava_callback - INFO - Starting async job submit for node 69c1c72f2b2b51e9ad97b5ff 2026-03-25 23:05:24,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:05:24,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c72f2b2b51e9ad97b5ff HTTP/1.1" 200 None 2026-03-25 23:05:24,380 - lava_callback - DEBUG - Processing node 69c1c72f2b2b51e9ad97b5ff: baseline-arm64-baylibre 2026-03-25 23:05:24,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c72f2b2b51e9ad97b5ff 2026-03-25 23:05:24,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:05:24,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c72f2b2b51e9ad97b5ff HTTP/1.1" 200 None 2026-03-25 23:05:24,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:05:24,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:05:24,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:05:24,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c72f2b2b51e9ad97b5ff HTTP/1.1" 200 None 2026-03-25 23:05:24,455 - lava_callback - ERROR - Error processing callback for node 69c1c72f2b2b51e9ad97b5ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39220 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:07:04,319 - lava_callback - INFO - Received callback for node 69c1c7862b2b51e9ad97b611 INFO: 172.21.0.1:47196 - "POST /node/69c1c7862b2b51e9ad97b611 HTTP/1.0" 202 Accepted 2026-03-25 23:07:04,324 - lava_callback - INFO - Starting async job submit for node 69c1c7862b2b51e9ad97b611 2026-03-25 23:07:04,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:07:04,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c7862b2b51e9ad97b611 HTTP/1.1" 200 None 2026-03-25 23:07:04,341 - lava_callback - DEBUG - Processing node 69c1c7862b2b51e9ad97b611: baseline-arm64-baylibre 2026-03-25 23:07:04,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c7862b2b51e9ad97b611 2026-03-25 23:07:04,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:07:04,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c7862b2b51e9ad97b611 HTTP/1.1" 200 None 2026-03-25 23:07:04,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:07:04,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:07:04,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:07:04,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c7862b2b51e9ad97b611 HTTP/1.1" 200 None 2026-03-25 23:07:04,394 - lava_callback - ERROR - Error processing callback for node 69c1c7862b2b51e9ad97b611: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56786 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:08:24,404 - lava_callback - INFO - Received callback for node 69c1c7dc2b2b51e9ad97b62a INFO: 172.21.0.1:37912 - "POST /node/69c1c7dc2b2b51e9ad97b62a HTTP/1.0" 202 Accepted 2026-03-25 23:08:24,409 - lava_callback - INFO - Starting async job submit for node 69c1c7dc2b2b51e9ad97b62a 2026-03-25 23:08:24,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:08:24,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c7dc2b2b51e9ad97b62a HTTP/1.1" 200 None 2026-03-25 23:08:24,426 - lava_callback - DEBUG - Processing node 69c1c7dc2b2b51e9ad97b62a: baseline-arm64-baylibre 2026-03-25 23:08:24,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c7dc2b2b51e9ad97b62a 2026-03-25 23:08:24,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:08:24,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c7dc2b2b51e9ad97b62a HTTP/1.1" 200 None 2026-03-25 23:08:24,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:08:24,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:08:24,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:08:24,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c7dc2b2b51e9ad97b62a HTTP/1.1" 200 None 2026-03-25 23:08:24,484 - lava_callback - ERROR - Error processing callback for node 69c1c7dc2b2b51e9ad97b62a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41834 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:09:44,491 - lava_callback - INFO - Received callback for node 69c1c82e2b2b51e9ad97b63c INFO: 172.21.0.1:53248 - "POST /node/69c1c82e2b2b51e9ad97b63c HTTP/1.0" 202 Accepted 2026-03-25 23:09:44,497 - lava_callback - INFO - Starting async job submit for node 69c1c82e2b2b51e9ad97b63c 2026-03-25 23:09:44,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:09:44,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c82e2b2b51e9ad97b63c HTTP/1.1" 200 None 2026-03-25 23:09:44,513 - lava_callback - DEBUG - Processing node 69c1c82e2b2b51e9ad97b63c: baseline-arm64-baylibre 2026-03-25 23:09:44,514 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c82e2b2b51e9ad97b63c 2026-03-25 23:09:44,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:09:44,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c82e2b2b51e9ad97b63c HTTP/1.1" 200 None 2026-03-25 23:09:44,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:09:44,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:09:44,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:09:44,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c82e2b2b51e9ad97b63c HTTP/1.1" 200 None 2026-03-25 23:09:44,578 - lava_callback - ERROR - Error processing callback for node 69c1c82e2b2b51e9ad97b63c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36594 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:11:04,567 - lava_callback - INFO - Received callback for node 69c1c87f2b2b51e9ad97b651 INFO: 172.21.0.1:54578 - "POST /node/69c1c87f2b2b51e9ad97b651 HTTP/1.0" 202 Accepted 2026-03-25 23:11:04,573 - lava_callback - INFO - Starting async job submit for node 69c1c87f2b2b51e9ad97b651 2026-03-25 23:11:04,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:11:04,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c87f2b2b51e9ad97b651 HTTP/1.1" 200 None 2026-03-25 23:11:04,589 - lava_callback - DEBUG - Processing node 69c1c87f2b2b51e9ad97b651: baseline-arm64-baylibre 2026-03-25 23:11:04,589 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c87f2b2b51e9ad97b651 2026-03-25 23:11:04,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:11:04,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c87f2b2b51e9ad97b651 HTTP/1.1" 200 None 2026-03-25 23:11:04,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:11:04,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:11:04,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:11:04,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c87f2b2b51e9ad97b651 HTTP/1.1" 200 None 2026-03-25 23:11:04,640 - lava_callback - ERROR - Error processing callback for node 69c1c87f2b2b51e9ad97b651: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:12:44,664 - lava_callback - INFO - Received callback for node 69c1c8d82b2b51e9ad97b666 INFO: 172.21.0.1:50250 - "POST /node/69c1c8d82b2b51e9ad97b666 HTTP/1.0" 202 Accepted 2026-03-25 23:12:44,669 - lava_callback - INFO - Starting async job submit for node 69c1c8d82b2b51e9ad97b666 2026-03-25 23:12:44,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:12:44,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c8d82b2b51e9ad97b666 HTTP/1.1" 200 None 2026-03-25 23:12:44,693 - lava_callback - DEBUG - Processing node 69c1c8d82b2b51e9ad97b666: baseline-arm64-baylibre 2026-03-25 23:12:44,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c8d82b2b51e9ad97b666 2026-03-25 23:12:44,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:12:44,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c8d82b2b51e9ad97b666 HTTP/1.1" 200 None 2026-03-25 23:12:44,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:12:44,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:12:44,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:12:44,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c8d82b2b51e9ad97b666 HTTP/1.1" 200 None 2026-03-25 23:12:44,744 - lava_callback - ERROR - Error processing callback for node 69c1c8d82b2b51e9ad97b666: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52194 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:14:04,720 - lava_callback - INFO - Received callback for node 69c1c92f2b2b51e9ad97b677 INFO: 172.21.0.1:55554 - "POST /node/69c1c92f2b2b51e9ad97b677 HTTP/1.0" 202 Accepted 2026-03-25 23:14:04,726 - lava_callback - INFO - Starting async job submit for node 69c1c92f2b2b51e9ad97b677 2026-03-25 23:14:04,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:14:04,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c92f2b2b51e9ad97b677 HTTP/1.1" 200 None 2026-03-25 23:14:04,742 - lava_callback - DEBUG - Processing node 69c1c92f2b2b51e9ad97b677: baseline-arm64-baylibre 2026-03-25 23:14:04,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c92f2b2b51e9ad97b677 2026-03-25 23:14:04,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:14:04,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c92f2b2b51e9ad97b677 HTTP/1.1" 200 None 2026-03-25 23:14:04,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:14:04,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:14:04,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:14:04,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c92f2b2b51e9ad97b677 HTTP/1.1" 200 None 2026-03-25 23:14:04,814 - lava_callback - ERROR - Error processing callback for node 69c1c92f2b2b51e9ad97b677: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:15:24,788 - lava_callback - INFO - Received callback for node 69c1c9832b2b51e9ad97b681 INFO: 172.21.0.1:60404 - "POST /node/69c1c9832b2b51e9ad97b681 HTTP/1.0" 202 Accepted 2026-03-25 23:15:24,794 - lava_callback - INFO - Starting async job submit for node 69c1c9832b2b51e9ad97b681 2026-03-25 23:15:24,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:15:24,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c9832b2b51e9ad97b681 HTTP/1.1" 200 None 2026-03-25 23:15:24,810 - lava_callback - DEBUG - Processing node 69c1c9832b2b51e9ad97b681: baseline-arm64-baylibre 2026-03-25 23:15:24,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c9832b2b51e9ad97b681 2026-03-25 23:15:24,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:15:24,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c9832b2b51e9ad97b681 HTTP/1.1" 200 None 2026-03-25 23:15:24,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:15:24,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:15:24,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:15:24,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c9832b2b51e9ad97b681 HTTP/1.1" 200 None 2026-03-25 23:15:24,867 - lava_callback - ERROR - Error processing callback for node 69c1c9832b2b51e9ad97b681: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:16:54,711 - lava_callback - INFO - Received callback for node 69c1c9dc2b2b51e9ad97b695 INFO: 172.21.0.1:55748 - "POST /node/69c1c9dc2b2b51e9ad97b695 HTTP/1.0" 202 Accepted 2026-03-25 23:16:54,717 - lava_callback - INFO - Starting async job submit for node 69c1c9dc2b2b51e9ad97b695 2026-03-25 23:16:54,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:16:54,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c9dc2b2b51e9ad97b695 HTTP/1.1" 200 None 2026-03-25 23:16:54,739 - lava_callback - DEBUG - Processing node 69c1c9dc2b2b51e9ad97b695: baseline-arm64-clabbe 2026-03-25 23:16:54,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c9dc2b2b51e9ad97b695 2026-03-25 23:16:54,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:16:54,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c9dc2b2b51e9ad97b695 HTTP/1.1" 200 None 2026-03-25 23:16:54,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:16:54,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:16:54,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:16:54,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c9dc2b2b51e9ad97b695 HTTP/1.1" 200 None 2026-03-25 23:16:54,812 - lava_callback - ERROR - Error processing callback for node 69c1c9dc2b2b51e9ad97b695: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47960 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:18:14,766 - lava_callback - INFO - Received callback for node 69c1ca312b2b51e9ad97b6af INFO: 172.21.0.1:45534 - "POST /node/69c1ca312b2b51e9ad97b6af HTTP/1.0" 202 Accepted 2026-03-25 23:18:14,772 - lava_callback - INFO - Starting async job submit for node 69c1ca312b2b51e9ad97b6af 2026-03-25 23:18:14,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:18:14,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ca312b2b51e9ad97b6af HTTP/1.1" 200 None 2026-03-25 23:18:14,789 - lava_callback - DEBUG - Processing node 69c1ca312b2b51e9ad97b6af: baseline-arm64-clabbe 2026-03-25 23:18:14,790 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ca312b2b51e9ad97b6af 2026-03-25 23:18:14,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:18:14,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ca312b2b51e9ad97b6af HTTP/1.1" 200 None 2026-03-25 23:18:14,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:18:14,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:18:14,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:18:14,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ca312b2b51e9ad97b6af HTTP/1.1" 200 None 2026-03-25 23:18:14,844 - lava_callback - ERROR - Error processing callback for node 69c1ca312b2b51e9ad97b6af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51378 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:19:54,794 - lava_callback - INFO - Received callback for node 69c1ca892b2b51e9ad97b6c6 INFO: 172.21.0.1:51386 - "POST /node/69c1ca892b2b51e9ad97b6c6 HTTP/1.0" 202 Accepted 2026-03-25 23:19:54,799 - lava_callback - INFO - Starting async job submit for node 69c1ca892b2b51e9ad97b6c6 2026-03-25 23:19:54,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:19:54,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ca892b2b51e9ad97b6c6 HTTP/1.1" 200 None 2026-03-25 23:19:54,815 - lava_callback - DEBUG - Processing node 69c1ca892b2b51e9ad97b6c6: baseline-arm64-clabbe 2026-03-25 23:19:54,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ca892b2b51e9ad97b6c6 2026-03-25 23:19:54,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:19:54,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ca892b2b51e9ad97b6c6 HTTP/1.1" 200 None 2026-03-25 23:19:54,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:19:54,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:19:54,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:19:54,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ca892b2b51e9ad97b6c6 HTTP/1.1" 200 None 2026-03-25 23:19:54,916 - lava_callback - ERROR - Error processing callback for node 69c1ca892b2b51e9ad97b6c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:21:14,831 - lava_callback - INFO - Received callback for node 69c1cadf2b2b51e9ad97b6e0 INFO: 172.21.0.1:50378 - "POST /node/69c1cadf2b2b51e9ad97b6e0 HTTP/1.0" 202 Accepted 2026-03-25 23:21:14,837 - lava_callback - INFO - Starting async job submit for node 69c1cadf2b2b51e9ad97b6e0 2026-03-25 23:21:14,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:21:14,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cadf2b2b51e9ad97b6e0 HTTP/1.1" 200 None 2026-03-25 23:21:14,853 - lava_callback - DEBUG - Processing node 69c1cadf2b2b51e9ad97b6e0: baseline-arm64-clabbe 2026-03-25 23:21:14,853 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cadf2b2b51e9ad97b6e0 2026-03-25 23:21:14,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:21:14,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cadf2b2b51e9ad97b6e0 HTTP/1.1" 200 None 2026-03-25 23:21:14,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:21:14,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:21:14,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:21:14,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cadf2b2b51e9ad97b6e0 HTTP/1.1" 200 None 2026-03-25 23:21:14,917 - lava_callback - ERROR - Error processing callback for node 69c1cadf2b2b51e9ad97b6e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:22:34,893 - lava_callback - INFO - Received callback for node 69c1cb322b2b51e9ad97b6fa INFO: 172.21.0.1:46118 - "POST /node/69c1cb322b2b51e9ad97b6fa HTTP/1.0" 202 Accepted 2026-03-25 23:22:34,898 - lava_callback - INFO - Starting async job submit for node 69c1cb322b2b51e9ad97b6fa 2026-03-25 23:22:34,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:22:34,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cb322b2b51e9ad97b6fa HTTP/1.1" 200 None 2026-03-25 23:22:34,914 - lava_callback - DEBUG - Processing node 69c1cb322b2b51e9ad97b6fa: baseline-arm64-clabbe 2026-03-25 23:22:34,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cb322b2b51e9ad97b6fa 2026-03-25 23:22:34,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:22:34,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cb322b2b51e9ad97b6fa HTTP/1.1" 200 None 2026-03-25 23:22:34,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:22:34,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:22:34,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:22:34,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cb322b2b51e9ad97b6fa HTTP/1.1" 200 None 2026-03-25 23:22:34,976 - lava_callback - ERROR - Error processing callback for node 69c1cb322b2b51e9ad97b6fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:23:54,939 - lava_callback - INFO - Received callback for node 69c1cb862b2b51e9ad97b70c INFO: 172.21.0.1:59016 - "POST /node/69c1cb862b2b51e9ad97b70c HTTP/1.0" 202 Accepted 2026-03-25 23:23:54,944 - lava_callback - INFO - Starting async job submit for node 69c1cb862b2b51e9ad97b70c 2026-03-25 23:23:54,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:23:54,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cb862b2b51e9ad97b70c HTTP/1.1" 200 None 2026-03-25 23:23:54,961 - lava_callback - DEBUG - Processing node 69c1cb862b2b51e9ad97b70c: baseline-arm64-clabbe 2026-03-25 23:23:54,962 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cb862b2b51e9ad97b70c 2026-03-25 23:23:54,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:23:54,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cb862b2b51e9ad97b70c HTTP/1.1" 200 None 2026-03-25 23:23:54,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:23:54,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:23:54,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:23:55,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cb862b2b51e9ad97b70c HTTP/1.1" 200 None 2026-03-25 23:23:55,044 - lava_callback - ERROR - Error processing callback for node 69c1cb862b2b51e9ad97b70c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:25:35,054 - lava_callback - INFO - Received callback for node 69c1cbdb2b2b51e9ad97b726 INFO: 172.21.0.1:54058 - "POST /node/69c1cbdb2b2b51e9ad97b726 HTTP/1.0" 202 Accepted 2026-03-25 23:25:35,061 - lava_callback - INFO - Starting async job submit for node 69c1cbdb2b2b51e9ad97b726 2026-03-25 23:25:35,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:25:35,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cbdb2b2b51e9ad97b726 HTTP/1.1" 200 None 2026-03-25 23:25:35,079 - lava_callback - DEBUG - Processing node 69c1cbdb2b2b51e9ad97b726: baseline-arm64-clabbe 2026-03-25 23:25:35,079 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cbdb2b2b51e9ad97b726 2026-03-25 23:25:35,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:25:35,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cbdb2b2b51e9ad97b726 HTTP/1.1" 200 None 2026-03-25 23:25:35,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:25:35,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:25:35,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:25:35,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cbdb2b2b51e9ad97b726 HTTP/1.1" 200 None 2026-03-25 23:25:35,149 - lava_callback - ERROR - Error processing callback for node 69c1cbdb2b2b51e9ad97b726: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35618 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:26:55,062 - lava_callback - INFO - Received callback for node 69c1cc302b2b51e9ad97b739 INFO: 172.21.0.1:35632 - "POST /node/69c1cc302b2b51e9ad97b739 HTTP/1.0" 202 Accepted 2026-03-25 23:26:55,067 - lava_callback - INFO - Starting async job submit for node 69c1cc302b2b51e9ad97b739 2026-03-25 23:26:55,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:26:55,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cc302b2b51e9ad97b739 HTTP/1.1" 200 None 2026-03-25 23:26:55,083 - lava_callback - DEBUG - Processing node 69c1cc302b2b51e9ad97b739: baseline-arm64-clabbe 2026-03-25 23:26:55,084 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cc302b2b51e9ad97b739 2026-03-25 23:26:55,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:26:55,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cc302b2b51e9ad97b739 HTTP/1.1" 200 None 2026-03-25 23:26:55,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:26:55,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:26:55,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:26:55,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cc302b2b51e9ad97b739 HTTP/1.1" 200 None 2026-03-25 23:26:55,155 - lava_callback - ERROR - Error processing callback for node 69c1cc302b2b51e9ad97b739: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60566 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 23:28:15,181 - lava_callback - INFO - Received callback for node 69c1cc832b2b51e9ad97b747 INFO: 172.21.0.1:60580 - "POST /node/69c1cc832b2b51e9ad97b747 HTTP/1.0" 202 Accepted 2026-03-25 23:28:15,186 - lava_callback - INFO - Starting async job submit for node 69c1cc832b2b51e9ad97b747 2026-03-25 23:28:15,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:28:15,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cc832b2b51e9ad97b747 HTTP/1.1" 200 None 2026-03-25 23:28:15,202 - lava_callback - DEBUG - Processing node 69c1cc832b2b51e9ad97b747: baseline-arm64-clabbe 2026-03-25 23:28:15,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cc832b2b51e9ad97b747 2026-03-25 23:28:15,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:28:15,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cc832b2b51e9ad97b747 HTTP/1.1" 200 None 2026-03-25 23:28:15,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:28:15,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:28:15,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:28:15,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cc832b2b51e9ad97b747 HTTP/1.1" 200 None 2026-03-25 23:28:15,260 - lava_callback - ERROR - Error processing callback for node 69c1cc832b2b51e9ad97b747: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60694 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:29:35,180 - lava_callback - INFO - Received callback for node 69c1ccd72b2b51e9ad97b757 INFO: 172.21.0.1:44156 - "POST /node/69c1ccd72b2b51e9ad97b757 HTTP/1.0" 202 Accepted 2026-03-25 23:29:35,186 - lava_callback - INFO - Starting async job submit for node 69c1ccd72b2b51e9ad97b757 2026-03-25 23:29:35,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:29:35,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ccd72b2b51e9ad97b757 HTTP/1.1" 200 None 2026-03-25 23:29:35,201 - lava_callback - DEBUG - Processing node 69c1ccd72b2b51e9ad97b757: baseline-arm64-clabbe 2026-03-25 23:29:35,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ccd72b2b51e9ad97b757 2026-03-25 23:29:35,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:29:35,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ccd72b2b51e9ad97b757 HTTP/1.1" 200 None 2026-03-25 23:29:35,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:29:35,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:29:35,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:29:35,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ccd72b2b51e9ad97b757 HTTP/1.1" 200 None 2026-03-25 23:29:35,252 - lava_callback - ERROR - Error processing callback for node 69c1ccd72b2b51e9ad97b757: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 23:31:15,261 - lava_callback - INFO - Received callback for node 69c1cd2e2b2b51e9ad97b769 INFO: 172.21.0.1:36558 - "POST /node/69c1cd2e2b2b51e9ad97b769 HTTP/1.0" 202 Accepted 2026-03-25 23:31:15,266 - lava_callback - INFO - Starting async job submit for node 69c1cd2e2b2b51e9ad97b769 2026-03-25 23:31:15,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:31:15,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cd2e2b2b51e9ad97b769 HTTP/1.1" 200 None 2026-03-25 23:31:15,282 - lava_callback - DEBUG - Processing node 69c1cd2e2b2b51e9ad97b769: baseline-arm64-clabbe 2026-03-25 23:31:15,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cd2e2b2b51e9ad97b769 2026-03-25 23:31:15,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:31:15,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cd2e2b2b51e9ad97b769 HTTP/1.1" 200 None 2026-03-25 23:31:15,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:31:15,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:31:15,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:31:15,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cd2e2b2b51e9ad97b769 HTTP/1.1" 200 None 2026-03-25 23:31:15,336 - lava_callback - ERROR - Error processing callback for node 69c1cd2e2b2b51e9ad97b769: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:32:05,791 - lava_callback - INFO - Received callback for node 69c1cd6f2b2b51e9ad97b778 INFO: 172.21.0.1:52180 - "POST /node/69c1cd6f2b2b51e9ad97b778 HTTP/1.0" 202 Accepted 2026-03-25 23:32:05,797 - lava_callback - INFO - Starting async job submit for node 69c1cd6f2b2b51e9ad97b778 2026-03-25 23:32:05,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:32:05,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cd6f2b2b51e9ad97b778 HTTP/1.1" 200 None 2026-03-25 23:32:05,813 - lava_callback - DEBUG - Processing node 69c1cd6f2b2b51e9ad97b778: baseline-arm-baylibre 2026-03-25 23:32:05,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cd6f2b2b51e9ad97b778 2026-03-25 23:32:05,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:32:05,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cd6f2b2b51e9ad97b778 HTTP/1.1" 200 None 2026-03-25 23:32:05,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:32:05,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:32:05,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:32:05,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cd6f2b2b51e9ad97b778 HTTP/1.1" 200 None 2026-03-25 23:32:05,863 - lava_callback - ERROR - Error processing callback for node 69c1cd6f2b2b51e9ad97b778: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53064 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:32:45,701 - lava_callback - INFO - Received callback for node 69c1cd962b2b51e9ad97b783 INFO: 172.21.0.1:41016 - "POST /node/69c1cd962b2b51e9ad97b783 HTTP/1.0" 202 Accepted 2026-03-25 23:32:45,706 - lava_callback - INFO - Starting async job submit for node 69c1cd962b2b51e9ad97b783 2026-03-25 23:32:45,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:32:45,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cd962b2b51e9ad97b783 HTTP/1.1" 200 None 2026-03-25 23:32:45,722 - lava_callback - DEBUG - Processing node 69c1cd962b2b51e9ad97b783: baseline-arm-baylibre 2026-03-25 23:32:45,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cd962b2b51e9ad97b783 2026-03-25 23:32:45,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:32:45,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cd962b2b51e9ad97b783 HTTP/1.1" 200 None 2026-03-25 23:32:45,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:32:45,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:32:45,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:32:45,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cd962b2b51e9ad97b783 HTTP/1.1" 200 None 2026-03-25 23:32:45,793 - lava_callback - ERROR - Error processing callback for node 69c1cd962b2b51e9ad97b783: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:33:25,746 - lava_callback - INFO - Received callback for node 69c1cdbe2b2b51e9ad97b78c INFO: 172.21.0.1:57966 - "POST /node/69c1cdbe2b2b51e9ad97b78c HTTP/1.0" 202 Accepted 2026-03-25 23:33:25,751 - lava_callback - INFO - Starting async job submit for node 69c1cdbe2b2b51e9ad97b78c 2026-03-25 23:33:25,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:33:25,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cdbe2b2b51e9ad97b78c HTTP/1.1" 200 None 2026-03-25 23:33:25,768 - lava_callback - DEBUG - Processing node 69c1cdbe2b2b51e9ad97b78c: baseline-arm-baylibre 2026-03-25 23:33:25,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cdbe2b2b51e9ad97b78c 2026-03-25 23:33:25,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:33:25,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cdbe2b2b51e9ad97b78c HTTP/1.1" 200 None 2026-03-25 23:33:25,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:33:25,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:33:25,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:33:25,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cdbe2b2b51e9ad97b78c HTTP/1.1" 200 None 2026-03-25 23:33:25,836 - lava_callback - ERROR - Error processing callback for node 69c1cdbe2b2b51e9ad97b78c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50216 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:34:35,385 - lava_callback - INFO - Received callback for node 69c1cdf92b2b51e9ad97b798 INFO: 172.21.0.1:40470 - "POST /node/69c1cdf92b2b51e9ad97b798 HTTP/1.0" 202 Accepted 2026-03-25 23:34:35,391 - lava_callback - INFO - Starting async job submit for node 69c1cdf92b2b51e9ad97b798 2026-03-25 23:34:35,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:34:35,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cdf92b2b51e9ad97b798 HTTP/1.1" 200 None 2026-03-25 23:34:35,407 - lava_callback - DEBUG - Processing node 69c1cdf92b2b51e9ad97b798: baseline-arm64-clabbe 2026-03-25 23:34:35,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cdf92b2b51e9ad97b798 2026-03-25 23:34:35,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:34:35,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cdf92b2b51e9ad97b798 HTTP/1.1" 200 None 2026-03-25 23:34:35,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:34:35,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:34:35,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:34:35,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cdf92b2b51e9ad97b798 HTTP/1.1" 200 None 2026-03-25 23:34:35,465 - lava_callback - ERROR - Error processing callback for node 69c1cdf92b2b51e9ad97b798: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54016 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:35:25,885 - lava_callback - INFO - Received callback for node 69c1ce3a2b2b51e9ad97b7b2 INFO: 172.21.0.1:39620 - "POST /node/69c1ce3a2b2b51e9ad97b7b2 HTTP/1.0" 202 Accepted 2026-03-25 23:35:25,890 - lava_callback - INFO - Starting async job submit for node 69c1ce3a2b2b51e9ad97b7b2 2026-03-25 23:35:25,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:35:25,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ce3a2b2b51e9ad97b7b2 HTTP/1.1" 200 None 2026-03-25 23:35:25,907 - lava_callback - DEBUG - Processing node 69c1ce3a2b2b51e9ad97b7b2: baseline-arm-baylibre 2026-03-25 23:35:25,908 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ce3a2b2b51e9ad97b7b2 2026-03-25 23:35:25,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:35:25,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ce3a2b2b51e9ad97b7b2 HTTP/1.1" 200 None 2026-03-25 23:35:25,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:35:25,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:35:25,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:35:25,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ce3a2b2b51e9ad97b7b2 HTTP/1.1" 200 None 2026-03-25 23:35:25,983 - lava_callback - ERROR - Error processing callback for node 69c1ce3a2b2b51e9ad97b7b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33646 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:36:05,908 - lava_callback - INFO - Received callback for node 69c1ce632b2b51e9ad97b7bc INFO: 172.21.0.1:38718 - "POST /node/69c1ce632b2b51e9ad97b7bc HTTP/1.0" 202 Accepted 2026-03-25 23:36:05,913 - lava_callback - INFO - Starting async job submit for node 69c1ce632b2b51e9ad97b7bc 2026-03-25 23:36:05,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:36:05,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ce632b2b51e9ad97b7bc HTTP/1.1" 200 None 2026-03-25 23:36:05,931 - lava_callback - DEBUG - Processing node 69c1ce632b2b51e9ad97b7bc: baseline-arm-baylibre 2026-03-25 23:36:05,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ce632b2b51e9ad97b7bc 2026-03-25 23:36:05,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:36:05,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ce632b2b51e9ad97b7bc HTTP/1.1" 200 None 2026-03-25 23:36:05,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:36:05,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:36:05,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:36:06,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ce632b2b51e9ad97b7bc HTTP/1.1" 200 None 2026-03-25 23:36:06,014 - lava_callback - ERROR - Error processing callback for node 69c1ce632b2b51e9ad97b7bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60110 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:36:45,932 - lava_callback - INFO - Received callback for node 69c1ce892b2b51e9ad97b7c7 INFO: 172.21.0.1:38288 - "POST /node/69c1ce892b2b51e9ad97b7c7 HTTP/1.0" 202 Accepted 2026-03-25 23:36:45,941 - lava_callback - INFO - Starting async job submit for node 69c1ce892b2b51e9ad97b7c7 2026-03-25 23:36:45,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:36:45,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ce892b2b51e9ad97b7c7 HTTP/1.1" 200 None 2026-03-25 23:36:45,962 - lava_callback - DEBUG - Processing node 69c1ce892b2b51e9ad97b7c7: baseline-arm-baylibre 2026-03-25 23:36:45,963 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ce892b2b51e9ad97b7c7 2026-03-25 23:36:45,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:36:45,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ce892b2b51e9ad97b7c7 HTTP/1.1" 200 None 2026-03-25 23:36:45,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:36:45,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:36:45,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:36:46,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ce892b2b51e9ad97b7c7 HTTP/1.1" 200 None 2026-03-25 23:36:46,020 - lava_callback - ERROR - Error processing callback for node 69c1ce892b2b51e9ad97b7c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49120 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:37:35,513 - lava_callback - INFO - Received callback for node 69c1ceb42b2b51e9ad97b7d4 INFO: 172.21.0.1:39284 - "POST /node/69c1ceb42b2b51e9ad97b7d4 HTTP/1.0" 202 Accepted 2026-03-25 23:37:35,518 - lava_callback - INFO - Starting async job submit for node 69c1ceb42b2b51e9ad97b7d4 2026-03-25 23:37:35,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:37:35,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ceb42b2b51e9ad97b7d4 HTTP/1.1" 200 None 2026-03-25 23:37:35,539 - lava_callback - DEBUG - Processing node 69c1ceb42b2b51e9ad97b7d4: baseline-arm-clabbe 2026-03-25 23:37:35,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ceb42b2b51e9ad97b7d4 2026-03-25 23:37:35,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:37:35,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ceb42b2b51e9ad97b7d4 HTTP/1.1" 200 None 2026-03-25 23:37:35,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:37:35,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:37:35,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:37:35,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ceb42b2b51e9ad97b7d4 HTTP/1.1" 200 None 2026-03-25 23:37:35,591 - lava_callback - ERROR - Error processing callback for node 69c1ceb42b2b51e9ad97b7d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44388 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:38:06,050 - lava_callback - INFO - Received callback for node 69c1ced72b2b51e9ad97b7dc INFO: 172.21.0.1:50740 - "POST /node/69c1ced72b2b51e9ad97b7dc HTTP/1.0" 202 Accepted 2026-03-25 23:38:06,056 - lava_callback - INFO - Starting async job submit for node 69c1ced72b2b51e9ad97b7dc 2026-03-25 23:38:06,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:38:06,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ced72b2b51e9ad97b7dc HTTP/1.1" 200 None 2026-03-25 23:38:06,073 - lava_callback - DEBUG - Processing node 69c1ced72b2b51e9ad97b7dc: baseline-arm-baylibre 2026-03-25 23:38:06,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ced72b2b51e9ad97b7dc 2026-03-25 23:38:06,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:38:06,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ced72b2b51e9ad97b7dc HTTP/1.1" 200 None 2026-03-25 23:38:06,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:38:06,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:38:06,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:38:06,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ced72b2b51e9ad97b7dc HTTP/1.1" 200 None 2026-03-25 23:38:06,132 - lava_callback - ERROR - Error processing callback for node 69c1ced72b2b51e9ad97b7dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33530 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:38:55,579 - lava_callback - INFO - Received callback for node 69c1cf012b2b51e9ad97b7e5 INFO: 172.21.0.1:33534 - "POST /node/69c1cf012b2b51e9ad97b7e5 HTTP/1.0" 202 Accepted 2026-03-25 23:38:55,585 - lava_callback - INFO - Starting async job submit for node 69c1cf012b2b51e9ad97b7e5 2026-03-25 23:38:55,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:38:55,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf012b2b51e9ad97b7e5 HTTP/1.1" 200 None 2026-03-25 23:38:55,604 - lava_callback - DEBUG - Processing node 69c1cf012b2b51e9ad97b7e5: baseline-arm-clabbe 2026-03-25 23:38:55,604 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cf012b2b51e9ad97b7e5 2026-03-25 23:38:55,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:38:55,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf012b2b51e9ad97b7e5 HTTP/1.1" 200 None 2026-03-25 23:38:55,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:38:55,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:38:55,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:38:55,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cf012b2b51e9ad97b7e5 HTTP/1.1" 200 None 2026-03-25 23:38:55,670 - lava_callback - ERROR - Error processing callback for node 69c1cf012b2b51e9ad97b7e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40040 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:39:26,308 - lava_callback - INFO - Received callback for node 69c1cf252b2b51e9ad97b7ef INFO: 172.21.0.1:44582 - "POST /node/69c1cf252b2b51e9ad97b7ef HTTP/1.0" 202 Accepted 2026-03-25 23:39:26,313 - lava_callback - INFO - Starting async job submit for node 69c1cf252b2b51e9ad97b7ef 2026-03-25 23:39:26,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:39:26,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf252b2b51e9ad97b7ef HTTP/1.1" 200 None 2026-03-25 23:39:26,330 - lava_callback - DEBUG - Processing node 69c1cf252b2b51e9ad97b7ef: baseline-arm-baylibre 2026-03-25 23:39:26,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cf252b2b51e9ad97b7ef 2026-03-25 23:39:26,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:39:26,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf252b2b51e9ad97b7ef HTTP/1.1" 200 None 2026-03-25 23:39:26,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:39:26,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:39:26,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:39:26,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cf252b2b51e9ad97b7ef HTTP/1.1" 200 None 2026-03-25 23:39:26,398 - lava_callback - ERROR - Error processing callback for node 69c1cf252b2b51e9ad97b7ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54204 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:40:06,138 - lava_callback - INFO - Received callback for node 69c1cf4c2b2b51e9ad97b7f9 INFO: 172.21.0.1:48698 - "POST /node/69c1cf4c2b2b51e9ad97b7f9 HTTP/1.0" 202 Accepted 2026-03-25 23:40:06,143 - lava_callback - INFO - Starting async job submit for node 69c1cf4c2b2b51e9ad97b7f9 2026-03-25 23:40:06,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:40:06,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf4c2b2b51e9ad97b7f9 HTTP/1.1" 200 None 2026-03-25 23:40:06,159 - lava_callback - DEBUG - Processing node 69c1cf4c2b2b51e9ad97b7f9: baseline-arm-baylibre 2026-03-25 23:40:06,160 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cf4c2b2b51e9ad97b7f9 2026-03-25 23:40:06,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:40:06,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf4c2b2b51e9ad97b7f9 HTTP/1.1" 200 None 2026-03-25 23:40:06,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:40:06,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:40:06,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:40:06,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cf4c2b2b51e9ad97b7f9 HTTP/1.1" 200 None 2026-03-25 23:40:06,218 - lava_callback - ERROR - Error processing callback for node 69c1cf4c2b2b51e9ad97b7f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56256 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:40:55,681 - lava_callback - INFO - Received callback for node 69c1cf742b2b51e9ad97b802 INFO: 172.21.0.1:56260 - "POST /node/69c1cf742b2b51e9ad97b802 HTTP/1.0" 202 Accepted 2026-03-25 23:40:55,686 - lava_callback - INFO - Starting async job submit for node 69c1cf742b2b51e9ad97b802 2026-03-25 23:40:55,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:40:55,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf742b2b51e9ad97b802 HTTP/1.1" 200 None 2026-03-25 23:40:55,702 - lava_callback - DEBUG - Processing node 69c1cf742b2b51e9ad97b802: baseline-arm-clabbe 2026-03-25 23:40:55,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cf742b2b51e9ad97b802 2026-03-25 23:40:55,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:40:55,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf742b2b51e9ad97b802 HTTP/1.1" 200 None 2026-03-25 23:40:55,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:40:55,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:40:55,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:40:55,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cf742b2b51e9ad97b802 HTTP/1.1" 200 None 2026-03-25 23:40:55,766 - lava_callback - ERROR - Error processing callback for node 69c1cf742b2b51e9ad97b802: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38904 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:41:35,711 - lava_callback - INFO - Received callback for node 69c1cf9d2b2b51e9ad97b80c INFO: 172.21.0.1:34616 - "POST /node/69c1cf9d2b2b51e9ad97b80c HTTP/1.0" 202 Accepted 2026-03-25 23:41:35,716 - lava_callback - INFO - Starting async job submit for node 69c1cf9d2b2b51e9ad97b80c 2026-03-25 23:41:35,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:41:35,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf9d2b2b51e9ad97b80c HTTP/1.1" 200 None 2026-03-25 23:41:35,733 - lava_callback - DEBUG - Processing node 69c1cf9d2b2b51e9ad97b80c: baseline-arm-clabbe 2026-03-25 23:41:35,733 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cf9d2b2b51e9ad97b80c 2026-03-25 23:41:35,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:41:35,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf9d2b2b51e9ad97b80c HTTP/1.1" 200 None 2026-03-25 23:41:35,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:41:35,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:41:35,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:41:35,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cf9d2b2b51e9ad97b80c HTTP/1.1" 200 None 2026-03-25 23:41:35,794 - lava_callback - ERROR - Error processing callback for node 69c1cf9d2b2b51e9ad97b80c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44042 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 23:42:15,762 - lava_callback - INFO - Received callback for node 69c1cfc32b2b51e9ad97b817 INFO: 172.21.0.1:44046 - "POST /node/69c1cfc32b2b51e9ad97b817 HTTP/1.0" 202 Accepted 2026-03-25 23:42:15,768 - lava_callback - INFO - Starting async job submit for node 69c1cfc32b2b51e9ad97b817 2026-03-25 23:42:15,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:42:15,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cfc32b2b51e9ad97b817 HTTP/1.1" 200 None 2026-03-25 23:42:15,796 - lava_callback - DEBUG - Processing node 69c1cfc32b2b51e9ad97b817: baseline-arm-clabbe 2026-03-25 23:42:15,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cfc32b2b51e9ad97b817 2026-03-25 23:42:15,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:42:15,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cfc32b2b51e9ad97b817 HTTP/1.1" 200 None 2026-03-25 23:42:15,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:42:15,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:42:15,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:42:15,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cfc32b2b51e9ad97b817 HTTP/1.1" 200 None 2026-03-25 23:42:15,856 - lava_callback - ERROR - Error processing callback for node 69c1cfc32b2b51e9ad97b817: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49436 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:42:55,742 - lava_callback - INFO - Received callback for node 69c1cfeb2b2b51e9ad97b81f INFO: 172.21.0.1:49448 - "POST /node/69c1cfeb2b2b51e9ad97b81f HTTP/1.0" 202 Accepted 2026-03-25 23:42:55,747 - lava_callback - INFO - Starting async job submit for node 69c1cfeb2b2b51e9ad97b81f 2026-03-25 23:42:55,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:42:55,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cfeb2b2b51e9ad97b81f HTTP/1.1" 200 None 2026-03-25 23:42:55,763 - lava_callback - DEBUG - Processing node 69c1cfeb2b2b51e9ad97b81f: baseline-arm-clabbe 2026-03-25 23:42:55,764 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cfeb2b2b51e9ad97b81f 2026-03-25 23:42:55,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:42:55,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cfeb2b2b51e9ad97b81f HTTP/1.1" 200 None 2026-03-25 23:42:55,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:42:55,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:42:55,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:42:55,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cfeb2b2b51e9ad97b81f HTTP/1.1" 200 None 2026-03-25 23:42:55,817 - lava_callback - ERROR - Error processing callback for node 69c1cfeb2b2b51e9ad97b81f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:43:35,792 - lava_callback - INFO - Received callback for node 69c1d0132b2b51e9ad97b828 INFO: 172.21.0.1:44448 - "POST /node/69c1d0132b2b51e9ad97b828 HTTP/1.0" 202 Accepted 2026-03-25 23:43:35,797 - lava_callback - INFO - Starting async job submit for node 69c1d0132b2b51e9ad97b828 2026-03-25 23:43:35,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:43:35,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d0132b2b51e9ad97b828 HTTP/1.1" 200 None 2026-03-25 23:43:35,814 - lava_callback - DEBUG - Processing node 69c1d0132b2b51e9ad97b828: baseline-arm-clabbe 2026-03-25 23:43:35,814 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d0132b2b51e9ad97b828 2026-03-25 23:43:35,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:43:35,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d0132b2b51e9ad97b828 HTTP/1.1" 200 None 2026-03-25 23:43:35,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:43:35,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:43:35,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:43:35,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d0132b2b51e9ad97b828 HTTP/1.1" 200 None 2026-03-25 23:43:35,877 - lava_callback - ERROR - Error processing callback for node 69c1d0132b2b51e9ad97b828: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 23:44:15,803 - lava_callback - INFO - Received callback for node 69c1d03b2b2b51e9ad97b834 INFO: 172.21.0.1:39268 - "POST /node/69c1d03b2b2b51e9ad97b834 HTTP/1.0" 202 Accepted 2026-03-25 23:44:15,809 - lava_callback - INFO - Starting async job submit for node 69c1d03b2b2b51e9ad97b834 2026-03-25 23:44:15,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:44:15,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d03b2b2b51e9ad97b834 HTTP/1.1" 200 None 2026-03-25 23:44:15,833 - lava_callback - DEBUG - Processing node 69c1d03b2b2b51e9ad97b834: baseline-arm-clabbe 2026-03-25 23:44:15,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d03b2b2b51e9ad97b834 2026-03-25 23:44:15,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:44:15,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d03b2b2b51e9ad97b834 HTTP/1.1" 200 None 2026-03-25 23:44:15,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:44:15,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:44:15,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:44:15,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d03b2b2b51e9ad97b834 HTTP/1.1" 200 None 2026-03-25 23:44:15,895 - lava_callback - ERROR - Error processing callback for node 69c1d03b2b2b51e9ad97b834: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43446 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:44:35,864 - lava_callback - INFO - Received callback for node 69c1d0612b2b51e9ad97b83b INFO: 172.21.0.1:41048 - "POST /node/69c1d0612b2b51e9ad97b83b HTTP/1.0" 202 Accepted 2026-03-25 23:44:35,870 - lava_callback - INFO - Starting async job submit for node 69c1d0612b2b51e9ad97b83b 2026-03-25 23:44:35,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:44:35,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d0612b2b51e9ad97b83b HTTP/1.1" 200 None 2026-03-25 23:44:35,885 - lava_callback - DEBUG - Processing node 69c1d0612b2b51e9ad97b83b: baseline-arm-clabbe 2026-03-25 23:44:35,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d0612b2b51e9ad97b83b 2026-03-25 23:44:35,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:44:35,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d0612b2b51e9ad97b83b HTTP/1.1" 200 None 2026-03-25 23:44:35,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:44:35,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:44:35,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:44:35,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d0612b2b51e9ad97b83b HTTP/1.1" 200 None 2026-03-25 23:44:35,952 - lava_callback - ERROR - Error processing callback for node 69c1d0612b2b51e9ad97b83b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45732 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 23:45:15,824 - lava_callback - INFO - Received callback for node 69c1d0862b2b51e9ad97b845 INFO: 172.21.0.1:45742 - "POST /node/69c1d0862b2b51e9ad97b845 HTTP/1.0" 202 Accepted 2026-03-25 23:45:15,829 - lava_callback - INFO - Starting async job submit for node 69c1d0862b2b51e9ad97b845 2026-03-25 23:45:15,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:45:15,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d0862b2b51e9ad97b845 HTTP/1.1" 200 None 2026-03-25 23:45:15,851 - lava_callback - DEBUG - Processing node 69c1d0862b2b51e9ad97b845: baseline-arm-clabbe 2026-03-25 23:45:15,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d0862b2b51e9ad97b845 2026-03-25 23:45:15,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:45:15,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d0862b2b51e9ad97b845 HTTP/1.1" 200 None 2026-03-25 23:45:15,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:45:15,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:45:15,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:45:15,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d0862b2b51e9ad97b845 HTTP/1.1" 200 None 2026-03-25 23:45:15,916 - lava_callback - ERROR - Error processing callback for node 69c1d0862b2b51e9ad97b845: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52904 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:48:06,514 - lava_callback - INFO - Received callback for node 69c1d12d2b2b51e9ad97b852 INFO: 172.21.0.1:52920 - "POST /node/69c1d12d2b2b51e9ad97b852 HTTP/1.0" 202 Accepted 2026-03-25 23:48:06,519 - lava_callback - INFO - Starting async job submit for node 69c1d12d2b2b51e9ad97b852 2026-03-25 23:48:06,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:48:06,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d12d2b2b51e9ad97b852 HTTP/1.1" 200 None 2026-03-25 23:48:06,538 - lava_callback - DEBUG - Processing node 69c1d12d2b2b51e9ad97b852: baseline-arm-baylibre 2026-03-25 23:48:06,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d12d2b2b51e9ad97b852 2026-03-25 23:48:06,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:48:06,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d12d2b2b51e9ad97b852 HTTP/1.1" 200 None 2026-03-25 23:48:06,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:48:06,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:48:06,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:48:06,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d12d2b2b51e9ad97b852 HTTP/1.1" 200 None 2026-03-25 23:48:06,593 - lava_callback - ERROR - Error processing callback for node 69c1d12d2b2b51e9ad97b852: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49326 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:49:06,599 - lava_callback - INFO - Received callback for node 69c1d16a2b2b51e9ad97b85f INFO: 172.21.0.1:49342 - "POST /node/69c1d16a2b2b51e9ad97b85f HTTP/1.0" 202 Accepted 2026-03-25 23:49:06,605 - lava_callback - INFO - Starting async job submit for node 69c1d16a2b2b51e9ad97b85f 2026-03-25 23:49:06,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:49:06,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d16a2b2b51e9ad97b85f HTTP/1.1" 200 None 2026-03-25 23:49:06,622 - lava_callback - DEBUG - Processing node 69c1d16a2b2b51e9ad97b85f: baseline-arm-baylibre 2026-03-25 23:49:06,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d16a2b2b51e9ad97b85f 2026-03-25 23:49:06,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:49:06,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d16a2b2b51e9ad97b85f HTTP/1.1" 200 None 2026-03-25 23:49:06,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:49:06,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:49:06,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:49:06,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d16a2b2b51e9ad97b85f HTTP/1.1" 200 None 2026-03-25 23:49:06,681 - lava_callback - ERROR - Error processing callback for node 69c1d16a2b2b51e9ad97b85f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52818 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:50:06,901 - lava_callback - INFO - Received callback for node 69c1d1a62b2b51e9ad97b86c INFO: 172.21.0.1:52834 - "POST /node/69c1d1a62b2b51e9ad97b86c HTTP/1.0" 202 Accepted 2026-03-25 23:50:06,910 - lava_callback - INFO - Starting async job submit for node 69c1d1a62b2b51e9ad97b86c 2026-03-25 23:50:06,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:50:06,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d1a62b2b51e9ad97b86c HTTP/1.1" 200 None 2026-03-25 23:50:06,932 - lava_callback - DEBUG - Processing node 69c1d1a62b2b51e9ad97b86c: baseline-arm-baylibre 2026-03-25 23:50:06,932 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d1a62b2b51e9ad97b86c 2026-03-25 23:50:06,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:50:06,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d1a62b2b51e9ad97b86c HTTP/1.1" 200 None 2026-03-25 23:50:06,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:50:06,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:50:06,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:50:07,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d1a62b2b51e9ad97b86c HTTP/1.1" 200 None 2026-03-25 23:50:07,008 - lava_callback - ERROR - Error processing callback for node 69c1d1a62b2b51e9ad97b86c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:51:06,684 - lava_callback - INFO - Received callback for node 69c1d1e32b2b51e9ad97b87a INFO: 172.21.0.1:56280 - "POST /node/69c1d1e32b2b51e9ad97b87a HTTP/1.0" 202 Accepted 2026-03-25 23:51:06,689 - lava_callback - INFO - Starting async job submit for node 69c1d1e32b2b51e9ad97b87a 2026-03-25 23:51:06,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:51:06,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d1e32b2b51e9ad97b87a HTTP/1.1" 200 None 2026-03-25 23:51:06,707 - lava_callback - DEBUG - Processing node 69c1d1e32b2b51e9ad97b87a: baseline-arm-baylibre 2026-03-25 23:51:06,707 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d1e32b2b51e9ad97b87a 2026-03-25 23:51:06,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:51:06,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d1e32b2b51e9ad97b87a HTTP/1.1" 200 None 2026-03-25 23:51:06,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:51:06,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:51:06,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:51:06,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d1e32b2b51e9ad97b87a HTTP/1.1" 200 None 2026-03-25 23:51:06,762 - lava_callback - ERROR - Error processing callback for node 69c1d1e32b2b51e9ad97b87a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50596 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:51:56,169 - lava_callback - INFO - Received callback for node 69c1d20d2b2b51e9ad97b886 INFO: 172.21.0.1:50600 - "POST /node/69c1d20d2b2b51e9ad97b886 HTTP/1.0" 202 Accepted 2026-03-25 23:51:56,174 - lava_callback - INFO - Starting async job submit for node 69c1d20d2b2b51e9ad97b886 2026-03-25 23:51:56,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:51:56,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d20d2b2b51e9ad97b886 HTTP/1.1" 200 None 2026-03-25 23:51:56,191 - lava_callback - DEBUG - Processing node 69c1d20d2b2b51e9ad97b886: baseline-arm-clabbe 2026-03-25 23:51:56,191 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d20d2b2b51e9ad97b886 2026-03-25 23:51:56,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:51:56,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d20d2b2b51e9ad97b886 HTTP/1.1" 200 None 2026-03-25 23:51:56,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:51:56,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:51:56,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:51:56,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d20d2b2b51e9ad97b886 HTTP/1.1" 200 None 2026-03-25 23:51:56,246 - lava_callback - ERROR - Error processing callback for node 69c1d20d2b2b51e9ad97b886: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33768 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:52:26,862 - lava_callback - INFO - Received callback for node 69c1d2322b2b51e9ad97b894 INFO: 172.21.0.1:33770 - "POST /node/69c1d2322b2b51e9ad97b894 HTTP/1.0" 202 Accepted 2026-03-25 23:52:26,868 - lava_callback - INFO - Starting async job submit for node 69c1d2322b2b51e9ad97b894 2026-03-25 23:52:26,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:52:26,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2322b2b51e9ad97b894 HTTP/1.1" 200 None 2026-03-25 23:52:26,885 - lava_callback - DEBUG - Processing node 69c1d2322b2b51e9ad97b894: baseline-arm-baylibre 2026-03-25 23:52:26,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d2322b2b51e9ad97b894 2026-03-25 23:52:26,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:52:26,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2322b2b51e9ad97b894 HTTP/1.1" 200 None 2026-03-25 23:52:26,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:52:26,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:52:26,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:52:26,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d2322b2b51e9ad97b894 HTTP/1.1" 200 None 2026-03-25 23:52:26,936 - lava_callback - ERROR - Error processing callback for node 69c1d2322b2b51e9ad97b894: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:53:06,818 - lava_callback - INFO - Received callback for node 69c1d2562b2b51e9ad97b89d INFO: 172.21.0.1:53162 - "POST /node/69c1d2562b2b51e9ad97b89d HTTP/1.0" 202 Accepted 2026-03-25 23:53:06,824 - lava_callback - INFO - Starting async job submit for node 69c1d2562b2b51e9ad97b89d 2026-03-25 23:53:06,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:53:06,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2562b2b51e9ad97b89d HTTP/1.1" 200 None 2026-03-25 23:53:06,840 - lava_callback - DEBUG - Processing node 69c1d2562b2b51e9ad97b89d: baseline-arm-baylibre 2026-03-25 23:53:06,840 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d2562b2b51e9ad97b89d 2026-03-25 23:53:06,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:53:06,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2562b2b51e9ad97b89d HTTP/1.1" 200 None 2026-03-25 23:53:06,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:53:06,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:53:06,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:53:06,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d2562b2b51e9ad97b89d HTTP/1.1" 200 None 2026-03-25 23:53:06,895 - lava_callback - ERROR - Error processing callback for node 69c1d2562b2b51e9ad97b89d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47950 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:53:56,179 - lava_callback - INFO - Received callback for node 69c1d2812b2b51e9ad97b8ac INFO: 172.21.0.1:47956 - "POST /node/69c1d2812b2b51e9ad97b8ac HTTP/1.0" 202 Accepted 2026-03-25 23:53:56,185 - lava_callback - INFO - Starting async job submit for node 69c1d2812b2b51e9ad97b8ac 2026-03-25 23:53:56,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:53:56,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2812b2b51e9ad97b8ac HTTP/1.1" 200 None 2026-03-25 23:53:56,201 - lava_callback - DEBUG - Processing node 69c1d2812b2b51e9ad97b8ac: baseline-arm-clabbe 2026-03-25 23:53:56,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d2812b2b51e9ad97b8ac 2026-03-25 23:53:56,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:53:56,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2812b2b51e9ad97b8ac HTTP/1.1" 200 None 2026-03-25 23:53:56,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:53:56,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:53:56,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:53:56,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d2812b2b51e9ad97b8ac HTTP/1.1" 200 None 2026-03-25 23:53:56,268 - lava_callback - ERROR - Error processing callback for node 69c1d2812b2b51e9ad97b8ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36752 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:54:26,966 - lava_callback - INFO - Received callback for node 69c1d2a62b2b51e9ad97b8b8 INFO: 172.21.0.1:36764 - "POST /node/69c1d2a62b2b51e9ad97b8b8 HTTP/1.0" 202 Accepted 2026-03-25 23:54:26,972 - lava_callback - INFO - Starting async job submit for node 69c1d2a62b2b51e9ad97b8b8 2026-03-25 23:54:26,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:54:26,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2a62b2b51e9ad97b8b8 HTTP/1.1" 200 None 2026-03-25 23:54:26,987 - lava_callback - DEBUG - Processing node 69c1d2a62b2b51e9ad97b8b8: baseline-arm-baylibre 2026-03-25 23:54:26,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d2a62b2b51e9ad97b8b8 2026-03-25 23:54:26,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:54:27,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2a62b2b51e9ad97b8b8 HTTP/1.1" 200 None 2026-03-25 23:54:27,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:54:27,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:54:27,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:54:27,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d2a62b2b51e9ad97b8b8 HTTP/1.1" 200 None 2026-03-25 23:54:27,055 - lava_callback - ERROR - Error processing callback for node 69c1d2a62b2b51e9ad97b8b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33146 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 23:55:16,229 - lava_callback - INFO - Received callback for node 69c1d2ce2b2b51e9ad97b8c5 INFO: 172.21.0.1:33152 - "POST /node/69c1d2ce2b2b51e9ad97b8c5 HTTP/1.0" 202 Accepted 2026-03-25 23:55:16,234 - lava_callback - INFO - Starting async job submit for node 69c1d2ce2b2b51e9ad97b8c5 2026-03-25 23:55:16,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:55:16,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2ce2b2b51e9ad97b8c5 HTTP/1.1" 200 None 2026-03-25 23:55:16,250 - lava_callback - DEBUG - Processing node 69c1d2ce2b2b51e9ad97b8c5: baseline-arm-clabbe 2026-03-25 23:55:16,251 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d2ce2b2b51e9ad97b8c5 2026-03-25 23:55:16,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:55:16,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2ce2b2b51e9ad97b8c5 HTTP/1.1" 200 None 2026-03-25 23:55:16,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:55:16,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:55:16,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:55:16,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d2ce2b2b51e9ad97b8c5 HTTP/1.1" 200 None 2026-03-25 23:55:16,305 - lava_callback - ERROR - Error processing callback for node 69c1d2ce2b2b51e9ad97b8c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:55:36,225 - lava_callback - INFO - Received callback for node 69c1d2f42b2b51e9ad97b8cf INFO: 172.21.0.1:35124 - "POST /node/69c1d2f42b2b51e9ad97b8cf HTTP/1.0" 202 Accepted 2026-03-25 23:55:36,231 - lava_callback - INFO - Starting async job submit for node 69c1d2f42b2b51e9ad97b8cf 2026-03-25 23:55:36,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:55:36,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2f42b2b51e9ad97b8cf HTTP/1.1" 200 None 2026-03-25 23:55:36,247 - lava_callback - DEBUG - Processing node 69c1d2f42b2b51e9ad97b8cf: baseline-arm-clabbe 2026-03-25 23:55:36,247 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d2f42b2b51e9ad97b8cf 2026-03-25 23:55:36,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:55:36,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2f42b2b51e9ad97b8cf HTTP/1.1" 200 None 2026-03-25 23:55:36,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:55:36,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:55:36,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:55:36,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d2f42b2b51e9ad97b8cf HTTP/1.1" 200 None 2026-03-25 23:55:36,311 - lava_callback - ERROR - Error processing callback for node 69c1d2f42b2b51e9ad97b8cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58862 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 23:56:16,286 - lava_callback - INFO - Received callback for node 69c1d31b2b2b51e9ad97b8ec INFO: 172.21.0.1:58866 - "POST /node/69c1d31b2b2b51e9ad97b8ec HTTP/1.0" 202 Accepted 2026-03-25 23:56:16,291 - lava_callback - INFO - Starting async job submit for node 69c1d31b2b2b51e9ad97b8ec 2026-03-25 23:56:16,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:56:16,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d31b2b2b51e9ad97b8ec HTTP/1.1" 200 None 2026-03-25 23:56:16,320 - lava_callback - DEBUG - Processing node 69c1d31b2b2b51e9ad97b8ec: baseline-arm-clabbe 2026-03-25 23:56:16,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d31b2b2b51e9ad97b8ec 2026-03-25 23:56:16,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:56:16,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d31b2b2b51e9ad97b8ec HTTP/1.1" 200 None 2026-03-25 23:56:16,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:56:16,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:56:16,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:56:16,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d31b2b2b51e9ad97b8ec HTTP/1.1" 200 None 2026-03-25 23:56:16,389 - lava_callback - ERROR - Error processing callback for node 69c1d31b2b2b51e9ad97b8ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41534 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:56:56,321 - lava_callback - INFO - Received callback for node 69c1d3422b2b51e9ad97b8f5 INFO: 172.21.0.1:41536 - "POST /node/69c1d3422b2b51e9ad97b8f5 HTTP/1.0" 202 Accepted 2026-03-25 23:56:56,327 - lava_callback - INFO - Starting async job submit for node 69c1d3422b2b51e9ad97b8f5 2026-03-25 23:56:56,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:56:56,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d3422b2b51e9ad97b8f5 HTTP/1.1" 200 None 2026-03-25 23:56:56,342 - lava_callback - DEBUG - Processing node 69c1d3422b2b51e9ad97b8f5: baseline-arm-clabbe 2026-03-25 23:56:56,343 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d3422b2b51e9ad97b8f5 2026-03-25 23:56:56,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:56:56,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d3422b2b51e9ad97b8f5 HTTP/1.1" 200 None 2026-03-25 23:56:56,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:56:56,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:56:56,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:56:56,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d3422b2b51e9ad97b8f5 HTTP/1.1" 200 None 2026-03-25 23:56:56,431 - lava_callback - ERROR - Error processing callback for node 69c1d3422b2b51e9ad97b8f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:57:36,401 - lava_callback - INFO - Received callback for node 69c1d3692b2b51e9ad97b931 INFO: 172.21.0.1:48564 - "POST /node/69c1d3692b2b51e9ad97b931 HTTP/1.0" 202 Accepted 2026-03-25 23:57:36,407 - lava_callback - INFO - Starting async job submit for node 69c1d3692b2b51e9ad97b931 2026-03-25 23:57:36,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:57:36,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d3692b2b51e9ad97b931 HTTP/1.1" 200 None 2026-03-25 23:57:36,433 - lava_callback - DEBUG - Processing node 69c1d3692b2b51e9ad97b931: baseline-arm-clabbe 2026-03-25 23:57:36,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d3692b2b51e9ad97b931 2026-03-25 23:57:36,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:57:36,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d3692b2b51e9ad97b931 HTTP/1.1" 200 None 2026-03-25 23:57:36,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:57:36,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:57:36,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:57:36,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d3692b2b51e9ad97b931 HTTP/1.1" 200 None 2026-03-25 23:57:36,496 - lava_callback - ERROR - Error processing callback for node 69c1d3692b2b51e9ad97b931: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37520 - "GET / HTTP/1.0" 200 OK 2026-03-26 00:05:36,801 - lava_callback - INFO - Received callback for node 69c1d53c2b2b51e9ad97b99a INFO: 172.21.0.1:37534 - "POST /node/69c1d53c2b2b51e9ad97b99a HTTP/1.0" 202 Accepted 2026-03-26 00:05:36,806 - lava_callback - INFO - Starting async job submit for node 69c1d53c2b2b51e9ad97b99a 2026-03-26 00:05:36,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:05:36,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d53c2b2b51e9ad97b99a HTTP/1.1" 200 None 2026-03-26 00:05:36,823 - lava_callback - DEBUG - Processing node 69c1d53c2b2b51e9ad97b99a: baseline-arm-clabbe 2026-03-26 00:05:36,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d53c2b2b51e9ad97b99a 2026-03-26 00:05:36,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:05:36,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d53c2b2b51e9ad97b99a HTTP/1.1" 200 None 2026-03-26 00:05:36,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:05:36,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-26 00:05:36,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:05:36,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d53c2b2b51e9ad97b99a HTTP/1.1" 200 None 2026-03-26 00:05:36,886 - lava_callback - ERROR - Error processing callback for node 69c1d53c2b2b51e9ad97b99a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38494 - "GET / HTTP/1.0" 200 OK 2026-03-26 00:06:08,161 - lava_callback - INFO - Received callback for node 69c1d5682b2b51e9ad97b9a8 INFO: 172.21.0.1:38498 - "POST /node/69c1d5682b2b51e9ad97b9a8 HTTP/1.0" 202 Accepted 2026-03-26 00:06:08,168 - lava_callback - INFO - Starting async job submit for node 69c1d5682b2b51e9ad97b9a8 2026-03-26 00:06:08,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:06:08,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d5682b2b51e9ad97b9a8 HTTP/1.1" 200 None 2026-03-26 00:06:08,183 - lava_callback - DEBUG - Processing node 69c1d5682b2b51e9ad97b9a8: baseline-arm64-baylibre 2026-03-26 00:06:08,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d5682b2b51e9ad97b9a8 2026-03-26 00:06:08,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:06:08,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d5682b2b51e9ad97b9a8 HTTP/1.1" 200 None 2026-03-26 00:06:08,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:06:08,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-26 00:06:08,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:06:08,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d5682b2b51e9ad97b9a8 HTTP/1.1" 200 None 2026-03-26 00:06:08,242 - lava_callback - ERROR - Error processing callback for node 69c1d5682b2b51e9ad97b9a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET / HTTP/1.0" 200 OK 2026-03-26 00:07:47,649 - lava_callback - INFO - Received callback for node 69c1d5be2b2b51e9ad97b9b7 INFO: 172.21.0.1:41236 - "POST /node/69c1d5be2b2b51e9ad97b9b7 HTTP/1.0" 202 Accepted 2026-03-26 00:07:47,655 - lava_callback - INFO - Starting async job submit for node 69c1d5be2b2b51e9ad97b9b7 2026-03-26 00:07:47,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:07:47,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d5be2b2b51e9ad97b9b7 HTTP/1.1" 200 None 2026-03-26 00:07:47,708 - lava_callback - DEBUG - Processing node 69c1d5be2b2b51e9ad97b9b7: baseline-arm64-baylibre 2026-03-26 00:07:47,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d5be2b2b51e9ad97b9b7 2026-03-26 00:07:47,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:07:47,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d5be2b2b51e9ad97b9b7 HTTP/1.1" 200 None 2026-03-26 00:07:47,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:07:47,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-26 00:07:47,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:07:47,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d5be2b2b51e9ad97b9b7 HTTP/1.1" 200 None 2026-03-26 00:07:47,772 - lava_callback - ERROR - Error processing callback for node 69c1d5be2b2b51e9ad97b9b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK 2026-03-26 00:09:08,063 - lava_callback - INFO - Received callback for node 69c1d6142b2b51e9ad97b9c2 INFO: 172.21.0.1:39300 - "POST /node/69c1d6142b2b51e9ad97b9c2 HTTP/1.0" 202 Accepted 2026-03-26 00:09:08,068 - lava_callback - INFO - Starting async job submit for node 69c1d6142b2b51e9ad97b9c2 2026-03-26 00:09:08,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:09:08,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d6142b2b51e9ad97b9c2 HTTP/1.1" 200 None 2026-03-26 00:09:08,085 - lava_callback - DEBUG - Processing node 69c1d6142b2b51e9ad97b9c2: baseline-arm64-baylibre 2026-03-26 00:09:08,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d6142b2b51e9ad97b9c2 2026-03-26 00:09:08,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:09:08,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d6142b2b51e9ad97b9c2 HTTP/1.1" 200 None 2026-03-26 00:09:08,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:09:08,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-26 00:09:08,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:09:08,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d6142b2b51e9ad97b9c2 HTTP/1.1" 200 None 2026-03-26 00:09:08,142 - lava_callback - ERROR - Error processing callback for node 69c1d6142b2b51e9ad97b9c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40170 - "GET / HTTP/1.0" 200 OK 2026-03-26 00:10:27,831 - lava_callback - INFO - Received callback for node 69c1d66a2b2b51e9ad97b9d2 INFO: 172.21.0.1:40178 - "POST /node/69c1d66a2b2b51e9ad97b9d2 HTTP/1.0" 202 Accepted 2026-03-26 00:10:27,837 - lava_callback - INFO - Starting async job submit for node 69c1d66a2b2b51e9ad97b9d2 2026-03-26 00:10:27,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:10:27,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d66a2b2b51e9ad97b9d2 HTTP/1.1" 200 None 2026-03-26 00:10:27,854 - lava_callback - DEBUG - Processing node 69c1d66a2b2b51e9ad97b9d2: baseline-arm64-baylibre 2026-03-26 00:10:27,854 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d66a2b2b51e9ad97b9d2 2026-03-26 00:10:27,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:10:27,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d66a2b2b51e9ad97b9d2 HTTP/1.1" 200 None 2026-03-26 00:10:27,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:10:27,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-26 00:10:27,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:10:27,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d66a2b2b51e9ad97b9d2 HTTP/1.1" 200 None 2026-03-26 00:10:27,924 - lava_callback - ERROR - Error processing callback for node 69c1d66a2b2b51e9ad97b9d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37878 - "GET / HTTP/1.0" 200 OK 2026-03-26 00:11:48,009 - lava_callback - INFO - Received callback for node 69c1d6bf2b2b51e9ad97b9e2 INFO: 172.21.0.1:37886 - "POST /node/69c1d6bf2b2b51e9ad97b9e2 HTTP/1.0" 202 Accepted 2026-03-26 00:11:48,014 - lava_callback - INFO - Starting async job submit for node 69c1d6bf2b2b51e9ad97b9e2 2026-03-26 00:11:48,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:11:48,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d6bf2b2b51e9ad97b9e2 HTTP/1.1" 200 None 2026-03-26 00:11:48,030 - lava_callback - DEBUG - Processing node 69c1d6bf2b2b51e9ad97b9e2: baseline-arm64-baylibre 2026-03-26 00:11:48,030 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d6bf2b2b51e9ad97b9e2 2026-03-26 00:11:48,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:11:48,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d6bf2b2b51e9ad97b9e2 HTTP/1.1" 200 None 2026-03-26 00:11:48,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:11:48,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-26 00:11:48,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:11:48,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d6bf2b2b51e9ad97b9e2 HTTP/1.1" 200 None 2026-03-26 00:11:48,099 - lava_callback - ERROR - Error processing callback for node 69c1d6bf2b2b51e9ad97b9e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48238 - "GET / HTTP/1.0" 200 OK 2026-03-26 00:13:28,220 - lava_callback - INFO - Received callback for node 69c1d7132b2b51e9ad97b9f2 INFO: 172.21.0.1:48240 - "POST /node/69c1d7132b2b51e9ad97b9f2 HTTP/1.0" 202 Accepted 2026-03-26 00:13:28,228 - lava_callback - INFO - Starting async job submit for node 69c1d7132b2b51e9ad97b9f2 2026-03-26 00:13:28,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:13:28,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d7132b2b51e9ad97b9f2 HTTP/1.1" 200 None 2026-03-26 00:13:28,253 - lava_callback - DEBUG - Processing node 69c1d7132b2b51e9ad97b9f2: baseline-arm64-baylibre 2026-03-26 00:13:28,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d7132b2b51e9ad97b9f2 2026-03-26 00:13:28,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:13:28,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d7132b2b51e9ad97b9f2 HTTP/1.1" 200 None 2026-03-26 00:13:28,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:13:28,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-26 00:13:28,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:13:28,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d7132b2b51e9ad97b9f2 HTTP/1.1" 200 None 2026-03-26 00:13:28,334 - lava_callback - ERROR - Error processing callback for node 69c1d7132b2b51e9ad97b9f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39908 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1] INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:35134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53194 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:32:40,212 - lava_callback - INFO - Received callback for node 69c40db6944faaf0e7f5e466 2026-03-25 16:32:40,219 - lava_callback - INFO - Starting async job submit for node 69c40db6944faaf0e7f5e466 INFO: 172.21.0.1:50786 - "POST /node/69c40db6944faaf0e7f5e466 HTTP/1.0" 202 Accepted 2026-03-25 16:32:40,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:32:40,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40db6944faaf0e7f5e466 HTTP/1.1" 200 None 2026-03-25 16:32:40,263 - lava_callback - DEBUG - Processing node 69c40db6944faaf0e7f5e466: baseline-arm 2026-03-25 16:32:40,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:32:40,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:32:40,645 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c40db6944faaf0e7f5e466/log.txt.gz 2026-03-25 16:32:40,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:32:40,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:32:41,000 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c40db6944faaf0e7f5e466/lava-logs.yaml 2026-03-25 16:32:41,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:32:41,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:32:41,156 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c40db6944faaf0e7f5e466/lava_callback.json.gz 2026-03-25 16:32:41,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:32:41,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40db6944faaf0e7f5e466 HTTP/1.1" 200 None 2026-03-25 16:32:41,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:32:41,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ace944faaf0e7f5e40e HTTP/1.1" 200 None 2026-03-25 16:32:41,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:32:41,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c40db6944faaf0e7f5e466 HTTP/1.1" 200 None 2026-03-25 16:32:41,257 - lava_callback - INFO - Completed processing callback for node 69c40db6944faaf0e7f5e466 INFO: 172.21.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:33:11,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:33:11,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37360 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:39:23,396 - lava_callback - INFO - Received callback for node 69c16ca82b2b51e9ad97a082 INFO: 172.21.0.1:38082 - "POST /node/69c16ca82b2b51e9ad97a082 HTTP/1.0" 202 Accepted 2026-03-25 16:39:23,401 - lava_callback - INFO - Starting async job submit for node 69c16ca82b2b51e9ad97a082 2026-03-25 16:39:23,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:23,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ca82b2b51e9ad97a082 HTTP/1.1" 200 None 2026-03-25 16:39:23,418 - lava_callback - DEBUG - Processing node 69c16ca82b2b51e9ad97a082: baseline-arm-baylibre 2026-03-25 16:39:23,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16ca82b2b51e9ad97a082 2026-03-25 16:39:23,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:23,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ca82b2b51e9ad97a082 HTTP/1.1" 200 None 2026-03-25 16:39:23,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:23,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:23,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:23,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16ca82b2b51e9ad97a082 HTTP/1.1" 200 None 2026-03-25 16:39:23,486 - lava_callback - ERROR - Error processing callback for node 69c16ca82b2b51e9ad97a082: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 16:39:24,040 - lava_callback - INFO - Received callback for node 69c16caa2b2b51e9ad97a085 INFO: 172.21.0.1:38092 - "POST /node/69c16caa2b2b51e9ad97a085 HTTP/1.0" 202 Accepted 2026-03-25 16:39:24,048 - lava_callback - INFO - Starting async job submit for node 69c16caa2b2b51e9ad97a085 2026-03-25 16:39:24,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:24,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16caa2b2b51e9ad97a085 HTTP/1.1" 200 None 2026-03-25 16:39:24,064 - lava_callback - DEBUG - Processing node 69c16caa2b2b51e9ad97a085: baseline-arm-baylibre 2026-03-25 16:39:24,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16caa2b2b51e9ad97a085 2026-03-25 16:39:24,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:24,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16caa2b2b51e9ad97a085 HTTP/1.1" 200 None 2026-03-25 16:39:24,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:24,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:24,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:24,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16caa2b2b51e9ad97a085 HTTP/1.1" 200 None 2026-03-25 16:39:24,116 - lava_callback - ERROR - Error processing callback for node 69c16caa2b2b51e9ad97a085: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 16:39:24,734 - lava_callback - INFO - Received callback for node 69c16cab2b2b51e9ad97a088 INFO: 172.21.0.1:38102 - "POST /node/69c16cab2b2b51e9ad97a088 HTTP/1.0" 202 Accepted 2026-03-25 16:39:24,740 - lava_callback - INFO - Starting async job submit for node 69c16cab2b2b51e9ad97a088 2026-03-25 16:39:24,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:24,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cab2b2b51e9ad97a088 HTTP/1.1" 200 None 2026-03-25 16:39:24,764 - lava_callback - DEBUG - Processing node 69c16cab2b2b51e9ad97a088: baseline-arm-baylibre 2026-03-25 16:39:24,764 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16cab2b2b51e9ad97a088 2026-03-25 16:39:24,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:24,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cab2b2b51e9ad97a088 HTTP/1.1" 200 None 2026-03-25 16:39:24,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:24,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:24,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:24,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cab2b2b51e9ad97a088 HTTP/1.1" 200 None 2026-03-25 16:39:24,824 - lava_callback - ERROR - Error processing callback for node 69c16cab2b2b51e9ad97a088: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 16:39:25,379 - lava_callback - INFO - Received callback for node 69c16cac2b2b51e9ad97a08b INFO: 172.21.0.1:38114 - "POST /node/69c16cac2b2b51e9ad97a08b HTTP/1.0" 202 Accepted 2026-03-25 16:39:25,385 - lava_callback - INFO - Starting async job submit for node 69c16cac2b2b51e9ad97a08b 2026-03-25 16:39:25,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:25,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cac2b2b51e9ad97a08b HTTP/1.1" 200 None 2026-03-25 16:39:25,402 - lava_callback - DEBUG - Processing node 69c16cac2b2b51e9ad97a08b: baseline-arm-baylibre 2026-03-25 16:39:25,402 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16cac2b2b51e9ad97a08b 2026-03-25 16:39:25,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:25,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cac2b2b51e9ad97a08b HTTP/1.1" 200 None 2026-03-25 16:39:25,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:25,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:25,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:25,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cac2b2b51e9ad97a08b HTTP/1.1" 200 None 2026-03-25 16:39:25,458 - lava_callback - ERROR - Error processing callback for node 69c16cac2b2b51e9ad97a08b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 16:39:26,028 - lava_callback - INFO - Received callback for node 69c16caf2b2b51e9ad97a0a5 INFO: 172.21.0.1:38128 - "POST /node/69c16caf2b2b51e9ad97a0a5 HTTP/1.0" 202 Accepted 2026-03-25 16:39:26,034 - lava_callback - INFO - Starting async job submit for node 69c16caf2b2b51e9ad97a0a5 2026-03-25 16:39:26,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:26,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16caf2b2b51e9ad97a0a5 HTTP/1.1" 200 None 2026-03-25 16:39:26,062 - lava_callback - DEBUG - Processing node 69c16caf2b2b51e9ad97a0a5: baseline-arm-baylibre 2026-03-25 16:39:26,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16caf2b2b51e9ad97a0a5 2026-03-25 16:39:26,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:26,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16caf2b2b51e9ad97a0a5 HTTP/1.1" 200 None 2026-03-25 16:39:26,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:26,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:26,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:26,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16caf2b2b51e9ad97a0a5 HTTP/1.1" 200 None 2026-03-25 16:39:26,133 - lava_callback - ERROR - Error processing callback for node 69c16caf2b2b51e9ad97a0a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38130 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:39:26,699 - lava_callback - INFO - Received callback for node 69c16cb12b2b51e9ad97a0a8 INFO: 172.21.0.1:38134 - "POST /node/69c16cb12b2b51e9ad97a0a8 HTTP/1.0" 202 Accepted 2026-03-25 16:39:26,704 - lava_callback - INFO - Starting async job submit for node 69c16cb12b2b51e9ad97a0a8 2026-03-25 16:39:26,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:26,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cb12b2b51e9ad97a0a8 HTTP/1.1" 200 None 2026-03-25 16:39:26,741 - lava_callback - DEBUG - Processing node 69c16cb12b2b51e9ad97a0a8: baseline-arm-baylibre 2026-03-25 16:39:26,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16cb12b2b51e9ad97a0a8 2026-03-25 16:39:26,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:26,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cb12b2b51e9ad97a0a8 HTTP/1.1" 200 None 2026-03-25 16:39:26,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:26,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:26,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:26,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cb12b2b51e9ad97a0a8 HTTP/1.1" 200 None 2026-03-25 16:39:26,818 - lava_callback - ERROR - Error processing callback for node 69c16cb12b2b51e9ad97a0a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:39:37,879 - lava_callback - INFO - Received callback for node 69c16cb82b2b51e9ad97a0be INFO: 172.21.0.1:51894 - "POST /node/69c16cb82b2b51e9ad97a0be HTTP/1.0" 202 Accepted 2026-03-25 16:39:37,884 - lava_callback - INFO - Starting async job submit for node 69c16cb82b2b51e9ad97a0be 2026-03-25 16:39:37,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:37,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cb82b2b51e9ad97a0be HTTP/1.1" 200 None 2026-03-25 16:39:37,900 - lava_callback - DEBUG - Processing node 69c16cb82b2b51e9ad97a0be: baseline-arm-clabbe 2026-03-25 16:39:37,900 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16cb82b2b51e9ad97a0be 2026-03-25 16:39:37,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:37,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cb82b2b51e9ad97a0be HTTP/1.1" 200 None 2026-03-25 16:39:37,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:37,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:37,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:37,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cb82b2b51e9ad97a0be HTTP/1.1" 200 None 2026-03-25 16:39:37,954 - lava_callback - ERROR - Error processing callback for node 69c16cb82b2b51e9ad97a0be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 16:39:38,567 - lava_callback - INFO - Received callback for node 69c16cbd2b2b51e9ad97a0ce INFO: 172.21.0.1:51904 - "POST /node/69c16cbd2b2b51e9ad97a0ce HTTP/1.0" 202 Accepted 2026-03-25 16:39:38,573 - lava_callback - INFO - Starting async job submit for node 69c16cbd2b2b51e9ad97a0ce 2026-03-25 16:39:38,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:38,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cbd2b2b51e9ad97a0ce HTTP/1.1" 200 None 2026-03-25 16:39:38,594 - lava_callback - DEBUG - Processing node 69c16cbd2b2b51e9ad97a0ce: baseline-arm-clabbe 2026-03-25 16:39:38,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16cbd2b2b51e9ad97a0ce 2026-03-25 16:39:38,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:38,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cbd2b2b51e9ad97a0ce HTTP/1.1" 200 None 2026-03-25 16:39:38,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:38,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:38,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:38,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cbd2b2b51e9ad97a0ce HTTP/1.1" 200 None 2026-03-25 16:39:38,651 - lava_callback - ERROR - Error processing callback for node 69c16cbd2b2b51e9ad97a0ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 16:39:39,237 - lava_callback - INFO - Received callback for node 69c16cbd2b2b51e9ad97a0d1 INFO: 172.21.0.1:51918 - "POST /node/69c16cbd2b2b51e9ad97a0d1 HTTP/1.0" 202 Accepted 2026-03-25 16:39:39,243 - lava_callback - INFO - Starting async job submit for node 69c16cbd2b2b51e9ad97a0d1 2026-03-25 16:39:39,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:39,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cbd2b2b51e9ad97a0d1 HTTP/1.1" 200 None 2026-03-25 16:39:39,259 - lava_callback - DEBUG - Processing node 69c16cbd2b2b51e9ad97a0d1: baseline-arm-clabbe 2026-03-25 16:39:39,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16cbd2b2b51e9ad97a0d1 2026-03-25 16:39:39,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:39,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cbd2b2b51e9ad97a0d1 HTTP/1.1" 200 None 2026-03-25 16:39:39,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:39,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:39,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:39,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cbd2b2b51e9ad97a0d1 HTTP/1.1" 200 None 2026-03-25 16:39:39,321 - lava_callback - ERROR - Error processing callback for node 69c16cbd2b2b51e9ad97a0d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 16:39:39,990 - lava_callback - INFO - Received callback for node 69c16cbe2b2b51e9ad97a0d4 INFO: 172.21.0.1:58838 - "POST /node/69c16cbe2b2b51e9ad97a0d4 HTTP/1.0" 202 Accepted 2026-03-25 16:39:39,995 - lava_callback - INFO - Starting async job submit for node 69c16cbe2b2b51e9ad97a0d4 2026-03-25 16:39:39,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:40,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cbe2b2b51e9ad97a0d4 HTTP/1.1" 200 None 2026-03-25 16:39:40,013 - lava_callback - DEBUG - Processing node 69c16cbe2b2b51e9ad97a0d4: baseline-arm-clabbe 2026-03-25 16:39:40,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16cbe2b2b51e9ad97a0d4 2026-03-25 16:39:40,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:40,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cbe2b2b51e9ad97a0d4 HTTP/1.1" 200 None 2026-03-25 16:39:40,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:40,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:40,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:40,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cbe2b2b51e9ad97a0d4 HTTP/1.1" 200 None 2026-03-25 16:39:40,076 - lava_callback - ERROR - Error processing callback for node 69c16cbe2b2b51e9ad97a0d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 16:39:40,664 - lava_callback - INFO - Received callback for node 69c16cc12b2b51e9ad97a0dd INFO: 172.21.0.1:58842 - "POST /node/69c16cc12b2b51e9ad97a0dd HTTP/1.0" 202 Accepted 2026-03-25 16:39:40,670 - lava_callback - INFO - Starting async job submit for node 69c16cc12b2b51e9ad97a0dd 2026-03-25 16:39:40,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:40,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cc12b2b51e9ad97a0dd HTTP/1.1" 200 None 2026-03-25 16:39:40,686 - lava_callback - DEBUG - Processing node 69c16cc12b2b51e9ad97a0dd: baseline-arm-clabbe 2026-03-25 16:39:40,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16cc12b2b51e9ad97a0dd 2026-03-25 16:39:40,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:40,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cc12b2b51e9ad97a0dd HTTP/1.1" 200 None 2026-03-25 16:39:40,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:40,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 16:39:40,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:39:40,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cc12b2b51e9ad97a0dd HTTP/1.1" 200 None 2026-03-25 16:39:40,785 - lava_callback - ERROR - Error processing callback for node 69c16cc12b2b51e9ad97a0dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:43:35,019 - lava_callback - INFO - Received callback for node 69c410a3944faaf0e7f60be8 INFO: 172.21.0.1:32968 - "POST /node/69c410a3944faaf0e7f60be8 HTTP/1.0" 202 Accepted 2026-03-25 16:43:35,026 - lava_callback - INFO - Starting async job submit for node 69c410a3944faaf0e7f60be8 2026-03-25 16:43:35,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:35,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a3944faaf0e7f60be8 HTTP/1.1" 200 None 2026-03-25 16:43:35,047 - lava_callback - DEBUG - Processing node 69c410a3944faaf0e7f60be8: baseline-arm 2026-03-25 16:43:35,056 - lava_callback - WARNING - Failed to upload log 2026-03-25 16:43:35,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:43:35,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:43:35,247 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a3944faaf0e7f60be8/lava-logs.yaml 2026-03-25 16:43:35,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:43:35,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:43:35,388 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a3944faaf0e7f60be8/lava_callback.json.gz 2026-03-25 16:43:35,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:35,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a3944faaf0e7f60be8 HTTP/1.1" 200 None 2026-03-25 16:43:35,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:35,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:43:35,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:35,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410a3944faaf0e7f60be8 HTTP/1.1" 200 None 2026-03-25 16:43:35,460 - lava_callback - INFO - Completed processing callback for node 69c410a3944faaf0e7f60be8 INFO: 172.21.0.1:32980 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:43:41,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:41,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 16:43:43,917 - lava_callback - INFO - Received callback for node 69c410a7944faaf0e7f60bf4 INFO: 172.21.0.1:36978 - "POST /node/69c410a7944faaf0e7f60bf4 HTTP/1.0" 202 Accepted 2026-03-25 16:43:43,967 - lava_callback - INFO - Starting async job submit for node 69c410a7944faaf0e7f60bf4 2026-03-25 16:43:43,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:44,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a7944faaf0e7f60bf4 HTTP/1.1" 200 None 2026-03-25 16:43:44,014 - lava_callback - DEBUG - Processing node 69c410a7944faaf0e7f60bf4: baseline-arm 2026-03-25 16:43:44,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:43:44,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:43:44,399 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a7944faaf0e7f60bf4/log.txt.gz 2026-03-25 16:43:44,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:43:44,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:43:44,692 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a7944faaf0e7f60bf4/lava-logs.yaml 2026-03-25 16:43:44,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:43:44,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:43:44,820 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a7944faaf0e7f60bf4/lava_callback.json.gz 2026-03-25 16:43:44,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:44,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a7944faaf0e7f60bf4 HTTP/1.1" 200 None 2026-03-25 16:43:44,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:44,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:43:44,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:44,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410a7944faaf0e7f60bf4 HTTP/1.1" 200 None 2026-03-25 16:43:44,926 - lava_callback - INFO - Completed processing callback for node 69c410a7944faaf0e7f60bf4 INFO: 172.21.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:43:57,522 - lava_callback - INFO - Received callback for node 69c410a4944faaf0e7f60beb INFO: 172.21.0.1:60574 - "POST /node/69c410a4944faaf0e7f60beb HTTP/1.0" 202 Accepted 2026-03-25 16:43:57,569 - lava_callback - INFO - Starting async job submit for node 69c410a4944faaf0e7f60beb 2026-03-25 16:43:57,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:57,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a4944faaf0e7f60beb HTTP/1.1" 200 None 2026-03-25 16:43:57,613 - lava_callback - DEBUG - Processing node 69c410a4944faaf0e7f60beb: baseline-arm 2026-03-25 16:43:57,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:43:57,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:43:57,875 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a4944faaf0e7f60beb/log.txt.gz 2026-03-25 16:43:57,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:43:58,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:43:58,110 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a4944faaf0e7f60beb/lava-logs.yaml 2026-03-25 16:43:58,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:43:58,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:43:58,263 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a4944faaf0e7f60beb/lava_callback.json.gz 2026-03-25 16:43:58,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:58,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a4944faaf0e7f60beb HTTP/1.1" 200 None 2026-03-25 16:43:58,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:58,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:43:58,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:43:58,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410a4944faaf0e7f60beb HTTP/1.1" 200 None 2026-03-25 16:43:58,384 - lava_callback - INFO - Completed processing callback for node 69c410a4944faaf0e7f60beb INFO: 172.21.0.1:39086 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:44:11,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:11,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48842 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:44:22,191 - lava_callback - INFO - Received callback for node 69c410a6944faaf0e7f60bf1 INFO: 172.21.0.1:45398 - "POST /node/69c410a6944faaf0e7f60bf1 HTTP/1.0" 202 Accepted 2026-03-25 16:44:22,201 - lava_callback - INFO - Starting async job submit for node 69c410a6944faaf0e7f60bf1 2026-03-25 16:44:22,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:22,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a6944faaf0e7f60bf1 HTTP/1.1" 200 None 2026-03-25 16:44:22,273 - lava_callback - DEBUG - Processing node 69c410a6944faaf0e7f60bf1: baseline-arm 2026-03-25 16:44:22,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:22,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:22,760 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a6944faaf0e7f60bf1/log.txt.gz 2026-03-25 16:44:22,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:23,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:23,076 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a6944faaf0e7f60bf1/lava-logs.yaml 2026-03-25 16:44:23,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:23,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:23,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a6944faaf0e7f60bf1/lava_callback.json.gz 2026-03-25 16:44:23,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:23,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a6944faaf0e7f60bf1 HTTP/1.1" 200 None 2026-03-25 16:44:23,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:23,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:44:23,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:23,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410a6944faaf0e7f60bf1 HTTP/1.1" 200 None 2026-03-25 16:44:23,316 - lava_callback - INFO - Completed processing callback for node 69c410a6944faaf0e7f60bf1 INFO: 172.21.0.1:45406 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:44:30,487 - lava_callback - INFO - Received callback for node 69c410a3944faaf0e7f60be5 INFO: 172.21.0.1:45102 - "POST /node/69c410a3944faaf0e7f60be5 HTTP/1.0" 202 Accepted 2026-03-25 16:44:30,502 - lava_callback - INFO - Starting async job submit for node 69c410a3944faaf0e7f60be5 2026-03-25 16:44:30,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:30,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a3944faaf0e7f60be5 HTTP/1.1" 200 None 2026-03-25 16:44:30,573 - lava_callback - DEBUG - Processing node 69c410a3944faaf0e7f60be5: baseline-arm 2026-03-25 16:44:30,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:31,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:31,273 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a3944faaf0e7f60be5/log.txt.gz 2026-03-25 16:44:31,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:31,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:31,708 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a3944faaf0e7f60be5/lava-logs.yaml 2026-03-25 16:44:31,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:32,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:32,143 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a3944faaf0e7f60be5/lava_callback.json.gz 2026-03-25 16:44:32,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:32,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a3944faaf0e7f60be5 HTTP/1.1" 200 None 2026-03-25 16:44:32,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:32,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:44:32,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:32,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410a3944faaf0e7f60be5 HTTP/1.1" 200 None 2026-03-25 16:44:32,349 - lava_callback - INFO - Completed processing callback for node 69c410a3944faaf0e7f60be5 INFO: 172.21.0.1:45110 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:44:41,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:41,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 16:44:43,396 - lava_callback - INFO - Received callback for node 69c410c8944faaf0e7f60c65 INFO: 172.21.0.1:35804 - "POST /node/69c410c8944faaf0e7f60c65 HTTP/1.0" 202 Accepted 2026-03-25 16:44:43,406 - lava_callback - INFO - Starting async job submit for node 69c410c8944faaf0e7f60c65 2026-03-25 16:44:43,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:43,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c8944faaf0e7f60c65 HTTP/1.1" 200 None 2026-03-25 16:44:43,478 - lava_callback - DEBUG - Processing node 69c410c8944faaf0e7f60c65: baseline-arm-pengutronix 2026-03-25 16:44:43,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:43,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:43,826 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c8944faaf0e7f60c65/log.txt.gz 2026-03-25 16:44:43,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:44,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:44,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c8944faaf0e7f60c65/lava-logs.yaml 2026-03-25 16:44:44,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35808 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:44:44,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:44,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c8944faaf0e7f60c65/lava_callback.json.gz 2026-03-25 16:44:44,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:44,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c8944faaf0e7f60c65 HTTP/1.1" 200 None 2026-03-25 16:44:44,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:44,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:44:44,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:44,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410c8944faaf0e7f60c65 HTTP/1.1" 200 None 2026-03-25 16:44:44,829 - lava_callback - INFO - Completed processing callback for node 69c410c8944faaf0e7f60c65 2026-03-25 16:44:45,122 - lava_callback - INFO - Received callback for node 69c410c7944faaf0e7f60c62 INFO: 172.21.0.1:35820 - "POST /node/69c410c7944faaf0e7f60c62 HTTP/1.0" 202 Accepted 2026-03-25 16:44:45,131 - lava_callback - INFO - Starting async job submit for node 69c410c7944faaf0e7f60c62 2026-03-25 16:44:45,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:45,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c7944faaf0e7f60c62 HTTP/1.1" 200 None 2026-03-25 16:44:45,235 - lava_callback - DEBUG - Processing node 69c410c7944faaf0e7f60c62: baseline-arm-pengutronix 2026-03-25 16:44:45,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:45,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:45,577 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c7944faaf0e7f60c62/log.txt.gz 2026-03-25 16:44:45,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:46,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:46,354 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c7944faaf0e7f60c62/lava-logs.yaml 2026-03-25 16:44:46,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35822 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:44:46,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:46,580 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c7944faaf0e7f60c62/lava_callback.json.gz 2026-03-25 16:44:46,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:46,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c7944faaf0e7f60c62 HTTP/1.1" 200 None 2026-03-25 16:44:46,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:46,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:44:46,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:46,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410c7944faaf0e7f60c62 HTTP/1.1" 200 None 2026-03-25 16:44:46,703 - lava_callback - INFO - Completed processing callback for node 69c410c7944faaf0e7f60c62 2026-03-25 16:44:53,472 - lava_callback - INFO - Received callback for node 69c410cb944faaf0e7f60c8d INFO: 172.21.0.1:54688 - "POST /node/69c410cb944faaf0e7f60c8d HTTP/1.0" 202 Accepted 2026-03-25 16:44:53,526 - lava_callback - INFO - Starting async job submit for node 69c410cb944faaf0e7f60c8d 2026-03-25 16:44:53,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:53,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410cb944faaf0e7f60c8d HTTP/1.1" 200 None 2026-03-25 16:44:53,588 - lava_callback - DEBUG - Processing node 69c410cb944faaf0e7f60c8d: baseline-arm-pengutronix 2026-03-25 16:44:53,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:54,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:54,010 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410cb944faaf0e7f60c8d/log.txt.gz 2026-03-25 16:44:54,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:54,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:54,533 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410cb944faaf0e7f60c8d/lava-logs.yaml 2026-03-25 16:44:54,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:44:54,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:44:54,692 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410cb944faaf0e7f60c8d/lava_callback.json.gz 2026-03-25 16:44:54,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:54,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410cb944faaf0e7f60c8d HTTP/1.1" 200 None 2026-03-25 16:44:54,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:54,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:44:54,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:44:54,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410cb944faaf0e7f60c8d HTTP/1.1" 200 None 2026-03-25 16:44:54,778 - lava_callback - INFO - Completed processing callback for node 69c410cb944faaf0e7f60c8d INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:45:02,143 - lava_callback - INFO - Received callback for node 69c410b6944faaf0e7f60c25 INFO: 172.21.0.1:55266 - "POST /node/69c410b6944faaf0e7f60c25 HTTP/1.0" 202 Accepted 2026-03-25 16:45:02,151 - lava_callback - INFO - Starting async job submit for node 69c410b6944faaf0e7f60c25 2026-03-25 16:45:02,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:02,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b6944faaf0e7f60c25 HTTP/1.1" 200 None 2026-03-25 16:45:02,197 - lava_callback - DEBUG - Processing node 69c410b6944faaf0e7f60c25: baseline-arm-broonie 2026-03-25 16:45:02,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:02,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:02,766 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b6944faaf0e7f60c25/log.txt.gz 2026-03-25 16:45:02,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:03,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:03,279 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b6944faaf0e7f60c25/lava-logs.yaml 2026-03-25 16:45:03,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:03,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:03,475 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b6944faaf0e7f60c25/lava_callback.json.gz 2026-03-25 16:45:03,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:03,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b6944faaf0e7f60c25 HTTP/1.1" 200 None 2026-03-25 16:45:03,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:03,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:45:03,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:03,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410b6944faaf0e7f60c25 HTTP/1.1" 200 None 2026-03-25 16:45:03,563 - lava_callback - INFO - Completed processing callback for node 69c410b6944faaf0e7f60c25 2026-03-25 16:45:03,681 - lava_callback - INFO - Received callback for node 69c410b8944faaf0e7f60c2a INFO: 172.21.0.1:55282 - "POST /node/69c410b8944faaf0e7f60c2a HTTP/1.0" 202 Accepted 2026-03-25 16:45:03,691 - lava_callback - INFO - Starting async job submit for node 69c410b8944faaf0e7f60c2a 2026-03-25 16:45:03,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:03,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b8944faaf0e7f60c2a HTTP/1.1" 200 None 2026-03-25 16:45:03,750 - lava_callback - DEBUG - Processing node 69c410b8944faaf0e7f60c2a: baseline-arm-broonie 2026-03-25 16:45:04,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:04,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:04,404 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b8944faaf0e7f60c2a/log.txt.gz 2026-03-25 16:45:04,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:05,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:05,156 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b8944faaf0e7f60c2a/lava-logs.yaml 2026-03-25 16:45:05,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:05,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:05,364 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b8944faaf0e7f60c2a/lava_callback.json.gz 2026-03-25 16:45:05,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:05,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b8944faaf0e7f60c2a HTTP/1.1" 200 None 2026-03-25 16:45:05,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:05,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:45:05,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:05,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410b8944faaf0e7f60c2a HTTP/1.1" 200 None 2026-03-25 16:45:05,457 - lava_callback - INFO - Completed processing callback for node 69c410b8944faaf0e7f60c2a INFO: 172.21.0.1:55286 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:45:11,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:11,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-25 16:45:12,494 - lava_callback - INFO - Received callback for node 69c410bd944faaf0e7f60c3d INFO: 172.21.0.1:57898 - "POST /node/69c410bd944faaf0e7f60c3d HTTP/1.0" 202 Accepted 2026-03-25 16:45:12,506 - lava_callback - INFO - Starting async job submit for node 69c410bd944faaf0e7f60c3d 2026-03-25 16:45:12,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:12,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410bd944faaf0e7f60c3d HTTP/1.1" 200 None 2026-03-25 16:45:12,583 - lava_callback - DEBUG - Processing node 69c410bd944faaf0e7f60c3d: baseline-arm-clabbe 2026-03-25 16:45:12,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:13,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:13,032 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410bd944faaf0e7f60c3d/log.txt.gz 2026-03-25 16:45:13,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:13,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:13,680 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410bd944faaf0e7f60c3d/lava-logs.yaml 2026-03-25 16:45:13,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:45:13,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:45:13,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410bd944faaf0e7f60c3d/lava_callback.json.gz 2026-03-25 16:45:13,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:13,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410bd944faaf0e7f60c3d HTTP/1.1" 200 None 2026-03-25 16:45:13,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:13,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:45:13,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:13,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410bd944faaf0e7f60c3d HTTP/1.1" 200 None 2026-03-25 16:45:13,976 - lava_callback - INFO - Completed processing callback for node 69c410bd944faaf0e7f60c3d INFO: 172.21.0.1:57910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34034 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:45:41,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:41,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 16:45:43,654 - lava_callback - INFO - Received callback for node 69c16e222b2b51e9ad97a331 INFO: 172.21.0.1:58436 - "POST /node/69c16e222b2b51e9ad97a331 HTTP/1.0" 202 Accepted 2026-03-25 16:45:43,660 - lava_callback - INFO - Starting async job submit for node 69c16e222b2b51e9ad97a331 2026-03-25 16:45:43,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:43,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16e222b2b51e9ad97a331 HTTP/1.1" 200 None 2026-03-25 16:45:43,683 - lava_callback - DEBUG - Processing node 69c16e222b2b51e9ad97a331: baseline-arm64-baylibre 2026-03-25 16:45:43,683 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16e222b2b51e9ad97a331 2026-03-25 16:45:43,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:43,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16e222b2b51e9ad97a331 HTTP/1.1" 200 None 2026-03-25 16:45:43,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:43,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 16:45:43,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:45:43,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16e222b2b51e9ad97a331 HTTP/1.1" 200 None 2026-03-25 16:45:43,770 - lava_callback - ERROR - Error processing callback for node 69c16e222b2b51e9ad97a331: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:46:15,144 - lava_callback - INFO - Received callback for node 69c41141944faaf0e7f60d3c INFO: 172.21.0.1:45596 - "POST /node/69c41141944faaf0e7f60d3c HTTP/1.0" 202 Accepted 2026-03-25 16:46:15,153 - lava_callback - INFO - Starting async job submit for node 69c41141944faaf0e7f60d3c INFO: 172.21.0.1:45598 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 16:46:15,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:15,204 - lava_callback - INFO - Received callback for node 69c410e6944faaf0e7f60cac 2026-03-25 16:46:15,214 - lava_callback - INFO - Starting async job submit for node 69c410e6944faaf0e7f60cac INFO: 172.21.0.1:45606 - "POST /node/69c410e6944faaf0e7f60cac HTTP/1.0" 202 Accepted 2026-03-25 16:46:15,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41141944faaf0e7f60d3c HTTP/1.1" 200 None 2026-03-25 16:46:15,267 - lava_callback - DEBUG - Processing node 69c41141944faaf0e7f60d3c: baseline-x86 2026-03-25 16:46:15,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:15,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e6944faaf0e7f60cac HTTP/1.1" 200 None 2026-03-25 16:46:15,382 - lava_callback - DEBUG - Processing node 69c410e6944faaf0e7f60cac: ltp-dio 2026-03-25 16:46:15,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:16,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:16,312 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c41141944faaf0e7f60d3c/log.txt.gz 2026-03-25 16:46:16,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:16,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:46:16,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:16,909 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69c410e6944faaf0e7f60cac/log.txt.gz 2026-03-25 16:46:16,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:16,990 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c41141944faaf0e7f60d3c/lava-logs.yaml 2026-03-25 16:46:17,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:17,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:17,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:17,600 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c41141944faaf0e7f60d3c/lava_callback.json.gz 2026-03-25 16:46:17,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:17,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41141944faaf0e7f60d3c HTTP/1.1" 200 None 2026-03-25 16:46:17,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:17,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40aef944faaf0e7f5e438 HTTP/1.1" 200 None 2026-03-25 16:46:17,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:17,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41141944faaf0e7f60d3c HTTP/1.1" 200 None 2026-03-25 16:46:17,728 - lava_callback - INFO - Completed processing callback for node 69c41141944faaf0e7f60d3c 2026-03-25 16:46:17,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:17,754 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69c410e6944faaf0e7f60cac/lava-logs.yaml 2026-03-25 16:46:17,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:18,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:18,417 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69c410e6944faaf0e7f60cac/lava_callback.json.gz 2026-03-25 16:46:18,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:18,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e6944faaf0e7f60cac HTTP/1.1" 200 None 2026-03-25 16:46:18,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:18,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:46:18,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:18,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410e6944faaf0e7f60cac HTTP/1.1" 200 None 2026-03-25 16:46:18,568 - lava_callback - INFO - Completed processing callback for node 69c410e6944faaf0e7f60cac INFO: 172.21.0.1:33404 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:46:30,383 - lava_callback - INFO - Received callback for node 69c41143944faaf0e7f60d49 INFO: 172.21.0.1:47046 - "POST /node/69c41143944faaf0e7f60d49 HTTP/1.0" 202 Accepted 2026-03-25 16:46:30,392 - lava_callback - INFO - Starting async job submit for node 69c41143944faaf0e7f60d49 2026-03-25 16:46:30,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:30,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41143944faaf0e7f60d49 HTTP/1.1" 200 None 2026-03-25 16:46:30,438 - lava_callback - DEBUG - Processing node 69c41143944faaf0e7f60d49: baseline-x86 2026-03-25 16:46:30,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:31,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:31,077 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c41143944faaf0e7f60d49/log.txt.gz 2026-03-25 16:46:31,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:31,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:31,681 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c41143944faaf0e7f60d49/lava-logs.yaml 2026-03-25 16:46:31,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:31,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:31,858 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c41143944faaf0e7f60d49/lava_callback.json.gz 2026-03-25 16:46:31,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:31,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41143944faaf0e7f60d49 HTTP/1.1" 200 None 2026-03-25 16:46:31,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:31,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40aef944faaf0e7f5e438 HTTP/1.1" 200 None 2026-03-25 16:46:31,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:31,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41143944faaf0e7f60d49 HTTP/1.1" 200 None 2026-03-25 16:46:31,962 - lava_callback - INFO - Completed processing callback for node 69c41143944faaf0e7f60d49 INFO: 172.21.0.1:47058 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:46:39,424 - lava_callback - INFO - Received callback for node 69c410be944faaf0e7f60c41 INFO: 172.21.0.1:47066 - "POST /node/69c410be944faaf0e7f60c41 HTTP/1.0" 202 Accepted 2026-03-25 16:46:39,434 - lava_callback - INFO - Starting async job submit for node 69c410be944faaf0e7f60c41 2026-03-25 16:46:39,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:39,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410be944faaf0e7f60c41 HTTP/1.1" 200 None 2026-03-25 16:46:39,509 - lava_callback - DEBUG - Processing node 69c410be944faaf0e7f60c41: baseline-arm-clabbe 2026-03-25 16:46:39,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:40,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:40,102 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410be944faaf0e7f60c41/log.txt.gz 2026-03-25 16:46:40,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:40,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:40,601 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410be944faaf0e7f60c41/lava-logs.yaml 2026-03-25 16:46:40,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:46:40,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:46:40,767 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410be944faaf0e7f60c41/lava_callback.json.gz 2026-03-25 16:46:40,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:40,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410be944faaf0e7f60c41 HTTP/1.1" 200 None 2026-03-25 16:46:40,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:40,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:46:40,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:40,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410be944faaf0e7f60c41 HTTP/1.1" 200 None 2026-03-25 16:46:40,855 - lava_callback - INFO - Completed processing callback for node 69c410be944faaf0e7f60c41 2026-03-25 16:46:41,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:46:41,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:47:06,859 - lava_callback - INFO - Received callback for node 69c41141944faaf0e7f60d43 INFO: 172.21.0.1:51052 - "POST /node/69c41141944faaf0e7f60d43 HTTP/1.0" 202 Accepted 2026-03-25 16:47:06,865 - lava_callback - INFO - Starting async job submit for node 69c41141944faaf0e7f60d43 2026-03-25 16:47:06,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:06,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41141944faaf0e7f60d43 HTTP/1.1" 200 None 2026-03-25 16:47:06,907 - lava_callback - DEBUG - Processing node 69c41141944faaf0e7f60d43: baseline-x86 2026-03-25 16:47:07,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:07,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:07,388 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c41141944faaf0e7f60d43/log.txt.gz 2026-03-25 16:47:07,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:07,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:07,775 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c41141944faaf0e7f60d43/lava-logs.yaml 2026-03-25 16:47:07,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:07,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:07,921 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c41141944faaf0e7f60d43/lava_callback.json.gz 2026-03-25 16:47:07,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:08,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41141944faaf0e7f60d43 HTTP/1.1" 200 None 2026-03-25 16:47:08,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:08,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40aef944faaf0e7f5e438 HTTP/1.1" 200 None 2026-03-25 16:47:08,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:08,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41141944faaf0e7f60d43 HTTP/1.1" 200 None 2026-03-25 16:47:08,059 - lava_callback - INFO - Completed processing callback for node 69c41141944faaf0e7f60d43 2026-03-25 16:47:11,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:11,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54404 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:47:19,714 - lava_callback - INFO - Received callback for node 69c41180944faaf0e7f60dc5 INFO: 172.21.0.1:54220 - "POST /node/69c41180944faaf0e7f60dc5 HTTP/1.0" 202 Accepted 2026-03-25 16:47:19,721 - lava_callback - INFO - Starting async job submit for node 69c41180944faaf0e7f60dc5 2026-03-25 16:47:19,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:19,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41180944faaf0e7f60dc5 HTTP/1.1" 200 None 2026-03-25 16:47:19,757 - lava_callback - DEBUG - Processing node 69c41180944faaf0e7f60dc5: baseline-arm64 2026-03-25 16:47:19,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:20,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:20,025 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41180944faaf0e7f60dc5/log.txt.gz 2026-03-25 16:47:20,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:20,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:20,367 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41180944faaf0e7f60dc5/lava-logs.yaml 2026-03-25 16:47:20,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:20,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:20,499 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41180944faaf0e7f60dc5/lava_callback.json.gz 2026-03-25 16:47:20,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:20,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41180944faaf0e7f60dc5 HTTP/1.1" 200 None 2026-03-25 16:47:20,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:20,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:47:20,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:20,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41180944faaf0e7f60dc5 HTTP/1.1" 200 None 2026-03-25 16:47:20,601 - lava_callback - INFO - Completed processing callback for node 69c41180944faaf0e7f60dc5 2026-03-25 16:47:20,687 - lava_callback - INFO - Received callback for node 69c41174944faaf0e7f60d8d INFO: 172.21.0.1:54236 - "POST /node/69c41174944faaf0e7f60d8d HTTP/1.0" 202 Accepted 2026-03-25 16:47:20,695 - lava_callback - INFO - Starting async job submit for node 69c41174944faaf0e7f60d8d 2026-03-25 16:47:20,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:20,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41174944faaf0e7f60d8d HTTP/1.1" 200 None 2026-03-25 16:47:20,733 - lava_callback - DEBUG - Processing node 69c41174944faaf0e7f60d8d: baseline-arm64 2026-03-25 16:47:20,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:21,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:21,103 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41174944faaf0e7f60d8d/log.txt.gz 2026-03-25 16:47:21,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:21,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:21,377 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41174944faaf0e7f60d8d/lava-logs.yaml 2026-03-25 16:47:21,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:21,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:21,538 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41174944faaf0e7f60d8d/lava_callback.json.gz 2026-03-25 16:47:21,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:21,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41174944faaf0e7f60d8d HTTP/1.1" 200 None 2026-03-25 16:47:21,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:21,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:47:21,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:21,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41174944faaf0e7f60d8d HTTP/1.1" 200 None 2026-03-25 16:47:21,622 - lava_callback - INFO - Completed processing callback for node 69c41174944faaf0e7f60d8d 2026-03-25 16:47:24,053 - lava_callback - INFO - Received callback for node 69c41191944faaf0e7f60df3 INFO: 172.21.0.1:54248 - "POST /node/69c41191944faaf0e7f60df3 HTTP/1.0" 202 Accepted 2026-03-25 16:47:24,066 - lava_callback - INFO - Starting async job submit for node 69c41191944faaf0e7f60df3 2026-03-25 16:47:24,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:24,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41191944faaf0e7f60df3 HTTP/1.1" 200 None 2026-03-25 16:47:24,118 - lava_callback - DEBUG - Processing node 69c41191944faaf0e7f60df3: baseline-nfs-arm64 2026-03-25 16:47:24,120 - lava_callback - WARNING - Failed to upload log 2026-03-25 16:47:24,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:24,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:24,272 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41191944faaf0e7f60df3/lava-logs.yaml 2026-03-25 16:47:24,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:47:24,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:47:24,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41191944faaf0e7f60df3/lava_callback.json.gz 2026-03-25 16:47:24,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:24,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41191944faaf0e7f60df3 HTTP/1.1" 200 None 2026-03-25 16:47:24,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:24,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:47:24,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:24,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41191944faaf0e7f60df3 HTTP/1.1" 200 None 2026-03-25 16:47:24,476 - lava_callback - INFO - Completed processing callback for node 69c41191944faaf0e7f60df3 INFO: 172.21.0.1:54260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59718 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:47:41,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:47:41,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:48:08,500 - lava_callback - INFO - Received callback for node 69c41175944faaf0e7f60d93 INFO: 172.21.0.1:48770 - "POST /node/69c41175944faaf0e7f60d93 HTTP/1.0" 202 Accepted 2026-03-25 16:48:08,508 - lava_callback - INFO - Starting async job submit for node 69c41175944faaf0e7f60d93 2026-03-25 16:48:08,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:08,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41175944faaf0e7f60d93 HTTP/1.1" 200 None 2026-03-25 16:48:08,550 - lava_callback - DEBUG - Processing node 69c41175944faaf0e7f60d93: baseline-arm64 2026-03-25 16:48:08,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:08,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:08,994 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41175944faaf0e7f60d93/log.txt.gz 2026-03-25 16:48:09,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:09,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:09,383 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41175944faaf0e7f60d93/lava-logs.yaml 2026-03-25 16:48:09,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:09,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:09,516 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41175944faaf0e7f60d93/lava_callback.json.gz 2026-03-25 16:48:09,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:09,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41175944faaf0e7f60d93 HTTP/1.1" 200 None 2026-03-25 16:48:09,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:09,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:09,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:09,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41175944faaf0e7f60d93 HTTP/1.1" 200 None 2026-03-25 16:48:09,611 - lava_callback - INFO - Completed processing callback for node 69c41175944faaf0e7f60d93 2026-03-25 16:48:11,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:11,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50852 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:48:18,524 - lava_callback - INFO - Received callback for node 69c410c1944faaf0e7f60c51 INFO: 172.21.0.1:50864 - "POST /node/69c410c1944faaf0e7f60c51 HTTP/1.0" 202 Accepted 2026-03-25 16:48:18,530 - lava_callback - INFO - Starting async job submit for node 69c410c1944faaf0e7f60c51 2026-03-25 16:48:18,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:18,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c1944faaf0e7f60c51 HTTP/1.1" 200 None 2026-03-25 16:48:18,567 - lava_callback - DEBUG - Processing node 69c410c1944faaf0e7f60c51: baseline-arm-clabbe 2026-03-25 16:48:18,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:18,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:18,888 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410c1944faaf0e7f60c51/log.txt.gz 2026-03-25 16:48:19,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:19,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:19,230 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410c1944faaf0e7f60c51/lava-logs.yaml 2026-03-25 16:48:19,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:19,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:19,426 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410c1944faaf0e7f60c51/lava_callback.json.gz 2026-03-25 16:48:19,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:19,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c1944faaf0e7f60c51 HTTP/1.1" 200 None 2026-03-25 16:48:19,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:19,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:48:19,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:19,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410c1944faaf0e7f60c51 HTTP/1.1" 200 None 2026-03-25 16:48:19,512 - lava_callback - INFO - Completed processing callback for node 69c410c1944faaf0e7f60c51 2026-03-25 16:48:20,677 - lava_callback - INFO - Received callback for node 69c41177944faaf0e7f60d99 INFO: 172.21.0.1:54814 - "POST /node/69c41177944faaf0e7f60d99 HTTP/1.0" 202 Accepted 2026-03-25 16:48:20,683 - lava_callback - INFO - Starting async job submit for node 69c41177944faaf0e7f60d99 2026-03-25 16:48:20,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:20,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41177944faaf0e7f60d99 HTTP/1.1" 200 None 2026-03-25 16:48:20,759 - lava_callback - DEBUG - Processing node 69c41177944faaf0e7f60d99: baseline-arm64 2026-03-25 16:48:20,916 - lava_callback - WARNING - Failed to upload log 2026-03-25 16:48:20,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:21,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:21,155 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41177944faaf0e7f60d99/lava-logs.yaml 2026-03-25 16:48:21,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:21,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:21,313 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41177944faaf0e7f60d99/lava_callback.json.gz 2026-03-25 16:48:21,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:21,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41177944faaf0e7f60d99 HTTP/1.1" 200 None 2026-03-25 16:48:21,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:21,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:21,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:21,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41177944faaf0e7f60d99 HTTP/1.1" 200 None 2026-03-25 16:48:21,465 - lava_callback - INFO - Completed processing callback for node 69c41177944faaf0e7f60d99 2026-03-25 16:48:25,116 - lava_callback - INFO - Received callback for node 69c41174944faaf0e7f60d90 INFO: 172.21.0.1:54816 - "POST /node/69c41174944faaf0e7f60d90 HTTP/1.0" 202 Accepted 2026-03-25 16:48:25,123 - lava_callback - INFO - Starting async job submit for node 69c41174944faaf0e7f60d90 2026-03-25 16:48:25,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:25,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41174944faaf0e7f60d90 HTTP/1.1" 200 None 2026-03-25 16:48:25,167 - lava_callback - DEBUG - Processing node 69c41174944faaf0e7f60d90: baseline-arm64 2026-03-25 16:48:25,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:25,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:25,594 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41174944faaf0e7f60d90/log.txt.gz 2026-03-25 16:48:25,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:25,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:25,943 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41174944faaf0e7f60d90/lava-logs.yaml 2026-03-25 16:48:25,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:26,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:26,080 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41174944faaf0e7f60d90/lava_callback.json.gz 2026-03-25 16:48:26,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:26,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41174944faaf0e7f60d90 HTTP/1.1" 200 None 2026-03-25 16:48:26,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:26,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:26,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:26,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41174944faaf0e7f60d90 HTTP/1.1" 200 None 2026-03-25 16:48:26,164 - lava_callback - INFO - Completed processing callback for node 69c41174944faaf0e7f60d90 INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:48:28,820 - lava_callback - INFO - Received callback for node 69c41185944faaf0e7f60dd1 INFO: 172.21.0.1:54840 - "POST /node/69c41185944faaf0e7f60dd1 HTTP/1.0" 202 Accepted 2026-03-25 16:48:28,826 - lava_callback - INFO - Starting async job submit for node 69c41185944faaf0e7f60dd1 2026-03-25 16:48:28,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:28,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41185944faaf0e7f60dd1 HTTP/1.1" 200 None 2026-03-25 16:48:28,863 - lava_callback - DEBUG - Processing node 69c41185944faaf0e7f60dd1: baseline-arm64 2026-03-25 16:48:29,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:29,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:29,250 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41185944faaf0e7f60dd1/log.txt.gz 2026-03-25 16:48:29,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:29,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:29,581 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41185944faaf0e7f60dd1/lava-logs.yaml 2026-03-25 16:48:29,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:29,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:29,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41185944faaf0e7f60dd1/lava_callback.json.gz 2026-03-25 16:48:29,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:29,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41185944faaf0e7f60dd1 HTTP/1.1" 200 None 2026-03-25 16:48:29,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:29,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:29,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:29,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41185944faaf0e7f60dd1 HTTP/1.1" 200 None 2026-03-25 16:48:29,808 - lava_callback - INFO - Completed processing callback for node 69c41185944faaf0e7f60dd1 2026-03-25 16:48:32,986 - lava_callback - INFO - Received callback for node 69c41181944faaf0e7f60dc8 INFO: 172.21.0.1:50466 - "POST /node/69c41181944faaf0e7f60dc8 HTTP/1.0" 202 Accepted 2026-03-25 16:48:32,992 - lava_callback - INFO - Starting async job submit for node 69c41181944faaf0e7f60dc8 2026-03-25 16:48:33,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:33,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41181944faaf0e7f60dc8 HTTP/1.1" 200 None 2026-03-25 16:48:33,028 - lava_callback - DEBUG - Processing node 69c41181944faaf0e7f60dc8: baseline-arm64 2026-03-25 16:48:33,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:33,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:33,411 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41181944faaf0e7f60dc8/log.txt.gz 2026-03-25 16:48:33,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:33,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:33,733 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41181944faaf0e7f60dc8/lava-logs.yaml 2026-03-25 16:48:33,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:33,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:33,890 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41181944faaf0e7f60dc8/lava_callback.json.gz 2026-03-25 16:48:33,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:33,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41181944faaf0e7f60dc8 HTTP/1.1" 200 None 2026-03-25 16:48:33,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:33,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:33,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:33,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41181944faaf0e7f60dc8 HTTP/1.1" 200 None 2026-03-25 16:48:33,989 - lava_callback - INFO - Completed processing callback for node 69c41181944faaf0e7f60dc8 INFO: 172.21.0.1:50472 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:48:37,936 - lava_callback - INFO - Received callback for node 69c411ba944faaf0e7f60e94 INFO: 172.21.0.1:50488 - "POST /node/69c411ba944faaf0e7f60e94 HTTP/1.0" 202 Accepted 2026-03-25 16:48:37,943 - lava_callback - INFO - Starting async job submit for node 69c411ba944faaf0e7f60e94 2026-03-25 16:48:37,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:37,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411ba944faaf0e7f60e94 HTTP/1.1" 200 None 2026-03-25 16:48:37,977 - lava_callback - DEBUG - Processing node 69c411ba944faaf0e7f60e94: baseline-arm64-pengutronix 2026-03-25 16:48:38,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:38,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:38,276 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411ba944faaf0e7f60e94/log.txt.gz 2026-03-25 16:48:38,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:38,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:38,562 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411ba944faaf0e7f60e94/lava-logs.yaml 2026-03-25 16:48:38,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:38,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:38,697 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411ba944faaf0e7f60e94/lava_callback.json.gz 2026-03-25 16:48:38,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:38,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411ba944faaf0e7f60e94 HTTP/1.1" 200 None 2026-03-25 16:48:38,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:38,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:38,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:38,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411ba944faaf0e7f60e94 HTTP/1.1" 200 None 2026-03-25 16:48:38,781 - lava_callback - INFO - Completed processing callback for node 69c411ba944faaf0e7f60e94 2026-03-25 16:48:41,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:41,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:49974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:48:46,726 - lava_callback - INFO - Received callback for node 69c41178944faaf0e7f60d9c INFO: 172.21.0.1:49984 - "POST /node/69c41178944faaf0e7f60d9c HTTP/1.0" 202 Accepted 2026-03-25 16:48:46,733 - lava_callback - INFO - Starting async job submit for node 69c41178944faaf0e7f60d9c 2026-03-25 16:48:46,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:46,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41178944faaf0e7f60d9c HTTP/1.1" 200 None 2026-03-25 16:48:46,795 - lava_callback - DEBUG - Processing node 69c41178944faaf0e7f60d9c: baseline-arm64 2026-03-25 16:48:46,990 - lava_callback - WARNING - Failed to upload log 2026-03-25 16:48:47,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:47,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:47,284 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41178944faaf0e7f60d9c/lava-logs.yaml 2026-03-25 16:48:47,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:47,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:47,402 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41178944faaf0e7f60d9c/lava_callback.json.gz 2026-03-25 16:48:47,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:47,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41178944faaf0e7f60d9c HTTP/1.1" 200 None 2026-03-25 16:48:47,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:47,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:47,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:47,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41178944faaf0e7f60d9c HTTP/1.1" 200 None 2026-03-25 16:48:47,581 - lava_callback - INFO - Completed processing callback for node 69c41178944faaf0e7f60d9c 2026-03-25 16:48:49,766 - lava_callback - INFO - Received callback for node 69c41184944faaf0e7f60dce INFO: 172.21.0.1:57888 - "POST /node/69c41184944faaf0e7f60dce HTTP/1.0" 202 Accepted 2026-03-25 16:48:49,772 - lava_callback - INFO - Starting async job submit for node 69c41184944faaf0e7f60dce 2026-03-25 16:48:49,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:49,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41184944faaf0e7f60dce HTTP/1.1" 200 None 2026-03-25 16:48:49,810 - lava_callback - DEBUG - Processing node 69c41184944faaf0e7f60dce: baseline-arm64 2026-03-25 16:48:50,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:50,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:50,216 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41184944faaf0e7f60dce/log.txt.gz 2026-03-25 16:48:50,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:50,422 - lava_callback - INFO - Received callback for node 69c4117e944faaf0e7f60dbf INFO: 172.21.0.1:57890 - "POST /node/69c4117e944faaf0e7f60dbf HTTP/1.0" 202 Accepted 2026-03-25 16:48:50,429 - lava_callback - INFO - Starting async job submit for node 69c4117e944faaf0e7f60dbf 2026-03-25 16:48:50,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:50,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117e944faaf0e7f60dbf HTTP/1.1" 200 None 2026-03-25 16:48:50,469 - lava_callback - DEBUG - Processing node 69c4117e944faaf0e7f60dbf: baseline-arm64 2026-03-25 16:48:50,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:50,622 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41184944faaf0e7f60dce/lava-logs.yaml 2026-03-25 16:48:50,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:50,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:50,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:50,986 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41184944faaf0e7f60dce/lava_callback.json.gz 2026-03-25 16:48:51,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:51,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41184944faaf0e7f60dce HTTP/1.1" 200 None 2026-03-25 16:48:51,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:51,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:51,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:51,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:51,056 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117e944faaf0e7f60dbf/log.txt.gz 2026-03-25 16:48:51,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41184944faaf0e7f60dce HTTP/1.1" 200 None 2026-03-25 16:48:51,143 - lava_callback - INFO - Completed processing callback for node 69c41184944faaf0e7f60dce 2026-03-25 16:48:51,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:51,520 - lava_callback - INFO - Received callback for node 69c410b9944faaf0e7f60c2d INFO: 172.21.0.1:57892 - "POST /node/69c410b9944faaf0e7f60c2d HTTP/1.0" 202 Accepted 2026-03-25 16:48:51,526 - lava_callback - INFO - Starting async job submit for node 69c410b9944faaf0e7f60c2d 2026-03-25 16:48:51,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:51,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b9944faaf0e7f60c2d HTTP/1.1" 200 None 2026-03-25 16:48:51,566 - lava_callback - DEBUG - Processing node 69c410b9944faaf0e7f60c2d: baseline-arm-broonie 2026-03-25 16:48:51,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:51,679 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117e944faaf0e7f60dbf/lava-logs.yaml 2026-03-25 16:48:51,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:51,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:51,990 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:51,992 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117e944faaf0e7f60dbf/lava_callback.json.gz 2026-03-25 16:48:52,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:52,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:52,019 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b9944faaf0e7f60c2d/log.txt.gz 2026-03-25 16:48:52,095 - lava_callback - INFO - Received callback for node 69c411be944faaf0e7f60e9d 2026-03-25 16:48:52,109 - lava_callback - INFO - Starting async job submit for node 69c411be944faaf0e7f60e9d INFO: 172.21.0.1:57908 - "POST /node/69c411be944faaf0e7f60e9d HTTP/1.0" 202 Accepted 2026-03-25 16:48:52,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117e944faaf0e7f60dbf HTTP/1.1" 200 None 2026-03-25 16:48:52,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:52,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:52,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411be944faaf0e7f60e9d HTTP/1.1" 200 None 2026-03-25 16:48:52,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:52,281 - lava_callback - DEBUG - Processing node 69c411be944faaf0e7f60e9d: baseline-arm64-foundriesio 2026-03-25 16:48:52,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:52,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:52,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4117e944faaf0e7f60dbf HTTP/1.1" 200 None 2026-03-25 16:48:52,403 - lava_callback - INFO - Completed processing callback for node 69c4117e944faaf0e7f60dbf 2026-03-25 16:48:52,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:52,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:52,634 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b9944faaf0e7f60c2d/lava-logs.yaml 2026-03-25 16:48:52,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:52,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:52,744 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c411be944faaf0e7f60e9d/log.txt.gz 2026-03-25 16:48:52,788 - lava_callback - INFO - Received callback for node 69c41196944faaf0e7f60dff INFO: 172.21.0.1:57918 - "POST /node/69c41196944faaf0e7f60dff HTTP/1.0" 202 Accepted 2026-03-25 16:48:52,814 - lava_callback - INFO - Starting async job submit for node 69c41196944faaf0e7f60dff 2026-03-25 16:48:52,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:52,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:52,882 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b9944faaf0e7f60c2d/lava_callback.json.gz 2026-03-25 16:48:52,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:52,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41196944faaf0e7f60dff HTTP/1.1" 200 None 2026-03-25 16:48:52,974 - lava_callback - DEBUG - Processing node 69c41196944faaf0e7f60dff: baseline-nfs-arm64 2026-03-25 16:48:53,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:53,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b9944faaf0e7f60c2d HTTP/1.1" 200 None 2026-03-25 16:48:53,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:53,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:48:53,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:53,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410b9944faaf0e7f60c2d HTTP/1.1" 200 None 2026-03-25 16:48:53,321 - lava_callback - INFO - Completed processing callback for node 69c410b9944faaf0e7f60c2d 2026-03-25 16:48:53,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:53,361 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c411be944faaf0e7f60e9d/lava-logs.yaml 2026-03-25 16:48:53,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:53,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:53,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:53,653 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c411be944faaf0e7f60e9d/lava_callback.json.gz 2026-03-25 16:48:53,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:53,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:53,678 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41196944faaf0e7f60dff/log.txt.gz 2026-03-25 16:48:53,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411be944faaf0e7f60e9d HTTP/1.1" 200 None 2026-03-25 16:48:53,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:53,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:53,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:53,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411be944faaf0e7f60e9d HTTP/1.1" 200 None 2026-03-25 16:48:53,938 - lava_callback - INFO - Completed processing callback for node 69c411be944faaf0e7f60e9d 2026-03-25 16:48:53,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:54,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:54,206 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41196944faaf0e7f60dff/lava-logs.yaml 2026-03-25 16:48:54,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:54,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:54,368 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41196944faaf0e7f60dff/lava_callback.json.gz 2026-03-25 16:48:54,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:54,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41196944faaf0e7f60dff HTTP/1.1" 200 None 2026-03-25 16:48:54,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:54,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:54,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:54,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41196944faaf0e7f60dff HTTP/1.1" 200 None 2026-03-25 16:48:54,471 - lava_callback - INFO - Completed processing callback for node 69c41196944faaf0e7f60dff 2026-03-25 16:48:55,905 - lava_callback - INFO - Received callback for node 69c4117f944faaf0e7f60dc2 INFO: 172.21.0.1:57926 - "POST /node/69c4117f944faaf0e7f60dc2 HTTP/1.0" 202 Accepted 2026-03-25 16:48:55,914 - lava_callback - INFO - Starting async job submit for node 69c4117f944faaf0e7f60dc2 2026-03-25 16:48:55,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:55,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117f944faaf0e7f60dc2 HTTP/1.1" 200 None 2026-03-25 16:48:55,956 - lava_callback - DEBUG - Processing node 69c4117f944faaf0e7f60dc2: baseline-arm64 2026-03-25 16:48:56,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:57932 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:48:56,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:56,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117f944faaf0e7f60dc2/log.txt.gz 2026-03-25 16:48:56,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:57,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:57,145 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117f944faaf0e7f60dc2/lava-logs.yaml 2026-03-25 16:48:57,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:48:57,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:48:57,306 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117f944faaf0e7f60dc2/lava_callback.json.gz 2026-03-25 16:48:57,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:57,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117f944faaf0e7f60dc2 HTTP/1.1" 200 None 2026-03-25 16:48:57,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:57,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:48:57,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:57,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4117f944faaf0e7f60dc2 HTTP/1.1" 200 None 2026-03-25 16:48:57,399 - lava_callback - INFO - Completed processing callback for node 69c4117f944faaf0e7f60dc2 2026-03-25 16:48:59,611 - lava_callback - INFO - Received callback for node 69c41176944faaf0e7f60d96 INFO: 172.21.0.1:57936 - "POST /node/69c41176944faaf0e7f60d96 HTTP/1.0" 202 Accepted 2026-03-25 16:48:59,617 - lava_callback - INFO - Starting async job submit for node 69c41176944faaf0e7f60d96 2026-03-25 16:48:59,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:48:59,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41176944faaf0e7f60d96 HTTP/1.1" 200 None 2026-03-25 16:48:59,654 - lava_callback - DEBUG - Processing node 69c41176944faaf0e7f60d96: baseline-arm64 2026-03-25 16:48:59,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:00,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:00,051 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41176944faaf0e7f60d96/log.txt.gz 2026-03-25 16:49:00,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:00,261 - lava_callback - INFO - Received callback for node 69c411bb944faaf0e7f60e97 INFO: 172.21.0.1:40550 - "POST /node/69c411bb944faaf0e7f60e97 HTTP/1.0" 202 Accepted 2026-03-25 16:49:00,268 - lava_callback - INFO - Starting async job submit for node 69c411bb944faaf0e7f60e97 2026-03-25 16:49:00,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:00,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411bb944faaf0e7f60e97 HTTP/1.1" 200 None 2026-03-25 16:49:00,317 - lava_callback - DEBUG - Processing node 69c411bb944faaf0e7f60e97: baseline-arm64-pengutronix 2026-03-25 16:49:00,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:00,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41176944faaf0e7f60d96/lava-logs.yaml 2026-03-25 16:49:00,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:00,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:00,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:00,683 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41176944faaf0e7f60d96/lava_callback.json.gz 2026-03-25 16:49:00,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:00,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:00,709 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411bb944faaf0e7f60e97/log.txt.gz 2026-03-25 16:49:00,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41176944faaf0e7f60d96 HTTP/1.1" 200 None 2026-03-25 16:49:00,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:00,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:00,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:00,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:00,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41176944faaf0e7f60d96 HTTP/1.1" 200 None 2026-03-25 16:49:00,881 - lava_callback - INFO - Completed processing callback for node 69c41176944faaf0e7f60d96 2026-03-25 16:49:01,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:01,102 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411bb944faaf0e7f60e97/lava-logs.yaml 2026-03-25 16:49:01,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:01,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:01,258 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411bb944faaf0e7f60e97/lava_callback.json.gz 2026-03-25 16:49:01,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:01,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411bb944faaf0e7f60e97 HTTP/1.1" 200 None 2026-03-25 16:49:01,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:01,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:01,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:01,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411bb944faaf0e7f60e97 HTTP/1.1" 200 None 2026-03-25 16:49:01,351 - lava_callback - INFO - Completed processing callback for node 69c411bb944faaf0e7f60e97 2026-03-25 16:49:03,779 - lava_callback - INFO - Received callback for node 69c16ef12b2b51e9ad97a398 INFO: 172.21.0.1:40560 - "POST /node/69c16ef12b2b51e9ad97a398 HTTP/1.0" 202 Accepted 2026-03-25 16:49:03,785 - lava_callback - INFO - Starting async job submit for node 69c16ef12b2b51e9ad97a398 2026-03-25 16:49:03,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:03,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ef12b2b51e9ad97a398 HTTP/1.1" 200 None 2026-03-25 16:49:03,816 - lava_callback - DEBUG - Processing node 69c16ef12b2b51e9ad97a398: baseline-arm64-baylibre 2026-03-25 16:49:03,816 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16ef12b2b51e9ad97a398 2026-03-25 16:49:03,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:03,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ef12b2b51e9ad97a398 HTTP/1.1" 200 None 2026-03-25 16:49:03,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:03,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 16:49:03,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:03,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16ef12b2b51e9ad97a398 HTTP/1.1" 200 None 2026-03-25 16:49:03,890 - lava_callback - ERROR - Error processing callback for node 69c16ef12b2b51e9ad97a398: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:49:08,331 - lava_callback - INFO - Received callback for node 69c4118f944faaf0e7f60dea INFO: 172.21.0.1:40578 - "POST /node/69c4118f944faaf0e7f60dea HTTP/1.0" 202 Accepted 2026-03-25 16:49:08,338 - lava_callback - INFO - Starting async job submit for node 69c4118f944faaf0e7f60dea 2026-03-25 16:49:08,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:08,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4118f944faaf0e7f60dea HTTP/1.1" 200 None 2026-03-25 16:49:08,376 - lava_callback - DEBUG - Processing node 69c4118f944faaf0e7f60dea: baseline-nfs-arm64 2026-03-25 16:49:08,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:09,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:09,005 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118f944faaf0e7f60dea/log.txt.gz 2026-03-25 16:49:09,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:09,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:09,502 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118f944faaf0e7f60dea/lava-logs.yaml 2026-03-25 16:49:09,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:09,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:09,678 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118f944faaf0e7f60dea/lava_callback.json.gz 2026-03-25 16:49:09,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:09,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4118f944faaf0e7f60dea HTTP/1.1" 200 None 2026-03-25 16:49:09,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:09,729 - lava_callback - INFO - Received callback for node 69c411bc944faaf0e7f60e9a INFO: 172.21.0.1:52688 - "POST /node/69c411bc944faaf0e7f60e9a HTTP/1.0" 202 Accepted 2026-03-25 16:49:09,735 - lava_callback - INFO - Starting async job submit for node 69c411bc944faaf0e7f60e9a 2026-03-25 16:49:09,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:09,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:09,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:09,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411bc944faaf0e7f60e9a HTTP/1.1" 200 None 2026-03-25 16:49:09,774 - lava_callback - DEBUG - Processing node 69c411bc944faaf0e7f60e9a: baseline-arm64-pengutronix 2026-03-25 16:49:09,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4118f944faaf0e7f60dea HTTP/1.1" 200 None 2026-03-25 16:49:09,881 - lava_callback - INFO - Completed processing callback for node 69c4118f944faaf0e7f60dea 2026-03-25 16:49:10,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:10,218 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:10,220 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411bc944faaf0e7f60e9a/log.txt.gz 2026-03-25 16:49:10,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:10,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:10,535 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411bc944faaf0e7f60e9a/lava-logs.yaml 2026-03-25 16:49:10,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:10,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:10,670 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c411bc944faaf0e7f60e9a/lava_callback.json.gz 2026-03-25 16:49:10,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:10,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411bc944faaf0e7f60e9a HTTP/1.1" 200 None 2026-03-25 16:49:10,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:10,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:10,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:10,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411bc944faaf0e7f60e9a HTTP/1.1" 200 None 2026-03-25 16:49:10,766 - lava_callback - INFO - Completed processing callback for node 69c411bc944faaf0e7f60e9a 2026-03-25 16:49:11,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:11,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-25 16:49:14,484 - lava_callback - INFO - Received callback for node 69c41195944faaf0e7f60dfc INFO: 172.21.0.1:52702 - "POST /node/69c41195944faaf0e7f60dfc HTTP/1.0" 202 Accepted 2026-03-25 16:49:14,490 - lava_callback - INFO - Starting async job submit for node 69c41195944faaf0e7f60dfc 2026-03-25 16:49:14,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:14,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41195944faaf0e7f60dfc HTTP/1.1" 200 None 2026-03-25 16:49:14,528 - lava_callback - DEBUG - Processing node 69c41195944faaf0e7f60dfc: baseline-nfs-arm64 2026-03-25 16:49:14,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:15,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:15,013 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41195944faaf0e7f60dfc/log.txt.gz INFO: 172.21.0.1:52710 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 16:49:15,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:15,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:15,400 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41195944faaf0e7f60dfc/lava-logs.yaml 2026-03-25 16:49:15,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:15,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:15,551 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41195944faaf0e7f60dfc/lava_callback.json.gz 2026-03-25 16:49:15,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:15,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41195944faaf0e7f60dfc HTTP/1.1" 200 None 2026-03-25 16:49:15,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:15,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:15,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:15,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41195944faaf0e7f60dfc HTTP/1.1" 200 None 2026-03-25 16:49:15,631 - lava_callback - INFO - Completed processing callback for node 69c41195944faaf0e7f60dfc 2026-03-25 16:49:16,444 - lava_callback - INFO - Received callback for node 69c4118c944faaf0e7f60de4 INFO: 172.21.0.1:52722 - "POST /node/69c4118c944faaf0e7f60de4 HTTP/1.0" 202 Accepted 2026-03-25 16:49:16,450 - lava_callback - INFO - Starting async job submit for node 69c4118c944faaf0e7f60de4 2026-03-25 16:49:16,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:16,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4118c944faaf0e7f60de4 HTTP/1.1" 200 None 2026-03-25 16:49:16,489 - lava_callback - DEBUG - Processing node 69c4118c944faaf0e7f60de4: baseline-nfs-arm64 INFO: 172.21.0.1:52732 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:49:16,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:16,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:16,933 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118c944faaf0e7f60de4/log.txt.gz 2026-03-25 16:49:17,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:17,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:17,324 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118c944faaf0e7f60de4/lava-logs.yaml 2026-03-25 16:49:17,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:17,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:17,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118c944faaf0e7f60de4/lava_callback.json.gz 2026-03-25 16:49:17,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:17,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4118c944faaf0e7f60de4 HTTP/1.1" 200 None 2026-03-25 16:49:17,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:17,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:17,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:17,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4118c944faaf0e7f60de4 HTTP/1.1" 200 None 2026-03-25 16:49:17,553 - lava_callback - INFO - Completed processing callback for node 69c4118c944faaf0e7f60de4 2026-03-25 16:49:18,512 - lava_callback - INFO - Received callback for node 69c41190944faaf0e7f60df0 INFO: 172.21.0.1:52738 - "POST /node/69c41190944faaf0e7f60df0 HTTP/1.0" 202 Accepted 2026-03-25 16:49:18,520 - lava_callback - INFO - Starting async job submit for node 69c41190944faaf0e7f60df0 2026-03-25 16:49:18,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:18,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41190944faaf0e7f60df0 HTTP/1.1" 200 None 2026-03-25 16:49:18,557 - lava_callback - DEBUG - Processing node 69c41190944faaf0e7f60df0: baseline-nfs-arm64 2026-03-25 16:49:18,968 - lava_callback - INFO - Received callback for node 69c41192944faaf0e7f60df6 INFO: 172.21.0.1:52746 - "POST /node/69c41192944faaf0e7f60df6 HTTP/1.0" 202 Accepted 2026-03-25 16:49:19,000 - lava_callback - INFO - Starting async job submit for node 69c41192944faaf0e7f60df6 2026-03-25 16:49:19,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:19,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41192944faaf0e7f60df6 HTTP/1.1" 200 None 2026-03-25 16:49:19,161 - lava_callback - DEBUG - Processing node 69c41192944faaf0e7f60df6: baseline-nfs-arm64 2026-03-25 16:49:19,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:19,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:19,522 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41190944faaf0e7f60df0/log.txt.gz 2026-03-25 16:49:19,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:19,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:19,835 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41192944faaf0e7f60df6/log.txt.gz 2026-03-25 16:49:20,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:20,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:20,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:20,326 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41190944faaf0e7f60df0/lava-logs.yaml 2026-03-25 16:49:20,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:20,331 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41192944faaf0e7f60df6/lava-logs.yaml 2026-03-25 16:49:20,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:20,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:20,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:20,496 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41192944faaf0e7f60df6/lava_callback.json.gz 2026-03-25 16:49:20,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:20,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:20,528 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41190944faaf0e7f60df0/lava_callback.json.gz 2026-03-25 16:49:20,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:20,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41192944faaf0e7f60df6 HTTP/1.1" 200 None 2026-03-25 16:49:20,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:20,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41190944faaf0e7f60df0 HTTP/1.1" 200 None 2026-03-25 16:49:20,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:20,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:20,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:20,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:20,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:20,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41192944faaf0e7f60df6 HTTP/1.1" 200 None 2026-03-25 16:49:20,619 - lava_callback - INFO - Completed processing callback for node 69c41192944faaf0e7f60df6 2026-03-25 16:49:20,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41190944faaf0e7f60df0 HTTP/1.1" 200 None 2026-03-25 16:49:20,682 - lava_callback - INFO - Completed processing callback for node 69c41190944faaf0e7f60df0 2026-03-25 16:49:21,471 - lava_callback - INFO - Received callback for node 69c411bf944faaf0e7f60ea0 INFO: 172.21.0.1:47370 - "POST /node/69c411bf944faaf0e7f60ea0 HTTP/1.0" 202 Accepted 2026-03-25 16:49:21,478 - lava_callback - INFO - Starting async job submit for node 69c411bf944faaf0e7f60ea0 2026-03-25 16:49:21,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:21,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411bf944faaf0e7f60ea0 HTTP/1.1" 200 None 2026-03-25 16:49:21,521 - lava_callback - DEBUG - Processing node 69c411bf944faaf0e7f60ea0: baseline-arm64-foundriesio 2026-03-25 16:49:21,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:22,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:22,069 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c411bf944faaf0e7f60ea0/log.txt.gz 2026-03-25 16:49:22,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:22,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:22,542 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c411bf944faaf0e7f60ea0/lava-logs.yaml 2026-03-25 16:49:22,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:22,590 - lava_callback - INFO - Received callback for node 69c41189944faaf0e7f60dda INFO: 172.21.0.1:47386 - "POST /node/69c41189944faaf0e7f60dda HTTP/1.0" 202 Accepted 2026-03-25 16:49:22,600 - lava_callback - INFO - Starting async job submit for node 69c41189944faaf0e7f60dda 2026-03-25 16:49:22,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:22,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41189944faaf0e7f60dda HTTP/1.1" 200 None 2026-03-25 16:49:22,655 - lava_callback - DEBUG - Processing node 69c41189944faaf0e7f60dda: baseline-nfs-arm64 2026-03-25 16:49:22,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:22,792 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c411bf944faaf0e7f60ea0/lava_callback.json.gz 2026-03-25 16:49:22,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:22,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411bf944faaf0e7f60ea0 HTTP/1.1" 200 None 2026-03-25 16:49:22,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:23,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:23,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:23,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:23,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411bf944faaf0e7f60ea0 HTTP/1.1" 200 None 2026-03-25 16:49:23,078 - lava_callback - INFO - Completed processing callback for node 69c411bf944faaf0e7f60ea0 2026-03-25 16:49:23,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:23,189 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41189944faaf0e7f60dda/log.txt.gz 2026-03-25 16:49:23,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:23,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:23,569 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41189944faaf0e7f60dda/lava-logs.yaml 2026-03-25 16:49:23,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:23,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:23,708 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41189944faaf0e7f60dda/lava_callback.json.gz 2026-03-25 16:49:23,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:23,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41189944faaf0e7f60dda HTTP/1.1" 200 None 2026-03-25 16:49:23,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:23,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:23,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:23,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41189944faaf0e7f60dda HTTP/1.1" 200 None 2026-03-25 16:49:23,796 - lava_callback - INFO - Completed processing callback for node 69c41189944faaf0e7f60dda INFO: 172.21.0.1:47396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47838 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:49:41,450 - lava_callback - INFO - Received callback for node 69c411b2944faaf0e7f60e5e INFO: 172.21.0.1:47936 - "POST /node/69c411b2944faaf0e7f60e5e HTTP/1.0" 202 Accepted 2026-03-25 16:49:41,456 - lava_callback - INFO - Starting async job submit for node 69c411b2944faaf0e7f60e5e 2026-03-25 16:49:41,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:41,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b2944faaf0e7f60e5e HTTP/1.1" 200 None 2026-03-25 16:49:41,495 - lava_callback - DEBUG - Processing node 69c411b2944faaf0e7f60e5e: baseline-arm64-broonie 2026-03-25 16:49:41,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:41,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-25 16:49:41,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:41,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:41,915 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411b2944faaf0e7f60e5e/log.txt.gz 2026-03-25 16:49:42,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:42,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:42,287 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411b2944faaf0e7f60e5e/lava-logs.yaml 2026-03-25 16:49:42,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:42,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:42,453 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411b2944faaf0e7f60e5e/lava_callback.json.gz 2026-03-25 16:49:42,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:42,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b2944faaf0e7f60e5e HTTP/1.1" 200 None 2026-03-25 16:49:42,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:42,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:42,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:42,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411b2944faaf0e7f60e5e HTTP/1.1" 200 None 2026-03-25 16:49:42,555 - lava_callback - INFO - Completed processing callback for node 69c411b2944faaf0e7f60e5e 2026-03-25 16:49:42,584 - lava_callback - INFO - Received callback for node 69c4117b944faaf0e7f60da4 INFO: 172.21.0.1:47948 - "POST /node/69c4117b944faaf0e7f60da4 HTTP/1.0" 202 Accepted 2026-03-25 16:49:42,595 - lava_callback - INFO - Starting async job submit for node 69c4117b944faaf0e7f60da4 2026-03-25 16:49:42,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:42,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117b944faaf0e7f60da4 HTTP/1.1" 200 None 2026-03-25 16:49:42,659 - lava_callback - DEBUG - Processing node 69c4117b944faaf0e7f60da4: baseline-arm64 2026-03-25 16:49:42,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:43,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:43,111 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117b944faaf0e7f60da4/log.txt.gz 2026-03-25 16:49:43,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:43,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:43,465 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117b944faaf0e7f60da4/lava-logs.yaml 2026-03-25 16:49:43,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:43,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:43,606 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117b944faaf0e7f60da4/lava_callback.json.gz 2026-03-25 16:49:43,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:43,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117b944faaf0e7f60da4 HTTP/1.1" 200 None 2026-03-25 16:49:43,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:43,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:43,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:43,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4117b944faaf0e7f60da4 HTTP/1.1" 200 None 2026-03-25 16:49:43,782 - lava_callback - INFO - Completed processing callback for node 69c4117b944faaf0e7f60da4 INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:49:53,237 - lava_callback - INFO - Received callback for node 69c411a9944faaf0e7f60e48 INFO: 172.21.0.1:40098 - "POST /node/69c411a9944faaf0e7f60e48 HTTP/1.0" 202 Accepted 2026-03-25 16:49:53,243 - lava_callback - INFO - Starting async job submit for node 69c411a9944faaf0e7f60e48 2026-03-25 16:49:53,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:53,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411a9944faaf0e7f60e48 HTTP/1.1" 200 None 2026-03-25 16:49:53,284 - lava_callback - DEBUG - Processing node 69c411a9944faaf0e7f60e48: baseline-arm64-broonie 2026-03-25 16:49:53,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:53,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:53,653 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411a9944faaf0e7f60e48/log.txt.gz 2026-03-25 16:49:53,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:54,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:54,044 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411a9944faaf0e7f60e48/lava-logs.yaml 2026-03-25 16:49:54,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:49:54,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:49:54,191 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411a9944faaf0e7f60e48/lava_callback.json.gz 2026-03-25 16:49:54,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:54,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411a9944faaf0e7f60e48 HTTP/1.1" 200 None 2026-03-25 16:49:54,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:54,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:49:54,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:49:54,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411a9944faaf0e7f60e48 HTTP/1.1" 200 None 2026-03-25 16:49:54,276 - lava_callback - INFO - Completed processing callback for node 69c411a9944faaf0e7f60e48 INFO: 172.21.0.1:40104 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:50:01,712 - lava_callback - INFO - Received callback for node 69c411b6944faaf0e7f60e6d INFO: 172.21.0.1:38682 - "POST /node/69c411b6944faaf0e7f60e6d HTTP/1.0" 202 Accepted 2026-03-25 16:50:01,718 - lava_callback - INFO - Starting async job submit for node 69c411b6944faaf0e7f60e6d 2026-03-25 16:50:01,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:01,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b6944faaf0e7f60e6d HTTP/1.1" 200 None 2026-03-25 16:50:01,754 - lava_callback - DEBUG - Processing node 69c411b6944faaf0e7f60e6d: baseline-arm64-clabbe 2026-03-25 16:50:01,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:50:02,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:50:02,102 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c411b6944faaf0e7f60e6d/log.txt.gz 2026-03-25 16:50:02,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:50:02,438 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:50:02,440 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c411b6944faaf0e7f60e6d/lava-logs.yaml 2026-03-25 16:50:02,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:50:02,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:50:02,572 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c411b6944faaf0e7f60e6d/lava_callback.json.gz 2026-03-25 16:50:02,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:02,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b6944faaf0e7f60e6d HTTP/1.1" 200 None 2026-03-25 16:50:02,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:02,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:50:02,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:02,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411b6944faaf0e7f60e6d HTTP/1.1" 200 None 2026-03-25 16:50:02,672 - lava_callback - INFO - Completed processing callback for node 69c411b6944faaf0e7f60e6d INFO: 172.21.0.1:38684 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:50:11,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:11,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:39110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39118 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:50:21,038 - lava_callback - INFO - Received callback for node 69c40db8944faaf0e7f5e469 INFO: 172.21.0.1:55800 - "POST /node/69c40db8944faaf0e7f5e469 HTTP/1.0" 202 Accepted 2026-03-25 16:50:21,048 - lava_callback - INFO - Starting async job submit for node 69c40db8944faaf0e7f5e469 2026-03-25 16:50:21,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:21,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40db8944faaf0e7f5e469 HTTP/1.1" 200 None 2026-03-25 16:50:21,132 - lava_callback - DEBUG - Processing node 69c40db8944faaf0e7f5e469: ltp-smoke 2026-03-25 16:50:21,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:50:21,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:50:21,777 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c40db8944faaf0e7f5e469/log.txt.gz 2026-03-25 16:50:22,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:50:22,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:50:22,295 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c40db8944faaf0e7f5e469/lava-logs.yaml 2026-03-25 16:50:22,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:50:22,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:50:22,465 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c40db8944faaf0e7f5e469/lava_callback.json.gz 2026-03-25 16:50:22,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:22,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40db8944faaf0e7f5e469 HTTP/1.1" 200 None 2026-03-25 16:50:22,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:22,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ace944faaf0e7f5e40e HTTP/1.1" 200 None 2026-03-25 16:50:22,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:22,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c40db8944faaf0e7f5e469 HTTP/1.1" 200 None 2026-03-25 16:50:22,816 - lava_callback - INFO - Completed processing callback for node 69c40db8944faaf0e7f5e469 INFO: 172.21.0.1:55816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58464 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:50:41,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:50:41,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57930 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:51:23,681 - lava_callback - INFO - Received callback for node 69c411aa944faaf0e7f60e4b INFO: 172.21.0.1:40316 - "POST /node/69c411aa944faaf0e7f60e4b HTTP/1.0" 202 Accepted 2026-03-25 16:51:23,687 - lava_callback - INFO - Starting async job submit for node 69c411aa944faaf0e7f60e4b 2026-03-25 16:51:23,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:23,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411aa944faaf0e7f60e4b HTTP/1.1" 200 None 2026-03-25 16:51:23,724 - lava_callback - DEBUG - Processing node 69c411aa944faaf0e7f60e4b: baseline-arm64-broonie 2026-03-25 16:51:23,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:51:24,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:51:24,161 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411aa944faaf0e7f60e4b/log.txt.gz 2026-03-25 16:51:24,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:51:24,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:51:24,554 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411aa944faaf0e7f60e4b/lava-logs.yaml 2026-03-25 16:51:24,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:51:24,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:51:24,711 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411aa944faaf0e7f60e4b/lava_callback.json.gz 2026-03-25 16:51:24,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:24,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411aa944faaf0e7f60e4b HTTP/1.1" 200 None 2026-03-25 16:51:24,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:24,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:51:24,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:24,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411aa944faaf0e7f60e4b HTTP/1.1" 200 None 2026-03-25 16:51:24,820 - lava_callback - INFO - Completed processing callback for node 69c411aa944faaf0e7f60e4b INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:51:28,702 - lava_callback - INFO - Received callback for node 69c410c2944faaf0e7f60c54 INFO: 172.21.0.1:40326 - "POST /node/69c410c2944faaf0e7f60c54 HTTP/1.0" 202 Accepted 2026-03-25 16:51:28,708 - lava_callback - INFO - Starting async job submit for node 69c410c2944faaf0e7f60c54 2026-03-25 16:51:28,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:28,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c2944faaf0e7f60c54 HTTP/1.1" 200 None 2026-03-25 16:51:28,763 - lava_callback - DEBUG - Processing node 69c410c2944faaf0e7f60c54: baseline-arm-clabbe 2026-03-25 16:51:28,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:51:29,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:51:29,100 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410c2944faaf0e7f60c54/log.txt.gz 2026-03-25 16:51:29,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:51:29,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:51:29,422 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410c2944faaf0e7f60c54/lava-logs.yaml 2026-03-25 16:51:29,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:51:29,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:51:29,564 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c410c2944faaf0e7f60c54/lava_callback.json.gz 2026-03-25 16:51:29,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:29,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c2944faaf0e7f60c54 HTTP/1.1" 200 None 2026-03-25 16:51:29,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:29,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:51:29,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:29,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410c2944faaf0e7f60c54 HTTP/1.1" 200 None 2026-03-25 16:51:29,651 - lava_callback - INFO - Completed processing callback for node 69c410c2944faaf0e7f60c54 INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:51:41,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:41,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 16:51:44,122 - lava_callback - INFO - Received callback for node 69c16f942b2b51e9ad97a3da INFO: 172.21.0.1:34840 - "POST /node/69c16f942b2b51e9ad97a3da HTTP/1.0" 202 Accepted 2026-03-25 16:51:44,132 - lava_callback - INFO - Starting async job submit for node 69c16f942b2b51e9ad97a3da 2026-03-25 16:51:44,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:44,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16f942b2b51e9ad97a3da HTTP/1.1" 200 None 2026-03-25 16:51:44,164 - lava_callback - DEBUG - Processing node 69c16f942b2b51e9ad97a3da: baseline-arm64-baylibre 2026-03-25 16:51:44,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c16f942b2b51e9ad97a3da 2026-03-25 16:51:44,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:44,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16f942b2b51e9ad97a3da HTTP/1.1" 200 None 2026-03-25 16:51:44,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:44,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 16:51:44,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:51:44,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16f942b2b51e9ad97a3da HTTP/1.1" 200 None 2026-03-25 16:51:44,282 - lava_callback - ERROR - Error processing callback for node 69c16f942b2b51e9ad97a3da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52192 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:52:11,964 - lava_callback - INFO - Received callback for node 69c410f5944faaf0e7f60cdd INFO: 172.21.0.1:59492 - "POST /node/69c410f5944faaf0e7f60cdd HTTP/1.0" 202 Accepted 2026-03-25 16:52:11,977 - lava_callback - INFO - Starting async job submit for node 69c410f5944faaf0e7f60cdd 2026-03-25 16:52:12,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:52:12,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f5944faaf0e7f60cdd HTTP/1.1" 200 None 2026-03-25 16:52:12,052 - lava_callback - DEBUG - Processing node 69c410f5944faaf0e7f60cdd: ltp-syscalls 2026-03-25 16:52:13,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:52:13,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:52:13,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c410f5944faaf0e7f60cdd/log.txt.gz 2026-03-25 16:52:14,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:52:15,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:52:15,143 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c410f5944faaf0e7f60cdd/lava-logs.yaml INFO: 172.21.0.1:59494 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 16:52:15,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:52:15,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:52:15,631 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c410f5944faaf0e7f60cdd/lava_callback.json.gz 2026-03-25 16:52:15,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:52:15,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f5944faaf0e7f60cdd HTTP/1.1" 200 None 2026-03-25 16:52:15,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:52:15,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:52:15,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:52:15,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410f5944faaf0e7f60cdd HTTP/1.1" 200 None 2026-03-25 16:52:15,790 - lava_callback - INFO - Completed processing callback for node 69c410f5944faaf0e7f60cdd INFO: 172.21.0.1:59504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:52:41,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:52:41,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:53:21,184 - lava_callback - INFO - Received callback for node 69c412f4944faaf0e7f60fe0 INFO: 172.21.0.1:41770 - "POST /node/69c412f4944faaf0e7f60fe0 HTTP/1.0" 202 Accepted 2026-03-25 16:53:21,190 - lava_callback - INFO - Starting async job submit for node 69c412f4944faaf0e7f60fe0 2026-03-25 16:53:21,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:53:21,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c412f4944faaf0e7f60fe0 HTTP/1.1" 200 None 2026-03-25 16:53:21,208 - lava_callback - DEBUG - Processing node 69c412f4944faaf0e7f60fe0: baseline-arm 2026-03-25 16:53:21,213 - lava_callback - WARNING - Failed to upload log 2026-03-25 16:53:21,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:53:21,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:53:21,371 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c412f4944faaf0e7f60fe0/lava-logs.yaml 2026-03-25 16:53:21,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:53:21,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:53:21,494 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c412f4944faaf0e7f60fe0/lava_callback.json.gz 2026-03-25 16:53:21,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:53:21,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c412f4944faaf0e7f60fe0 HTTP/1.1" 200 None 2026-03-25 16:53:21,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:53:21,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:53:21,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:53:21,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c412f4944faaf0e7f60fe0 HTTP/1.1" 200 None 2026-03-25 16:53:21,559 - lava_callback - INFO - Completed processing callback for node 69c412f4944faaf0e7f60fe0 INFO: 172.21.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:53:41,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:53:41,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59878 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:54:24,081 - lava_callback - INFO - Received callback for node 69c1703d2b2b51e9ad97a418 INFO: 172.21.0.1:36660 - "POST /node/69c1703d2b2b51e9ad97a418 HTTP/1.0" 202 Accepted 2026-03-25 16:54:24,093 - lava_callback - INFO - Starting async job submit for node 69c1703d2b2b51e9ad97a418 2026-03-25 16:54:24,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:54:24,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1703d2b2b51e9ad97a418 HTTP/1.1" 200 None 2026-03-25 16:54:24,138 - lava_callback - DEBUG - Processing node 69c1703d2b2b51e9ad97a418: baseline-arm64-baylibre 2026-03-25 16:54:24,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1703d2b2b51e9ad97a418 2026-03-25 16:54:24,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:54:24,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1703d2b2b51e9ad97a418 HTTP/1.1" 200 None 2026-03-25 16:54:24,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:54:24,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 16:54:24,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:54:24,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1703d2b2b51e9ad97a418 HTTP/1.1" 200 None 2026-03-25 16:54:24,217 - lava_callback - ERROR - Error processing callback for node 69c1703d2b2b51e9ad97a418: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45842 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:55:13,420 - lava_callback - INFO - Received callback for node 69c41188944faaf0e7f60dd7 INFO: 172.21.0.1:48132 - "POST /node/69c41188944faaf0e7f60dd7 HTTP/1.0" 202 Accepted 2026-03-25 16:55:13,427 - lava_callback - INFO - Starting async job submit for node 69c41188944faaf0e7f60dd7 2026-03-25 16:55:13,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:55:13,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41188944faaf0e7f60dd7 HTTP/1.1" 200 None 2026-03-25 16:55:13,478 - lava_callback - DEBUG - Processing node 69c41188944faaf0e7f60dd7: baseline-arm64 2026-03-25 16:55:13,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:55:14,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:55:14,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41188944faaf0e7f60dd7/log.txt.gz 2026-03-25 16:55:14,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:55:14,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:55:14,463 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41188944faaf0e7f60dd7/lava-logs.yaml 2026-03-25 16:55:14,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:55:14,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:55:14,638 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41188944faaf0e7f60dd7/lava_callback.json.gz DEBUG: Setup failed for 69c41188944faaf0e7f60dd7. Transitting job node result: incomplete -> fail 2026-03-25 16:55:14,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:55:14,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41188944faaf0e7f60dd7 HTTP/1.1" 200 None 2026-03-25 16:55:14,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:55:14,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:55:14,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:55:14,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41188944faaf0e7f60dd7 HTTP/1.1" 200 None 2026-03-25 16:55:14,858 - lava_callback - INFO - Completed processing callback for node 69c41188944faaf0e7f60dd7 INFO: 172.21.0.1:48138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51438 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:55:41,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:55:41,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46732 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:56:04,179 - lava_callback - INFO - Received callback for node 69c170952b2b51e9ad97a45b INFO: 172.21.0.1:45512 - "POST /node/69c170952b2b51e9ad97a45b HTTP/1.0" 202 Accepted 2026-03-25 16:56:04,185 - lava_callback - INFO - Starting async job submit for node 69c170952b2b51e9ad97a45b 2026-03-25 16:56:04,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:56:04,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c170952b2b51e9ad97a45b HTTP/1.1" 200 None 2026-03-25 16:56:04,203 - lava_callback - DEBUG - Processing node 69c170952b2b51e9ad97a45b: baseline-arm64-baylibre 2026-03-25 16:56:04,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c170952b2b51e9ad97a45b 2026-03-25 16:56:04,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:56:04,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c170952b2b51e9ad97a45b HTTP/1.1" 200 None 2026-03-25 16:56:04,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:56:04,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 16:56:04,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:56:04,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c170952b2b51e9ad97a45b HTTP/1.1" 200 None 2026-03-25 16:56:04,292 - lava_callback - ERROR - Error processing callback for node 69c170952b2b51e9ad97a45b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:57:24,232 - lava_callback - INFO - Received callback for node 69c170ec2b2b51e9ad97a48d INFO: 172.21.0.1:58968 - "POST /node/69c170ec2b2b51e9ad97a48d HTTP/1.0" 202 Accepted 2026-03-25 16:57:24,240 - lava_callback - INFO - Starting async job submit for node 69c170ec2b2b51e9ad97a48d 2026-03-25 16:57:24,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:57:24,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c170ec2b2b51e9ad97a48d HTTP/1.1" 200 None 2026-03-25 16:57:24,257 - lava_callback - DEBUG - Processing node 69c170ec2b2b51e9ad97a48d: baseline-arm64-baylibre 2026-03-25 16:57:24,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c170ec2b2b51e9ad97a48d 2026-03-25 16:57:24,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:57:24,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c170ec2b2b51e9ad97a48d HTTP/1.1" 200 None 2026-03-25 16:57:24,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:57:24,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 16:57:24,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:57:24,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c170ec2b2b51e9ad97a48d HTTP/1.1" 200 None 2026-03-25 16:57:24,373 - lava_callback - ERROR - Error processing callback for node 69c170ec2b2b51e9ad97a48d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50260 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:59:27,864 - lava_callback - INFO - Received callback for node 69c410a5944faaf0e7f60bee INFO: 172.21.0.1:50264 - "POST /node/69c410a5944faaf0e7f60bee HTTP/1.0" 202 Accepted 2026-03-25 16:59:27,871 - lava_callback - INFO - Starting async job submit for node 69c410a5944faaf0e7f60bee 2026-03-25 16:59:27,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:27,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a5944faaf0e7f60bee HTTP/1.1" 200 None 2026-03-25 16:59:27,941 - lava_callback - DEBUG - Processing node 69c410a5944faaf0e7f60bee: baseline-arm 2026-03-25 16:59:28,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:59:29,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:59:29,150 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a5944faaf0e7f60bee/log.txt.gz 2026-03-25 16:59:29,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:59:29,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:59:29,937 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a5944faaf0e7f60bee/lava-logs.yaml 2026-03-25 16:59:29,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:59:30,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:59:30,149 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c410a5944faaf0e7f60bee/lava_callback.json.gz DEBUG: Setup failed for 69c410a5944faaf0e7f60bee. Transitting job node result: incomplete -> fail 2026-03-25 16:59:30,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:30,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a5944faaf0e7f60bee HTTP/1.1" 200 None 2026-03-25 16:59:30,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:30,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 16:59:30,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:30,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410a5944faaf0e7f60bee HTTP/1.1" 200 None 2026-03-25 16:59:30,595 - lava_callback - INFO - Completed processing callback for node 69c410a5944faaf0e7f60bee INFO: 172.21.0.1:45240 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:59:41,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:41,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 16:59:44,795 - lava_callback - INFO - Received callback for node 69c41476944faaf0e7f6105e INFO: 172.21.0.1:48424 - "POST /node/69c41476944faaf0e7f6105e HTTP/1.0" 202 Accepted 2026-03-25 16:59:44,804 - lava_callback - INFO - Starting async job submit for node 69c41476944faaf0e7f6105e 2026-03-25 16:59:44,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:44,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41476944faaf0e7f6105e HTTP/1.1" 200 None 2026-03-25 16:59:44,835 - lava_callback - DEBUG - Processing node 69c41476944faaf0e7f6105e: baseline-nfs-arm64 2026-03-25 16:59:44,837 - lava_callback - WARNING - Failed to upload log 2026-03-25 16:59:44,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:48430 - "GET / HTTP/1.0" 200 OK 2026-03-25 16:59:45,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:59:45,176 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41476944faaf0e7f6105e/lava-logs.yaml 2026-03-25 16:59:45,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 16:59:45,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 16:59:45,283 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41476944faaf0e7f6105e/lava_callback.json.gz 2026-03-25 16:59:45,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:45,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41476944faaf0e7f6105e HTTP/1.1" 200 None 2026-03-25 16:59:45,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:45,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 16:59:45,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 16:59:45,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41476944faaf0e7f6105e HTTP/1.1" 200 None 2026-03-25 16:59:45,385 - lava_callback - INFO - Completed processing callback for node 69c41476944faaf0e7f6105e INFO: 172.21.0.1:48438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37586 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:00:11,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:00:11,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33970 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:00:24,365 - lava_callback - INFO - Received callback for node 69c171932b2b51e9ad97a4ed INFO: 172.21.0.1:58892 - "POST /node/69c171932b2b51e9ad97a4ed HTTP/1.0" 202 Accepted 2026-03-25 17:00:24,371 - lava_callback - INFO - Starting async job submit for node 69c171932b2b51e9ad97a4ed 2026-03-25 17:00:24,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:00:24,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c171932b2b51e9ad97a4ed HTTP/1.1" 200 None 2026-03-25 17:00:24,387 - lava_callback - DEBUG - Processing node 69c171932b2b51e9ad97a4ed: baseline-arm64-baylibre 2026-03-25 17:00:24,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c171932b2b51e9ad97a4ed 2026-03-25 17:00:24,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:00:24,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c171932b2b51e9ad97a4ed HTTP/1.1" 200 None 2026-03-25 17:00:24,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:00:24,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:00:24,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:00:24,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c171932b2b51e9ad97a4ed HTTP/1.1" 200 None 2026-03-25 17:00:24,443 - lava_callback - ERROR - Error processing callback for node 69c171932b2b51e9ad97a4ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48932 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:01:44,490 - lava_callback - INFO - Received callback for node 69c171ee2b2b51e9ad97a50d INFO: 172.21.0.1:35230 - "POST /node/69c171ee2b2b51e9ad97a50d HTTP/1.0" 202 Accepted 2026-03-25 17:01:44,496 - lava_callback - INFO - Starting async job submit for node 69c171ee2b2b51e9ad97a50d 2026-03-25 17:01:44,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:01:44,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c171ee2b2b51e9ad97a50d HTTP/1.1" 200 None 2026-03-25 17:01:44,512 - lava_callback - DEBUG - Processing node 69c171ee2b2b51e9ad97a50d: baseline-arm64-baylibre 2026-03-25 17:01:44,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c171ee2b2b51e9ad97a50d 2026-03-25 17:01:44,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:01:44,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c171ee2b2b51e9ad97a50d HTTP/1.1" 200 None 2026-03-25 17:01:44,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:01:44,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:01:44,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:01:44,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c171ee2b2b51e9ad97a50d HTTP/1.1" 200 None 2026-03-25 17:01:44,584 - lava_callback - ERROR - Error processing callback for node 69c171ee2b2b51e9ad97a50d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:01:47,404 - lava_callback - INFO - Received callback for node 69c41142944faaf0e7f60d46 INFO: 172.21.0.1:35258 - "POST /node/69c41142944faaf0e7f60d46 HTTP/1.0" 202 Accepted 2026-03-25 17:01:47,411 - lava_callback - INFO - Starting async job submit for node 69c41142944faaf0e7f60d46 2026-03-25 17:01:47,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:01:47,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41142944faaf0e7f60d46 HTTP/1.1" 200 None 2026-03-25 17:01:47,485 - lava_callback - DEBUG - Processing node 69c41142944faaf0e7f60d46: baseline-x86 2026-03-25 17:01:48,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:01:48,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:01:48,434 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c41142944faaf0e7f60d46/log.txt.gz 2026-03-25 17:01:48,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:01:49,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:01:49,138 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c41142944faaf0e7f60d46/lava-logs.yaml 2026-03-25 17:01:49,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:01:49,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:01:49,344 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c41142944faaf0e7f60d46/lava_callback.json.gz DEBUG: Setup failed for 69c41142944faaf0e7f60d46. Transitting job node result: incomplete -> fail 2026-03-25 17:01:49,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:01:49,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41142944faaf0e7f60d46 HTTP/1.1" 200 None 2026-03-25 17:01:49,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:01:49,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40aef944faaf0e7f5e438 HTTP/1.1" 200 None 2026-03-25 17:01:49,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:01:49,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41142944faaf0e7f60d46 HTTP/1.1" 200 None 2026-03-25 17:01:49,600 - lava_callback - INFO - Completed processing callback for node 69c41142944faaf0e7f60d46 INFO: 172.21.0.1:37688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58488 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:02:11,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:11,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51486 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 17:02:16,351 - lava_callback - INFO - Received callback for node 69c41198944faaf0e7f60e02 INFO: 172.21.0.1:51502 - "POST /node/69c41198944faaf0e7f60e02 HTTP/1.0" 202 Accepted 2026-03-25 17:02:16,359 - lava_callback - INFO - Starting async job submit for node 69c41198944faaf0e7f60e02 2026-03-25 17:02:16,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:16,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41198944faaf0e7f60e02 HTTP/1.1" 200 None 2026-03-25 17:02:16,425 - lava_callback - DEBUG - Processing node 69c41198944faaf0e7f60e02: baseline-nfs-arm64 INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:02:17,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:02:17,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:02:17,351 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41198944faaf0e7f60e02/log.txt.gz 2026-03-25 17:02:17,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:02:18,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:02:18,058 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41198944faaf0e7f60e02/lava-logs.yaml 2026-03-25 17:02:18,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:02:18,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:02:18,259 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41198944faaf0e7f60e02/lava_callback.json.gz DEBUG: Setup failed for 69c41198944faaf0e7f60e02. Transitting job node result: incomplete -> fail 2026-03-25 17:02:18,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:18,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41198944faaf0e7f60e02 HTTP/1.1" 200 None 2026-03-25 17:02:18,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:18,391 - lava_callback - INFO - Received callback for node 69c41187944faaf0e7f60dd4 INFO: 172.21.0.1:51522 - "POST /node/69c41187944faaf0e7f60dd4 HTTP/1.0" 202 Accepted 2026-03-25 17:02:18,399 - lava_callback - INFO - Starting async job submit for node 69c41187944faaf0e7f60dd4 2026-03-25 17:02:18,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:18,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:02:18,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:18,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41187944faaf0e7f60dd4 HTTP/1.1" 200 None 2026-03-25 17:02:18,471 - lava_callback - DEBUG - Processing node 69c41187944faaf0e7f60dd4: baseline-arm64 2026-03-25 17:02:18,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41198944faaf0e7f60e02 HTTP/1.1" 200 None 2026-03-25 17:02:18,700 - lava_callback - INFO - Completed processing callback for node 69c41198944faaf0e7f60e02 2026-03-25 17:02:19,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:02:19,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:02:19,537 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41187944faaf0e7f60dd4/log.txt.gz 2026-03-25 17:02:19,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:02:20,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:02:20,211 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41187944faaf0e7f60dd4/lava-logs.yaml 2026-03-25 17:02:20,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:02:20,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:02:20,389 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41187944faaf0e7f60dd4/lava_callback.json.gz DEBUG: Setup failed for 69c41187944faaf0e7f60dd4. Transitting job node result: incomplete -> fail 2026-03-25 17:02:20,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:20,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41187944faaf0e7f60dd4 HTTP/1.1" 200 None 2026-03-25 17:02:20,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:20,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:02:20,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:20,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41187944faaf0e7f60dd4 HTTP/1.1" 200 None 2026-03-25 17:02:20,661 - lava_callback - INFO - Completed processing callback for node 69c41187944faaf0e7f60dd4 INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43922 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:02:41,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:02:42,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:03:04,500 - lava_callback - INFO - Received callback for node 69c41517944faaf0e7f61097 INFO: 172.21.0.1:35488 - "POST /node/69c41517944faaf0e7f61097 HTTP/1.0" 202 Accepted 2026-03-25 17:03:04,507 - lava_callback - INFO - Starting async job submit for node 69c41517944faaf0e7f61097 2026-03-25 17:03:04,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:04,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41517944faaf0e7f61097 HTTP/1.1" 200 None 2026-03-25 17:03:04,567 - lava_callback - DEBUG - Processing node 69c41517944faaf0e7f61097: baseline-arm64 2026-03-25 17:03:04,716 - lava_callback - WARNING - Failed to upload log 2026-03-25 17:03:04,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:03:04,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:03:04,966 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41517944faaf0e7f61097/lava-logs.yaml 2026-03-25 17:03:04,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:03:05,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:03:05,102 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41517944faaf0e7f61097/lava_callback.json.gz 2026-03-25 17:03:05,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:05,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41517944faaf0e7f61097 HTTP/1.1" 200 None 2026-03-25 17:03:05,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:05,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:03:05,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:05,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41517944faaf0e7f61097 HTTP/1.1" 200 None 2026-03-25 17:03:05,261 - lava_callback - INFO - Completed processing callback for node 69c41517944faaf0e7f61097 INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:03:12,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:12,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:03:24,572 - lava_callback - INFO - Received callback for node 69c172472b2b51e9ad97a522 INFO: 172.21.0.1:51856 - "POST /node/69c172472b2b51e9ad97a522 HTTP/1.0" 202 Accepted 2026-03-25 17:03:24,582 - lava_callback - INFO - Starting async job submit for node 69c172472b2b51e9ad97a522 2026-03-25 17:03:24,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:24,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c172472b2b51e9ad97a522 HTTP/1.1" 200 None 2026-03-25 17:03:24,605 - lava_callback - DEBUG - Processing node 69c172472b2b51e9ad97a522: baseline-arm64-baylibre 2026-03-25 17:03:24,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c172472b2b51e9ad97a522 2026-03-25 17:03:24,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:24,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c172472b2b51e9ad97a522 HTTP/1.1" 200 None 2026-03-25 17:03:24,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:24,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:03:24,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:03:24,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c172472b2b51e9ad97a522 HTTP/1.1" 200 None 2026-03-25 17:03:24,670 - lava_callback - ERROR - Error processing callback for node 69c172472b2b51e9ad97a522: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:04:36,027 - lava_callback - INFO - Received callback for node 69c4117c944faaf0e7f60da7 INFO: 172.21.0.1:48790 - "POST /node/69c4117c944faaf0e7f60da7 HTTP/1.0" 202 Accepted 2026-03-25 17:04:36,034 - lava_callback - INFO - Starting async job submit for node 69c4117c944faaf0e7f60da7 2026-03-25 17:04:36,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:36,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117c944faaf0e7f60da7 HTTP/1.1" 200 None 2026-03-25 17:04:36,086 - lava_callback - DEBUG - Processing node 69c4117c944faaf0e7f60da7: baseline-arm64 INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:04:36,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:04:36,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:04:36,745 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117c944faaf0e7f60da7/log.txt.gz 2026-03-25 17:04:37,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:04:37,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:04:37,457 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117c944faaf0e7f60da7/lava-logs.yaml 2026-03-25 17:04:37,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:04:37,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:04:37,640 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117c944faaf0e7f60da7/lava_callback.json.gz 2026-03-25 17:04:37,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:37,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117c944faaf0e7f60da7 HTTP/1.1" 200 None 2026-03-25 17:04:37,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:37,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:04:37,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:37,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4117c944faaf0e7f60da7 HTTP/1.1" 200 None 2026-03-25 17:04:37,764 - lava_callback - INFO - Completed processing callback for node 69c4117c944faaf0e7f60da7 2026-03-25 17:04:42,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:42,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44406 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:04:45,001 - lava_callback - INFO - Received callback for node 69c1729a2b2b51e9ad97a535 INFO: 172.21.0.1:44418 - "POST /node/69c1729a2b2b51e9ad97a535 HTTP/1.0" 202 Accepted 2026-03-25 17:04:45,007 - lava_callback - INFO - Starting async job submit for node 69c1729a2b2b51e9ad97a535 2026-03-25 17:04:45,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:45,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1729a2b2b51e9ad97a535 HTTP/1.1" 200 None 2026-03-25 17:04:45,024 - lava_callback - DEBUG - Processing node 69c1729a2b2b51e9ad97a535: baseline-arm64-baylibre 2026-03-25 17:04:45,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1729a2b2b51e9ad97a535 2026-03-25 17:04:45,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:45,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1729a2b2b51e9ad97a535 HTTP/1.1" 200 None 2026-03-25 17:04:45,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:45,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:04:45,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:04:45,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1729a2b2b51e9ad97a535 HTTP/1.1" 200 None 2026-03-25 17:04:45,093 - lava_callback - ERROR - Error processing callback for node 69c1729a2b2b51e9ad97a535: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36878 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:06:04,750 - lava_callback - INFO - Received callback for node 69c172f22b2b51e9ad97a54b INFO: 172.21.0.1:53024 - "POST /node/69c172f22b2b51e9ad97a54b HTTP/1.0" 202 Accepted 2026-03-25 17:06:04,759 - lava_callback - INFO - Starting async job submit for node 69c172f22b2b51e9ad97a54b 2026-03-25 17:06:04,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:06:04,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c172f22b2b51e9ad97a54b HTTP/1.1" 200 None 2026-03-25 17:06:04,774 - lava_callback - DEBUG - Processing node 69c172f22b2b51e9ad97a54b: baseline-arm64-baylibre 2026-03-25 17:06:04,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c172f22b2b51e9ad97a54b 2026-03-25 17:06:04,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:06:04,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c172f22b2b51e9ad97a54b HTTP/1.1" 200 None 2026-03-25 17:06:04,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:06:04,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:06:04,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:06:04,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c172f22b2b51e9ad97a54b HTTP/1.1" 200 None 2026-03-25 17:06:04,830 - lava_callback - ERROR - Error processing callback for node 69c172f22b2b51e9ad97a54b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:07:34,231 - lava_callback - INFO - Received callback for node 69c4161b944faaf0e7f610e4 INFO: 172.21.0.1:48704 - "POST /node/69c4161b944faaf0e7f610e4 HTTP/1.0" 202 Accepted 2026-03-25 17:07:34,237 - lava_callback - INFO - Starting async job submit for node 69c4161b944faaf0e7f610e4 2026-03-25 17:07:34,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:34,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4161b944faaf0e7f610e4 HTTP/1.1" 200 None 2026-03-25 17:07:34,281 - lava_callback - DEBUG - Processing node 69c4161b944faaf0e7f610e4: baseline-arm64 2026-03-25 17:07:34,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:07:34,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:07:34,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4161b944faaf0e7f610e4/log.txt.gz 2026-03-25 17:07:34,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:07:35,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:07:35,079 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4161b944faaf0e7f610e4/lava-logs.yaml 2026-03-25 17:07:35,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:07:35,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:07:35,287 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4161b944faaf0e7f610e4/lava_callback.json.gz 2026-03-25 17:07:35,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:35,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4161b944faaf0e7f610e4 HTTP/1.1" 200 None 2026-03-25 17:07:35,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:35,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:07:35,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:35,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4161b944faaf0e7f610e4 HTTP/1.1" 200 None 2026-03-25 17:07:35,368 - lava_callback - INFO - Completed processing callback for node 69c4161b944faaf0e7f610e4 INFO: 172.21.0.1:48712 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:07:42,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:42,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 17:07:44,796 - lava_callback - INFO - Received callback for node 69c1734b2b2b51e9ad97a562 INFO: 172.21.0.1:44420 - "POST /node/69c1734b2b2b51e9ad97a562 HTTP/1.0" 202 Accepted 2026-03-25 17:07:44,804 - lava_callback - INFO - Starting async job submit for node 69c1734b2b2b51e9ad97a562 2026-03-25 17:07:44,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:44,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1734b2b2b51e9ad97a562 HTTP/1.1" 200 None 2026-03-25 17:07:44,831 - lava_callback - DEBUG - Processing node 69c1734b2b2b51e9ad97a562: baseline-arm64-baylibre 2026-03-25 17:07:44,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1734b2b2b51e9ad97a562 2026-03-25 17:07:44,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:44,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1734b2b2b51e9ad97a562 HTTP/1.1" 200 None 2026-03-25 17:07:44,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:44,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:07:44,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:07:44,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1734b2b2b51e9ad97a562 HTTP/1.1" 200 None 2026-03-25 17:07:44,893 - lava_callback - ERROR - Error processing callback for node 69c1734b2b2b51e9ad97a562: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:09:39,637 - lava_callback - INFO - Received callback for node 69c173cf2b2b51e9ad97a584 INFO: 172.21.0.1:40272 - "POST /node/69c173cf2b2b51e9ad97a584 HTTP/1.0" 202 Accepted 2026-03-25 17:09:39,642 - lava_callback - INFO - Starting async job submit for node 69c173cf2b2b51e9ad97a584 2026-03-25 17:09:39,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:09:39,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c173cf2b2b51e9ad97a584 HTTP/1.1" 200 None 2026-03-25 17:09:39,659 - lava_callback - DEBUG - Processing node 69c173cf2b2b51e9ad97a584: baseline-arm64-clabbe 2026-03-25 17:09:39,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c173cf2b2b51e9ad97a584 2026-03-25 17:09:39,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:09:39,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c173cf2b2b51e9ad97a584 HTTP/1.1" 200 None 2026-03-25 17:09:39,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:09:39,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:09:39,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:09:39,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c173cf2b2b51e9ad97a584 HTTP/1.1" 200 None 2026-03-25 17:09:39,727 - lava_callback - ERROR - Error processing callback for node 69c173cf2b2b51e9ad97a584: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:09:43,989 - lava_callback - INFO - Received callback for node 69c416c4944faaf0e7f61112 INFO: 172.21.0.1:51000 - "POST /node/69c416c4944faaf0e7f61112 HTTP/1.0" 202 Accepted 2026-03-25 17:09:43,995 - lava_callback - INFO - Starting async job submit for node 69c416c4944faaf0e7f61112 2026-03-25 17:09:43,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:09:44,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c416c4944faaf0e7f61112 HTTP/1.1" 200 None 2026-03-25 17:09:44,015 - lava_callback - DEBUG - Processing node 69c416c4944faaf0e7f61112: baseline-arm 2026-03-25 17:09:44,020 - lava_callback - WARNING - Failed to upload log 2026-03-25 17:09:44,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:09:44,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:09:44,306 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c416c4944faaf0e7f61112/lava-logs.yaml 2026-03-25 17:09:44,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:09:44,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:09:44,464 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c416c4944faaf0e7f61112/lava_callback.json.gz 2026-03-25 17:09:44,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:09:44,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c416c4944faaf0e7f61112 HTTP/1.1" 200 None 2026-03-25 17:09:44,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:09:44,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 17:09:44,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:09:44,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c416c4944faaf0e7f61112 HTTP/1.1" 200 None 2026-03-25 17:09:44,532 - lava_callback - INFO - Completed processing callback for node 69c416c4944faaf0e7f61112 INFO: 172.21.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55014 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:10:12,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:10:12,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50976 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:10:31,730 - lava_callback - INFO - Received callback for node 69c415c3944faaf0e7f610d2 INFO: 172.21.0.1:34916 - "POST /node/69c415c3944faaf0e7f610d2 HTTP/1.0" 202 Accepted 2026-03-25 17:10:31,737 - lava_callback - INFO - Starting async job submit for node 69c415c3944faaf0e7f610d2 2026-03-25 17:10:31,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:10:31,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c415c3944faaf0e7f610d2 HTTP/1.1" 200 None 2026-03-25 17:10:31,785 - lava_callback - DEBUG - Processing node 69c415c3944faaf0e7f610d2: baseline-arm64 2026-03-25 17:10:31,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:10:32,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:10:32,096 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c415c3944faaf0e7f610d2/log.txt.gz 2026-03-25 17:10:32,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:10:32,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:10:32,391 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c415c3944faaf0e7f610d2/lava-logs.yaml 2026-03-25 17:10:32,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:10:32,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:10:32,534 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c415c3944faaf0e7f610d2/lava_callback.json.gz 2026-03-25 17:10:32,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:10:32,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c415c3944faaf0e7f610d2 HTTP/1.1" 200 None 2026-03-25 17:10:32,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:10:32,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:10:32,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:10:32,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c415c3944faaf0e7f610d2 HTTP/1.1" 200 None 2026-03-25 17:10:32,664 - lava_callback - INFO - Completed processing callback for node 69c415c3944faaf0e7f610d2 INFO: 172.21.0.1:34926 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:10:42,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:10:42,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39162 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:11:19,282 - lava_callback - INFO - Received callback for node 69c174272b2b51e9ad97a5a1 INFO: 172.21.0.1:39178 - "POST /node/69c174272b2b51e9ad97a5a1 HTTP/1.0" 202 Accepted 2026-03-25 17:11:19,291 - lava_callback - INFO - Starting async job submit for node 69c174272b2b51e9ad97a5a1 2026-03-25 17:11:19,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:11:19,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c174272b2b51e9ad97a5a1 HTTP/1.1" 200 None 2026-03-25 17:11:19,314 - lava_callback - DEBUG - Processing node 69c174272b2b51e9ad97a5a1: baseline-arm64-clabbe 2026-03-25 17:11:19,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c174272b2b51e9ad97a5a1 2026-03-25 17:11:19,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:11:19,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c174272b2b51e9ad97a5a1 HTTP/1.1" 200 None 2026-03-25 17:11:19,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:11:19,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:11:19,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:11:19,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c174272b2b51e9ad97a5a1 HTTP/1.1" 200 None 2026-03-25 17:11:19,377 - lava_callback - ERROR - Error processing callback for node 69c174272b2b51e9ad97a5a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43800 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:12:39,364 - lava_callback - INFO - Received callback for node 69c174822b2b51e9ad97a5b6 INFO: 172.21.0.1:43814 - "POST /node/69c174822b2b51e9ad97a5b6 HTTP/1.0" 202 Accepted 2026-03-25 17:12:39,373 - lava_callback - INFO - Starting async job submit for node 69c174822b2b51e9ad97a5b6 2026-03-25 17:12:39,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:12:39,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c174822b2b51e9ad97a5b6 HTTP/1.1" 200 None 2026-03-25 17:12:39,400 - lava_callback - DEBUG - Processing node 69c174822b2b51e9ad97a5b6: baseline-arm64-clabbe 2026-03-25 17:12:39,400 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c174822b2b51e9ad97a5b6 2026-03-25 17:12:39,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:12:39,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c174822b2b51e9ad97a5b6 HTTP/1.1" 200 None 2026-03-25 17:12:39,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:12:39,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:12:39,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:12:39,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c174822b2b51e9ad97a5b6 HTTP/1.1" 200 None 2026-03-25 17:12:39,531 - lava_callback - ERROR - Error processing callback for node 69c174822b2b51e9ad97a5b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:14:19,468 - lava_callback - INFO - Received callback for node 69c174e52b2b51e9ad97a5e5 INFO: 172.21.0.1:56812 - "POST /node/69c174e52b2b51e9ad97a5e5 HTTP/1.0" 202 Accepted 2026-03-25 17:14:19,474 - lava_callback - INFO - Starting async job submit for node 69c174e52b2b51e9ad97a5e5 2026-03-25 17:14:19,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:14:19,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c174e52b2b51e9ad97a5e5 HTTP/1.1" 200 None 2026-03-25 17:14:19,490 - lava_callback - DEBUG - Processing node 69c174e52b2b51e9ad97a5e5: baseline-arm64-clabbe 2026-03-25 17:14:19,490 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c174e52b2b51e9ad97a5e5 2026-03-25 17:14:19,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:14:19,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c174e52b2b51e9ad97a5e5 HTTP/1.1" 200 None 2026-03-25 17:14:19,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:14:19,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:14:19,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:14:19,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c174e52b2b51e9ad97a5e5 HTTP/1.1" 200 None 2026-03-25 17:14:19,545 - lava_callback - ERROR - Error processing callback for node 69c174e52b2b51e9ad97a5e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57130 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:15:25,585 - lava_callback - INFO - Received callback for node 69c4181e944faaf0e7f61172 INFO: 172.21.0.1:50720 - "POST /node/69c4181e944faaf0e7f61172 HTTP/1.0" 202 Accepted 2026-03-25 17:15:25,591 - lava_callback - INFO - Starting async job submit for node 69c4181e944faaf0e7f61172 2026-03-25 17:15:25,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:25,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4181e944faaf0e7f61172 HTTP/1.1" 200 None 2026-03-25 17:15:25,608 - lava_callback - DEBUG - Processing node 69c4181e944faaf0e7f61172: baseline-nfs-arm64 2026-03-25 17:15:25,609 - lava_callback - WARNING - Failed to upload log 2026-03-25 17:15:25,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:15:25,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:15:25,751 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4181e944faaf0e7f61172/lava-logs.yaml 2026-03-25 17:15:25,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:15:25,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:15:25,913 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4181e944faaf0e7f61172/lava_callback.json.gz 2026-03-25 17:15:25,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:25,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4181e944faaf0e7f61172 HTTP/1.1" 200 None 2026-03-25 17:15:25,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:25,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:15:25,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:25,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4181e944faaf0e7f61172 HTTP/1.1" 200 None 2026-03-25 17:15:25,978 - lava_callback - INFO - Completed processing callback for node 69c4181e944faaf0e7f61172 INFO: 172.21.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41778 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:15:42,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:42,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:15:59,549 - lava_callback - INFO - Received callback for node 69c1753f2b2b51e9ad97a61c INFO: 172.21.0.1:47824 - "POST /node/69c1753f2b2b51e9ad97a61c HTTP/1.0" 202 Accepted 2026-03-25 17:15:59,555 - lava_callback - INFO - Starting async job submit for node 69c1753f2b2b51e9ad97a61c 2026-03-25 17:15:59,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:59,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1753f2b2b51e9ad97a61c HTTP/1.1" 200 None 2026-03-25 17:15:59,573 - lava_callback - DEBUG - Processing node 69c1753f2b2b51e9ad97a61c: baseline-arm64-clabbe 2026-03-25 17:15:59,573 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1753f2b2b51e9ad97a61c 2026-03-25 17:15:59,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:59,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1753f2b2b51e9ad97a61c HTTP/1.1" 200 None 2026-03-25 17:15:59,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:59,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:15:59,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:15:59,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1753f2b2b51e9ad97a61c HTTP/1.1" 200 None 2026-03-25 17:15:59,636 - lava_callback - ERROR - Error processing callback for node 69c1753f2b2b51e9ad97a61c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:16:48,811 - lava_callback - INFO - Received callback for node 69c41746944faaf0e7f61140 INFO: 172.21.0.1:34518 - "POST /node/69c41746944faaf0e7f61140 HTTP/1.0" 202 Accepted 2026-03-25 17:16:48,818 - lava_callback - INFO - Starting async job submit for node 69c41746944faaf0e7f61140 2026-03-25 17:16:48,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:16:48,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41746944faaf0e7f61140 HTTP/1.1" 200 None 2026-03-25 17:16:48,868 - lava_callback - DEBUG - Processing node 69c41746944faaf0e7f61140: baseline-arm64 2026-03-25 17:16:49,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:16:49,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:16:49,436 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41746944faaf0e7f61140/log.txt.gz 2026-03-25 17:16:49,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:16:49,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:16:49,852 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41746944faaf0e7f61140/lava-logs.yaml 2026-03-25 17:16:49,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:16:50,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:16:50,011 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41746944faaf0e7f61140/lava_callback.json.gz DEBUG: Setup failed for 69c41746944faaf0e7f61140. Transitting job node result: incomplete -> fail 2026-03-25 17:16:50,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:16:50,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41746944faaf0e7f61140 HTTP/1.1" 200 None 2026-03-25 17:16:50,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:16:50,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:16:50,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:16:50,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41746944faaf0e7f61140 HTTP/1.1" 200 None 2026-03-25 17:16:50,225 - lava_callback - INFO - Completed processing callback for node 69c41746944faaf0e7f61140 INFO: 172.21.0.1:55284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:17:12,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:17:12,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58074 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:17:19,585 - lava_callback - INFO - Received callback for node 69c175992b2b51e9ad97a653 INFO: 172.21.0.1:58086 - "POST /node/69c175992b2b51e9ad97a653 HTTP/1.0" 202 Accepted 2026-03-25 17:17:19,592 - lava_callback - INFO - Starting async job submit for node 69c175992b2b51e9ad97a653 2026-03-25 17:17:19,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:17:19,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c175992b2b51e9ad97a653 HTTP/1.1" 200 None 2026-03-25 17:17:19,607 - lava_callback - DEBUG - Processing node 69c175992b2b51e9ad97a653: baseline-arm64-clabbe 2026-03-25 17:17:19,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c175992b2b51e9ad97a653 2026-03-25 17:17:19,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:17:19,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c175992b2b51e9ad97a653 HTTP/1.1" 200 None 2026-03-25 17:17:19,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:17:19,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 17:17:19,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:17:19,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c175992b2b51e9ad97a653 HTTP/1.1" 200 None 2026-03-25 17:17:19,662 - lava_callback - ERROR - Error processing callback for node 69c175992b2b51e9ad97a653: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:18:25,379 - lava_callback - INFO - Received callback for node 69c175dc2b2b51e9ad97a688 INFO: 172.21.0.1:58484 - "POST /node/69c175dc2b2b51e9ad97a688 HTTP/1.0" 202 Accepted 2026-03-25 17:18:25,385 - lava_callback - INFO - Starting async job submit for node 69c175dc2b2b51e9ad97a688 2026-03-25 17:18:25,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:18:25,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c175dc2b2b51e9ad97a688 HTTP/1.1" 200 None 2026-03-25 17:18:25,402 - lava_callback - DEBUG - Processing node 69c175dc2b2b51e9ad97a688: baseline-arm-baylibre 2026-03-25 17:18:25,402 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c175dc2b2b51e9ad97a688 2026-03-25 17:18:25,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:18:25,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c175dc2b2b51e9ad97a688 HTTP/1.1" 200 None 2026-03-25 17:18:25,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:18:25,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:18:25,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:18:25,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c175dc2b2b51e9ad97a688 HTTP/1.1" 200 None 2026-03-25 17:18:25,455 - lava_callback - ERROR - Error processing callback for node 69c175dc2b2b51e9ad97a688: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:19:05,360 - lava_callback - INFO - Received callback for node 69c176042b2b51e9ad97a695 INFO: 172.21.0.1:59970 - "POST /node/69c176042b2b51e9ad97a695 HTTP/1.0" 202 Accepted 2026-03-25 17:19:05,366 - lava_callback - INFO - Starting async job submit for node 69c176042b2b51e9ad97a695 2026-03-25 17:19:05,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:19:05,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c176042b2b51e9ad97a695 HTTP/1.1" 200 None 2026-03-25 17:19:05,382 - lava_callback - DEBUG - Processing node 69c176042b2b51e9ad97a695: baseline-arm-baylibre 2026-03-25 17:19:05,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c176042b2b51e9ad97a695 2026-03-25 17:19:05,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:19:05,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c176042b2b51e9ad97a695 HTTP/1.1" 200 None 2026-03-25 17:19:05,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:19:05,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:19:05,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:19:05,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c176042b2b51e9ad97a695 HTTP/1.1" 200 None 2026-03-25 17:19:05,454 - lava_callback - ERROR - Error processing callback for node 69c176042b2b51e9ad97a695: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:19:45,479 - lava_callback - INFO - Received callback for node 69c1762c2b2b51e9ad97a6a0 INFO: 172.21.0.1:36952 - "POST /node/69c1762c2b2b51e9ad97a6a0 HTTP/1.0" 202 Accepted 2026-03-25 17:19:45,485 - lava_callback - INFO - Starting async job submit for node 69c1762c2b2b51e9ad97a6a0 2026-03-25 17:19:45,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:19:45,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1762c2b2b51e9ad97a6a0 HTTP/1.1" 200 None 2026-03-25 17:19:45,501 - lava_callback - DEBUG - Processing node 69c1762c2b2b51e9ad97a6a0: baseline-arm-baylibre 2026-03-25 17:19:45,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1762c2b2b51e9ad97a6a0 2026-03-25 17:19:45,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:19:45,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1762c2b2b51e9ad97a6a0 HTTP/1.1" 200 None 2026-03-25 17:19:45,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:19:45,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:19:45,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:19:45,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1762c2b2b51e9ad97a6a0 HTTP/1.1" 200 None 2026-03-25 17:19:45,571 - lava_callback - ERROR - Error processing callback for node 69c1762c2b2b51e9ad97a6a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:20:25,433 - lava_callback - INFO - Received callback for node 69c176542b2b51e9ad97a6a9 INFO: 172.21.0.1:49862 - "POST /node/69c176542b2b51e9ad97a6a9 HTTP/1.0" 202 Accepted 2026-03-25 17:20:25,439 - lava_callback - INFO - Starting async job submit for node 69c176542b2b51e9ad97a6a9 2026-03-25 17:20:25,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:20:25,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c176542b2b51e9ad97a6a9 HTTP/1.1" 200 None 2026-03-25 17:20:25,456 - lava_callback - DEBUG - Processing node 69c176542b2b51e9ad97a6a9: baseline-arm-baylibre 2026-03-25 17:20:25,457 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c176542b2b51e9ad97a6a9 2026-03-25 17:20:25,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:20:25,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c176542b2b51e9ad97a6a9 HTTP/1.1" 200 None 2026-03-25 17:20:25,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:20:25,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:20:25,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:20:25,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c176542b2b51e9ad97a6a9 HTTP/1.1" 200 None 2026-03-25 17:20:25,523 - lava_callback - ERROR - Error processing callback for node 69c176542b2b51e9ad97a6a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50680 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:21:05,570 - lava_callback - INFO - Received callback for node 69c1767c2b2b51e9ad97a6b2 INFO: 172.21.0.1:41324 - "POST /node/69c1767c2b2b51e9ad97a6b2 HTTP/1.0" 202 Accepted 2026-03-25 17:21:05,575 - lava_callback - INFO - Starting async job submit for node 69c1767c2b2b51e9ad97a6b2 2026-03-25 17:21:05,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:21:05,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1767c2b2b51e9ad97a6b2 HTTP/1.1" 200 None 2026-03-25 17:21:05,595 - lava_callback - DEBUG - Processing node 69c1767c2b2b51e9ad97a6b2: baseline-arm-baylibre 2026-03-25 17:21:05,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1767c2b2b51e9ad97a6b2 2026-03-25 17:21:05,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:21:05,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1767c2b2b51e9ad97a6b2 HTTP/1.1" 200 None 2026-03-25 17:21:05,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:21:05,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:21:05,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:21:05,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1767c2b2b51e9ad97a6b2 HTTP/1.1" 200 None 2026-03-25 17:21:05,652 - lava_callback - ERROR - Error processing callback for node 69c1767c2b2b51e9ad97a6b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58014 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:21:45,526 - lava_callback - INFO - Received callback for node 69c176a42b2b51e9ad97a6bb INFO: 172.21.0.1:58016 - "POST /node/69c176a42b2b51e9ad97a6bb HTTP/1.0" 202 Accepted 2026-03-25 17:21:45,531 - lava_callback - INFO - Starting async job submit for node 69c176a42b2b51e9ad97a6bb 2026-03-25 17:21:45,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:21:45,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c176a42b2b51e9ad97a6bb HTTP/1.1" 200 None 2026-03-25 17:21:45,548 - lava_callback - DEBUG - Processing node 69c176a42b2b51e9ad97a6bb: baseline-arm-baylibre 2026-03-25 17:21:45,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c176a42b2b51e9ad97a6bb 2026-03-25 17:21:45,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:21:45,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c176a42b2b51e9ad97a6bb HTTP/1.1" 200 None 2026-03-25 17:21:45,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:21:45,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:21:45,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:21:45,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c176a42b2b51e9ad97a6bb HTTP/1.1" 200 None 2026-03-25 17:21:45,613 - lava_callback - ERROR - Error processing callback for node 69c176a42b2b51e9ad97a6bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37668 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:23:19,837 - lava_callback - INFO - Received callback for node 69c176f42b2b51e9ad97a6ce INFO: 172.21.0.1:38278 - "POST /node/69c176f42b2b51e9ad97a6ce HTTP/1.0" 202 Accepted 2026-03-25 17:23:19,843 - lava_callback - INFO - Starting async job submit for node 69c176f42b2b51e9ad97a6ce 2026-03-25 17:23:19,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:19,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c176f42b2b51e9ad97a6ce HTTP/1.1" 200 None 2026-03-25 17:23:19,859 - lava_callback - DEBUG - Processing node 69c176f42b2b51e9ad97a6ce: baseline-arm-clabbe 2026-03-25 17:23:19,860 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c176f42b2b51e9ad97a6ce 2026-03-25 17:23:19,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:19,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c176f42b2b51e9ad97a6ce HTTP/1.1" 200 None 2026-03-25 17:23:19,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:19,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:23:19,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:19,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c176f42b2b51e9ad97a6ce HTTP/1.1" 200 None 2026-03-25 17:23:19,946 - lava_callback - ERROR - Error processing callback for node 69c176f42b2b51e9ad97a6ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:23:48,151 - lava_callback - INFO - Received callback for node 69c4118d944faaf0e7f60de7 INFO: 172.21.0.1:58854 - "POST /node/69c4118d944faaf0e7f60de7 HTTP/1.0" 202 Accepted 2026-03-25 17:23:48,160 - lava_callback - INFO - Starting async job submit for node 69c4118d944faaf0e7f60de7 2026-03-25 17:23:48,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:48,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4118d944faaf0e7f60de7 HTTP/1.1" 200 None 2026-03-25 17:23:48,219 - lava_callback - DEBUG - Processing node 69c4118d944faaf0e7f60de7: baseline-nfs-arm64 2026-03-25 17:23:49,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:23:49,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:23:49,496 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118d944faaf0e7f60de7/log.txt.gz 2026-03-25 17:23:50,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:23:50,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:23:50,406 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118d944faaf0e7f60de7/lava-logs.yaml 2026-03-25 17:23:50,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:23:50,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:23:50,618 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118d944faaf0e7f60de7/lava_callback.json.gz DEBUG: Setup failed for 69c4118d944faaf0e7f60de7. Transitting job node result: incomplete -> fail 2026-03-25 17:23:50,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:50,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4118d944faaf0e7f60de7 HTTP/1.1" 200 None 2026-03-25 17:23:50,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:50,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:23:50,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:50,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4118d944faaf0e7f60de7 HTTP/1.1" 200 None 2026-03-25 17:23:50,881 - lava_callback - INFO - Completed processing callback for node 69c4118d944faaf0e7f60de7 INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:23:59,780 - lava_callback - INFO - Received callback for node 69c1771d2b2b51e9ad97a6d8 INFO: 172.21.0.1:41072 - "POST /node/69c1771d2b2b51e9ad97a6d8 HTTP/1.0" 202 Accepted 2026-03-25 17:23:59,786 - lava_callback - INFO - Starting async job submit for node 69c1771d2b2b51e9ad97a6d8 2026-03-25 17:23:59,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:59,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1771d2b2b51e9ad97a6d8 HTTP/1.1" 200 None 2026-03-25 17:23:59,830 - lava_callback - DEBUG - Processing node 69c1771d2b2b51e9ad97a6d8: baseline-arm-clabbe 2026-03-25 17:23:59,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1771d2b2b51e9ad97a6d8 2026-03-25 17:23:59,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:59,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1771d2b2b51e9ad97a6d8 HTTP/1.1" 200 None 2026-03-25 17:23:59,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:59,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:23:59,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:23:59,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1771d2b2b51e9ad97a6d8 HTTP/1.1" 200 None 2026-03-25 17:23:59,886 - lava_callback - ERROR - Error processing callback for node 69c1771d2b2b51e9ad97a6d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:24:12,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:24:12,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53806 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:24:39,855 - lava_callback - INFO - Received callback for node 69c177442b2b51e9ad97a6e2 INFO: 172.21.0.1:54258 - "POST /node/69c177442b2b51e9ad97a6e2 HTTP/1.0" 202 Accepted 2026-03-25 17:24:39,860 - lava_callback - INFO - Starting async job submit for node 69c177442b2b51e9ad97a6e2 2026-03-25 17:24:39,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:24:39,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c177442b2b51e9ad97a6e2 HTTP/1.1" 200 None 2026-03-25 17:24:39,877 - lava_callback - DEBUG - Processing node 69c177442b2b51e9ad97a6e2: baseline-arm-clabbe 2026-03-25 17:24:39,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c177442b2b51e9ad97a6e2 2026-03-25 17:24:39,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:24:39,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c177442b2b51e9ad97a6e2 HTTP/1.1" 200 None 2026-03-25 17:24:39,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:24:39,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:24:39,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:24:39,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c177442b2b51e9ad97a6e2 HTTP/1.1" 200 None 2026-03-25 17:24:39,941 - lava_callback - ERROR - Error processing callback for node 69c177442b2b51e9ad97a6e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55530 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:25:19,821 - lava_callback - INFO - Received callback for node 69c177732b2b51e9ad97a6ec INFO: 172.21.0.1:45320 - "POST /node/69c177732b2b51e9ad97a6ec HTTP/1.0" 202 Accepted 2026-03-25 17:25:19,826 - lava_callback - INFO - Starting async job submit for node 69c177732b2b51e9ad97a6ec 2026-03-25 17:25:19,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:19,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c177732b2b51e9ad97a6ec HTTP/1.1" 200 None 2026-03-25 17:25:19,843 - lava_callback - DEBUG - Processing node 69c177732b2b51e9ad97a6ec: baseline-arm-clabbe 2026-03-25 17:25:19,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c177732b2b51e9ad97a6ec 2026-03-25 17:25:19,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:19,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c177732b2b51e9ad97a6ec HTTP/1.1" 200 None 2026-03-25 17:25:19,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:19,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:25:19,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:19,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c177732b2b51e9ad97a6ec HTTP/1.1" 200 None 2026-03-25 17:25:19,915 - lava_callback - ERROR - Error processing callback for node 69c177732b2b51e9ad97a6ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45328 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:25:32,037 - lava_callback - INFO - Received callback for node 69c41a47944faaf0e7f611df INFO: 172.21.0.1:41968 - "POST /node/69c41a47944faaf0e7f611df HTTP/1.0" 202 Accepted 2026-03-25 17:25:32,044 - lava_callback - INFO - Starting async job submit for node 69c41a47944faaf0e7f611df 2026-03-25 17:25:32,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:32,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41a47944faaf0e7f611df HTTP/1.1" 200 None 2026-03-25 17:25:32,089 - lava_callback - DEBUG - Processing node 69c41a47944faaf0e7f611df: baseline-arm64 2026-03-25 17:25:32,220 - lava_callback - WARNING - Failed to upload log 2026-03-25 17:25:32,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:25:32,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:25:32,503 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41a47944faaf0e7f611df/lava-logs.yaml 2026-03-25 17:25:32,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:25:32,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:25:32,644 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41a47944faaf0e7f611df/lava_callback.json.gz 2026-03-25 17:25:32,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:32,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41a47944faaf0e7f611df HTTP/1.1" 200 None 2026-03-25 17:25:32,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:32,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:25:32,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:32,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41a47944faaf0e7f611df HTTP/1.1" 200 None 2026-03-25 17:25:32,785 - lava_callback - INFO - Completed processing callback for node 69c41a47944faaf0e7f611df INFO: 172.21.0.1:41976 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:25:42,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:42,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 17:25:42,312 - lava_callback - INFO - Received callback for node 69c4166f944faaf0e7f610f8 INFO: 172.21.0.1:43036 - "POST /node/69c4166f944faaf0e7f610f8 HTTP/1.0" 202 Accepted 2026-03-25 17:25:42,318 - lava_callback - INFO - Starting async job submit for node 69c4166f944faaf0e7f610f8 2026-03-25 17:25:42,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:42,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4166f944faaf0e7f610f8 HTTP/1.1" 200 None 2026-03-25 17:25:42,390 - lava_callback - DEBUG - Processing node 69c4166f944faaf0e7f610f8: ltp-smoke 2026-03-25 17:25:42,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:25:43,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:25:43,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c4166f944faaf0e7f610f8/log.txt.gz 2026-03-25 17:25:43,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:25:43,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:25:43,502 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c4166f944faaf0e7f610f8/lava-logs.yaml 2026-03-25 17:25:43,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:25:43,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:25:43,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c4166f944faaf0e7f610f8/lava_callback.json.gz 2026-03-25 17:25:43,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:43,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4166f944faaf0e7f610f8 HTTP/1.1" 200 None 2026-03-25 17:25:43,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:43,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ace944faaf0e7f5e40e HTTP/1.1" 200 None 2026-03-25 17:25:43,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:43,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4166f944faaf0e7f610f8 HTTP/1.1" 200 None 2026-03-25 17:25:43,998 - lava_callback - INFO - Completed processing callback for node 69c4166f944faaf0e7f610f8 INFO: 172.21.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57950 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:25:59,947 - lava_callback - INFO - Received callback for node 69c1779d2b2b51e9ad97a6fb INFO: 172.21.0.1:34924 - "POST /node/69c1779d2b2b51e9ad97a6fb HTTP/1.0" 202 Accepted 2026-03-25 17:25:59,953 - lava_callback - INFO - Starting async job submit for node 69c1779d2b2b51e9ad97a6fb 2026-03-25 17:25:59,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:25:59,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1779d2b2b51e9ad97a6fb HTTP/1.1" 200 None 2026-03-25 17:25:59,978 - lava_callback - DEBUG - Processing node 69c1779d2b2b51e9ad97a6fb: baseline-arm-clabbe 2026-03-25 17:25:59,978 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1779d2b2b51e9ad97a6fb 2026-03-25 17:25:59,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:26:00,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1779d2b2b51e9ad97a6fb HTTP/1.1" 200 None 2026-03-25 17:26:00,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:26:00,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 17:26:00,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:26:00,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1779d2b2b51e9ad97a6fb HTTP/1.1" 200 None 2026-03-25 17:26:00,053 - lava_callback - ERROR - Error processing callback for node 69c1779d2b2b51e9ad97a6fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34930 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:26:12,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:26:12,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:27:39,972 - lava_callback - INFO - Received callback for node 69c177f92b2b51e9ad97a712 INFO: 172.21.0.1:56852 - "POST /node/69c177f92b2b51e9ad97a712 HTTP/1.0" 202 Accepted 2026-03-25 17:27:39,977 - lava_callback - INFO - Starting async job submit for node 69c177f92b2b51e9ad97a712 2026-03-25 17:27:39,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:27:39,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c177f92b2b51e9ad97a712 HTTP/1.1" 200 None 2026-03-25 17:27:39,993 - lava_callback - DEBUG - Processing node 69c177f92b2b51e9ad97a712: baseline-arm64-clabbe 2026-03-25 17:27:39,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c177f92b2b51e9ad97a712 2026-03-25 17:27:39,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:27:40,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c177f92b2b51e9ad97a712 HTTP/1.1" 200 None 2026-03-25 17:27:40,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:27:40,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 17:27:40,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:27:40,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c177f92b2b51e9ad97a712 HTTP/1.1" 200 None 2026-03-25 17:27:40,070 - lava_callback - ERROR - Error processing callback for node 69c177f92b2b51e9ad97a712: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59932 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:28:16,617 - lava_callback - INFO - Received callback for node 69c417eb944faaf0e7f61166 INFO: 172.21.0.1:59938 - "POST /node/69c417eb944faaf0e7f61166 HTTP/1.0" 202 Accepted 2026-03-25 17:28:16,627 - lava_callback - INFO - Starting async job submit for node 69c417eb944faaf0e7f61166 2026-03-25 17:28:16,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:28:16,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c417eb944faaf0e7f61166 HTTP/1.1" 200 None 2026-03-25 17:28:16,727 - lava_callback - DEBUG - Processing node 69c417eb944faaf0e7f61166: baseline-arm 2026-03-25 17:28:17,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:28:17,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:28:17,474 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c417eb944faaf0e7f61166/log.txt.gz 2026-03-25 17:28:17,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:28:18,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:28:18,026 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c417eb944faaf0e7f61166/lava-logs.yaml 2026-03-25 17:28:18,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:28:18,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:28:18,251 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c417eb944faaf0e7f61166/lava_callback.json.gz DEBUG: Setup failed for 69c417eb944faaf0e7f61166. Transitting job node result: incomplete -> fail 2026-03-25 17:28:18,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:28:18,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c417eb944faaf0e7f61166 HTTP/1.1" 200 None 2026-03-25 17:28:18,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:28:18,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 17:28:18,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:28:18,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c417eb944faaf0e7f61166 HTTP/1.1" 200 None 2026-03-25 17:28:18,551 - lava_callback - INFO - Completed processing callback for node 69c417eb944faaf0e7f61166 INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35864 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:28:42,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:28:42,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50290 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:30:20,094 - lava_callback - INFO - Received callback for node 69c178a02b2b51e9ad97a72d INFO: 172.21.0.1:37394 - "POST /node/69c178a02b2b51e9ad97a72d HTTP/1.0" 202 Accepted 2026-03-25 17:30:20,100 - lava_callback - INFO - Starting async job submit for node 69c178a02b2b51e9ad97a72d 2026-03-25 17:30:20,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:30:20,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c178a02b2b51e9ad97a72d HTTP/1.1" 200 None 2026-03-25 17:30:20,117 - lava_callback - DEBUG - Processing node 69c178a02b2b51e9ad97a72d: baseline-arm64-clabbe 2026-03-25 17:30:20,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c178a02b2b51e9ad97a72d 2026-03-25 17:30:20,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:30:20,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c178a02b2b51e9ad97a72d HTTP/1.1" 200 None 2026-03-25 17:30:20,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:30:20,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 17:30:20,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:30:20,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c178a02b2b51e9ad97a72d HTTP/1.1" 200 None 2026-03-25 17:30:20,198 - lava_callback - ERROR - Error processing callback for node 69c178a02b2b51e9ad97a72d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56374 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:31:40,146 - lava_callback - INFO - Received callback for node 69c178f42b2b51e9ad97a736 INFO: 172.21.0.1:60938 - "POST /node/69c178f42b2b51e9ad97a736 HTTP/1.0" 202 Accepted 2026-03-25 17:31:40,152 - lava_callback - INFO - Starting async job submit for node 69c178f42b2b51e9ad97a736 2026-03-25 17:31:40,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:31:40,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c178f42b2b51e9ad97a736 HTTP/1.1" 200 None 2026-03-25 17:31:40,169 - lava_callback - DEBUG - Processing node 69c178f42b2b51e9ad97a736: baseline-arm64-clabbe 2026-03-25 17:31:40,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c178f42b2b51e9ad97a736 2026-03-25 17:31:40,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:31:40,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c178f42b2b51e9ad97a736 HTTP/1.1" 200 None 2026-03-25 17:31:40,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:31:40,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 17:31:40,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:31:40,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c178f42b2b51e9ad97a736 HTTP/1.1" 200 None 2026-03-25 17:31:40,223 - lava_callback - ERROR - Error processing callback for node 69c178f42b2b51e9ad97a736: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:33:20,236 - lava_callback - INFO - Received callback for node 69c1794b2b2b51e9ad97a74e INFO: 172.21.0.1:51910 - "POST /node/69c1794b2b2b51e9ad97a74e HTTP/1.0" 202 Accepted 2026-03-25 17:33:20,242 - lava_callback - INFO - Starting async job submit for node 69c1794b2b2b51e9ad97a74e 2026-03-25 17:33:20,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:33:20,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1794b2b2b51e9ad97a74e HTTP/1.1" 200 None 2026-03-25 17:33:20,258 - lava_callback - DEBUG - Processing node 69c1794b2b2b51e9ad97a74e: baseline-arm64-clabbe 2026-03-25 17:33:20,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1794b2b2b51e9ad97a74e 2026-03-25 17:33:20,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:33:20,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1794b2b2b51e9ad97a74e HTTP/1.1" 200 None 2026-03-25 17:33:20,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:33:20,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 17:33:20,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:33:20,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1794b2b2b51e9ad97a74e HTTP/1.1" 200 None 2026-03-25 17:33:20,310 - lava_callback - ERROR - Error processing callback for node 69c1794b2b2b51e9ad97a74e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:34:22,786 - lava_callback - INFO - Received callback for node 69c41c90944faaf0e7f61252 INFO: 172.21.0.1:43756 - "POST /node/69c41c90944faaf0e7f61252 HTTP/1.0" 202 Accepted 2026-03-25 17:34:22,792 - lava_callback - INFO - Starting async job submit for node 69c41c90944faaf0e7f61252 2026-03-25 17:34:22,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:34:22,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41c90944faaf0e7f61252 HTTP/1.1" 200 None 2026-03-25 17:34:22,810 - lava_callback - DEBUG - Processing node 69c41c90944faaf0e7f61252: baseline-arm 2026-03-25 17:34:22,815 - lava_callback - WARNING - Failed to upload log 2026-03-25 17:34:22,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:34:22,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:34:22,960 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c41c90944faaf0e7f61252/lava-logs.yaml 2026-03-25 17:34:22,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:34:23,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:34:23,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c41c90944faaf0e7f61252/lava_callback.json.gz 2026-03-25 17:34:23,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:34:23,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41c90944faaf0e7f61252 HTTP/1.1" 200 None 2026-03-25 17:34:23,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:34:23,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 17:34:23,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:34:23,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41c90944faaf0e7f61252 HTTP/1.1" 200 None 2026-03-25 17:34:23,187 - lava_callback - INFO - Completed processing callback for node 69c41c90944faaf0e7f61252 INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40636 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:34:42,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:34:42,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44622 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:35:20,293 - lava_callback - INFO - Received callback for node 69c179cd2b2b51e9ad97a78c INFO: 172.21.0.1:45636 - "POST /node/69c179cd2b2b51e9ad97a78c HTTP/1.0" 202 Accepted 2026-03-25 17:35:20,298 - lava_callback - INFO - Starting async job submit for node 69c179cd2b2b51e9ad97a78c 2026-03-25 17:35:20,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:35:20,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c179cd2b2b51e9ad97a78c HTTP/1.1" 200 None 2026-03-25 17:35:20,332 - lava_callback - DEBUG - Processing node 69c179cd2b2b51e9ad97a78c: baseline-arm64-clabbe 2026-03-25 17:35:20,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c179cd2b2b51e9ad97a78c 2026-03-25 17:35:20,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:35:20,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c179cd2b2b51e9ad97a78c HTTP/1.1" 200 None 2026-03-25 17:35:20,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:35:20,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 17:35:20,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:35:20,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c179cd2b2b51e9ad97a78c HTTP/1.1" 200 None 2026-03-25 17:35:20,384 - lava_callback - ERROR - Error processing callback for node 69c179cd2b2b51e9ad97a78c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54722 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 17:36:16,481 - lava_callback - INFO - Received callback for node 69c419ab944faaf0e7f611bd INFO: 172.21.0.1:54732 - "POST /node/69c419ab944faaf0e7f611bd HTTP/1.0" 202 Accepted 2026-03-25 17:36:16,488 - lava_callback - INFO - Starting async job submit for node 69c419ab944faaf0e7f611bd 2026-03-25 17:36:16,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:54742 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:36:16,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c419ab944faaf0e7f611bd HTTP/1.1" 200 None 2026-03-25 17:36:16,561 - lava_callback - DEBUG - Processing node 69c419ab944faaf0e7f611bd: baseline-nfs-arm64 2026-03-25 17:36:17,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:36:17,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:36:17,526 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c419ab944faaf0e7f611bd/log.txt.gz 2026-03-25 17:36:17,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:36:18,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:36:18,237 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c419ab944faaf0e7f611bd/lava-logs.yaml 2026-03-25 17:36:18,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:36:18,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:36:18,428 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c419ab944faaf0e7f611bd/lava_callback.json.gz DEBUG: Setup failed for 69c419ab944faaf0e7f611bd. Transitting job node result: incomplete -> fail 2026-03-25 17:36:18,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:18,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c419ab944faaf0e7f611bd HTTP/1.1" 200 None 2026-03-25 17:36:18,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:18,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:36:18,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:18,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c419ab944faaf0e7f611bd HTTP/1.1" 200 None 2026-03-25 17:36:18,725 - lava_callback - INFO - Completed processing callback for node 69c419ab944faaf0e7f611bd INFO: 172.21.0.1:38952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36648 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:36:40,379 - lava_callback - INFO - Received callback for node 69c17a242b2b51e9ad97a7bf INFO: 172.21.0.1:43080 - "POST /node/69c17a242b2b51e9ad97a7bf HTTP/1.0" 202 Accepted 2026-03-25 17:36:40,385 - lava_callback - INFO - Starting async job submit for node 69c17a242b2b51e9ad97a7bf 2026-03-25 17:36:40,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:40,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17a242b2b51e9ad97a7bf HTTP/1.1" 200 None 2026-03-25 17:36:40,401 - lava_callback - DEBUG - Processing node 69c17a242b2b51e9ad97a7bf: baseline-arm64-clabbe 2026-03-25 17:36:40,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17a242b2b51e9ad97a7bf 2026-03-25 17:36:40,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:40,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17a242b2b51e9ad97a7bf HTTP/1.1" 200 None 2026-03-25 17:36:40,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:40,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-25 17:36:40,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:40,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17a242b2b51e9ad97a7bf HTTP/1.1" 200 None 2026-03-25 17:36:40,455 - lava_callback - ERROR - Error processing callback for node 69c17a242b2b51e9ad97a7bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:36:42,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:42,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43100 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:36:49,476 - lava_callback - INFO - Received callback for node 69c41ce4944faaf0e7f6126c INFO: 172.21.0.1:43110 - "POST /node/69c41ce4944faaf0e7f6126c HTTP/1.0" 202 Accepted 2026-03-25 17:36:49,483 - lava_callback - INFO - Starting async job submit for node 69c41ce4944faaf0e7f6126c 2026-03-25 17:36:49,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:49,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41ce4944faaf0e7f6126c HTTP/1.1" 200 None 2026-03-25 17:36:49,527 - lava_callback - DEBUG - Processing node 69c41ce4944faaf0e7f6126c: baseline-arm64 2026-03-25 17:36:49,722 - lava_callback - WARNING - Failed to upload log 2026-03-25 17:36:49,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:36:49,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:36:50,000 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41ce4944faaf0e7f6126c/lava-logs.yaml 2026-03-25 17:36:50,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:36:50,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:36:50,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41ce4944faaf0e7f6126c/lava_callback.json.gz 2026-03-25 17:36:50,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:50,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41ce4944faaf0e7f6126c HTTP/1.1" 200 None 2026-03-25 17:36:50,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:50,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:36:50,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:36:50,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41ce4944faaf0e7f6126c HTTP/1.1" 200 None 2026-03-25 17:36:50,312 - lava_callback - INFO - Completed processing callback for node 69c41ce4944faaf0e7f6126c INFO: 172.21.0.1:33444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41914 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:37:12,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:12,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:37:24,859 - lava_callback - INFO - Received callback for node 69c419f9944faaf0e7f611c9 INFO: 172.21.0.1:44044 - "POST /node/69c419f9944faaf0e7f611c9 HTTP/1.0" 202 Accepted 2026-03-25 17:37:24,867 - lava_callback - INFO - Starting async job submit for node 69c419f9944faaf0e7f611c9 2026-03-25 17:37:24,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:24,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c419f9944faaf0e7f611c9 HTTP/1.1" 200 None 2026-03-25 17:37:24,930 - lava_callback - DEBUG - Processing node 69c419f9944faaf0e7f611c9: baseline-arm64 2026-03-25 17:37:25,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:37:25,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:37:25,788 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c419f9944faaf0e7f611c9/log.txt.gz 2026-03-25 17:37:26,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:37:26,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:37:26,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c419f9944faaf0e7f611c9/lava-logs.yaml 2026-03-25 17:37:26,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44060 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:37:26,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:37:26,644 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c419f9944faaf0e7f611c9/lava_callback.json.gz DEBUG: Setup failed for 69c419f9944faaf0e7f611c9. Transitting job node result: incomplete -> fail 2026-03-25 17:37:26,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:26,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c419f9944faaf0e7f611c9 HTTP/1.1" 200 None 2026-03-25 17:37:26,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:26,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:37:26,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:26,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c419f9944faaf0e7f611c9 HTTP/1.1" 200 None 2026-03-25 17:37:26,939 - lava_callback - INFO - Completed processing callback for node 69c419f9944faaf0e7f611c9 2026-03-25 17:37:28,590 - lava_callback - INFO - Received callback for node 69c4199d944faaf0e7f611b8 INFO: 172.21.0.1:44062 - "POST /node/69c4199d944faaf0e7f611b8 HTTP/1.0" 202 Accepted 2026-03-25 17:37:28,597 - lava_callback - INFO - Starting async job submit for node 69c4199d944faaf0e7f611b8 2026-03-25 17:37:28,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:28,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4199d944faaf0e7f611b8 HTTP/1.1" 200 None 2026-03-25 17:37:28,661 - lava_callback - DEBUG - Processing node 69c4199d944faaf0e7f611b8: baseline-x86 2026-03-25 17:37:29,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:37:29,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:37:29,563 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c4199d944faaf0e7f611b8/log.txt.gz 2026-03-25 17:37:30,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:37:30,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:37:30,262 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c4199d944faaf0e7f611b8/lava-logs.yaml 2026-03-25 17:37:30,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:37:30,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:37:30,451 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c4199d944faaf0e7f611b8/lava_callback.json.gz DEBUG: Setup failed for 69c4199d944faaf0e7f611b8. Transitting job node result: incomplete -> fail 2026-03-25 17:37:30,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:30,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4199d944faaf0e7f611b8 HTTP/1.1" 200 None 2026-03-25 17:37:30,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:30,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40aef944faaf0e7f5e438 HTTP/1.1" 200 None 2026-03-25 17:37:30,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:30,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4199d944faaf0e7f611b8 HTTP/1.1" 200 None 2026-03-25 17:37:30,701 - lava_callback - INFO - Completed processing callback for node 69c4199d944faaf0e7f611b8 INFO: 172.21.0.1:56162 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:37:42,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:37:42,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43252 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:43:26,615 - lava_callback - INFO - Received callback for node 69c41eb9944faaf0e7f612ca INFO: 172.21.0.1:43262 - "POST /node/69c41eb9944faaf0e7f612ca HTTP/1.0" 202 Accepted 2026-03-25 17:43:26,621 - lava_callback - INFO - Starting async job submit for node 69c41eb9944faaf0e7f612ca 2026-03-25 17:43:26,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:26,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41eb9944faaf0e7f612ca HTTP/1.1" 200 None 2026-03-25 17:43:26,638 - lava_callback - DEBUG - Processing node 69c41eb9944faaf0e7f612ca: baseline-nfs-arm64 2026-03-25 17:43:26,640 - lava_callback - WARNING - Failed to upload log 2026-03-25 17:43:26,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:43:26,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:43:26,799 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41eb9944faaf0e7f612ca/lava-logs.yaml 2026-03-25 17:43:26,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:43:26,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:43:26,954 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c41eb9944faaf0e7f612ca/lava_callback.json.gz 2026-03-25 17:43:26,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:26,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41eb9944faaf0e7f612ca HTTP/1.1" 200 None 2026-03-25 17:43:26,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:26,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:43:26,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:27,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41eb9944faaf0e7f612ca HTTP/1.1" 200 None 2026-03-25 17:43:27,029 - lava_callback - INFO - Completed processing callback for node 69c41eb9944faaf0e7f612ca INFO: 172.21.0.1:44844 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:43:42,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:42,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 17:43:44,429 - lava_callback - INFO - Received callback for node 69c411ac944faaf0e7f60e4e INFO: 172.21.0.1:44660 - "POST /node/69c411ac944faaf0e7f60e4e HTTP/1.0" 202 Accepted 2026-03-25 17:43:44,435 - lava_callback - INFO - Starting async job submit for node 69c411ac944faaf0e7f60e4e 2026-03-25 17:43:44,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:44,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411ac944faaf0e7f60e4e HTTP/1.1" 200 None 2026-03-25 17:43:44,480 - lava_callback - DEBUG - Processing node 69c411ac944faaf0e7f60e4e: baseline-arm64-broonie 2026-03-25 17:43:44,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:43:44,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:43:44,845 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411ac944faaf0e7f60e4e/log.txt.gz 2026-03-25 17:43:44,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:43:45,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:43:45,202 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411ac944faaf0e7f60e4e/lava-logs.yaml 2026-03-25 17:43:45,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:43:45,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:43:45,386 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411ac944faaf0e7f60e4e/lava_callback.json.gz 2026-03-25 17:43:45,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:45,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411ac944faaf0e7f60e4e HTTP/1.1" 200 None 2026-03-25 17:43:45,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:45,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:43:45,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:43:45,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411ac944faaf0e7f60e4e HTTP/1.1" 200 None 2026-03-25 17:43:45,477 - lava_callback - INFO - Completed processing callback for node 69c411ac944faaf0e7f60e4e INFO: 172.21.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47368 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:44:12,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:44:12,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:48:07,011 - lava_callback - INFO - Received callback for node 69c17cc92b2b51e9ad97a815 INFO: 172.21.0.1:40046 - "POST /node/69c17cc92b2b51e9ad97a815 HTTP/1.0" 202 Accepted 2026-03-25 17:48:07,017 - lava_callback - INFO - Starting async job submit for node 69c17cc92b2b51e9ad97a815 2026-03-25 17:48:07,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:48:07,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17cc92b2b51e9ad97a815 HTTP/1.1" 200 None 2026-03-25 17:48:07,033 - lava_callback - DEBUG - Processing node 69c17cc92b2b51e9ad97a815: baseline-arm-baylibre 2026-03-25 17:48:07,033 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17cc92b2b51e9ad97a815 2026-03-25 17:48:07,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:48:07,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17cc92b2b51e9ad97a815 HTTP/1.1" 200 None 2026-03-25 17:48:07,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:48:07,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:48:07,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:48:07,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17cc92b2b51e9ad97a815 HTTP/1.1" 200 None 2026-03-25 17:48:07,122 - lava_callback - ERROR - Error processing callback for node 69c17cc92b2b51e9ad97a815: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44238 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:48:47,015 - lava_callback - INFO - Received callback for node 69c17cf22b2b51e9ad97a822 INFO: 172.21.0.1:44244 - "POST /node/69c17cf22b2b51e9ad97a822 HTTP/1.0" 202 Accepted 2026-03-25 17:48:47,021 - lava_callback - INFO - Starting async job submit for node 69c17cf22b2b51e9ad97a822 2026-03-25 17:48:47,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:48:47,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17cf22b2b51e9ad97a822 HTTP/1.1" 200 None 2026-03-25 17:48:47,038 - lava_callback - DEBUG - Processing node 69c17cf22b2b51e9ad97a822: baseline-arm-baylibre 2026-03-25 17:48:47,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17cf22b2b51e9ad97a822 2026-03-25 17:48:47,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:48:47,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17cf22b2b51e9ad97a822 HTTP/1.1" 200 None 2026-03-25 17:48:47,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:48:47,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:48:47,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:48:47,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17cf22b2b51e9ad97a822 HTTP/1.1" 200 None 2026-03-25 17:48:47,099 - lava_callback - ERROR - Error processing callback for node 69c17cf22b2b51e9ad97a822: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51866 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:49:27,086 - lava_callback - INFO - Received callback for node 69c17d1a2b2b51e9ad97a831 INFO: 172.21.0.1:51872 - "POST /node/69c17d1a2b2b51e9ad97a831 HTTP/1.0" 202 Accepted 2026-03-25 17:49:27,092 - lava_callback - INFO - Starting async job submit for node 69c17d1a2b2b51e9ad97a831 2026-03-25 17:49:27,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:49:27,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17d1a2b2b51e9ad97a831 HTTP/1.1" 200 None 2026-03-25 17:49:27,108 - lava_callback - DEBUG - Processing node 69c17d1a2b2b51e9ad97a831: baseline-arm-baylibre 2026-03-25 17:49:27,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17d1a2b2b51e9ad97a831 2026-03-25 17:49:27,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:49:27,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17d1a2b2b51e9ad97a831 HTTP/1.1" 200 None 2026-03-25 17:49:27,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:49:27,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:49:27,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:49:27,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17d1a2b2b51e9ad97a831 HTTP/1.1" 200 None 2026-03-25 17:49:27,175 - lava_callback - ERROR - Error processing callback for node 69c17d1a2b2b51e9ad97a831: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:49:50,897 - lava_callback - INFO - Received callback for node 69c4117a944faaf0e7f60d9f INFO: 172.21.0.1:50800 - "POST /node/69c4117a944faaf0e7f60d9f HTTP/1.0" 202 Accepted 2026-03-25 17:49:50,903 - lava_callback - INFO - Starting async job submit for node 69c4117a944faaf0e7f60d9f 2026-03-25 17:49:50,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:49:50,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117a944faaf0e7f60d9f HTTP/1.1" 200 None 2026-03-25 17:49:50,969 - lava_callback - DEBUG - Processing node 69c4117a944faaf0e7f60d9f: baseline-arm64 2026-03-25 17:49:51,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:49:51,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:49:51,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117a944faaf0e7f60d9f/log.txt.gz 2026-03-25 17:49:51,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:49:51,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:49:51,913 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117a944faaf0e7f60d9f/lava-logs.yaml 2026-03-25 17:49:51,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:49:52,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:49:52,069 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4117a944faaf0e7f60d9f/lava_callback.json.gz 2026-03-25 17:49:52,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:49:52,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117a944faaf0e7f60d9f HTTP/1.1" 200 None 2026-03-25 17:49:52,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:49:52,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:49:52,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:49:52,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4117a944faaf0e7f60d9f HTTP/1.1" 200 None 2026-03-25 17:49:52,158 - lava_callback - INFO - Completed processing callback for node 69c4117a944faaf0e7f60d9f INFO: 172.21.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33374 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:50:07,055 - lava_callback - INFO - Received callback for node 69c17d422b2b51e9ad97a83d INFO: 172.21.0.1:33378 - "POST /node/69c17d422b2b51e9ad97a83d HTTP/1.0" 202 Accepted 2026-03-25 17:50:07,061 - lava_callback - INFO - Starting async job submit for node 69c17d422b2b51e9ad97a83d 2026-03-25 17:50:07,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:07,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17d422b2b51e9ad97a83d HTTP/1.1" 200 None 2026-03-25 17:50:07,077 - lava_callback - DEBUG - Processing node 69c17d422b2b51e9ad97a83d: baseline-arm-baylibre 2026-03-25 17:50:07,077 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17d422b2b51e9ad97a83d 2026-03-25 17:50:07,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:07,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17d422b2b51e9ad97a83d HTTP/1.1" 200 None 2026-03-25 17:50:07,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:07,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:50:07,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:07,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17d422b2b51e9ad97a83d HTTP/1.1" 200 None 2026-03-25 17:50:07,144 - lava_callback - ERROR - Error processing callback for node 69c17d422b2b51e9ad97a83d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:50:12,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:12,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:50:40,872 - lava_callback - INFO - Received callback for node 69c17d6e2b2b51e9ad97a849 INFO: 172.21.0.1:55282 - "POST /node/69c17d6e2b2b51e9ad97a849 HTTP/1.0" 202 Accepted 2026-03-25 17:50:40,878 - lava_callback - INFO - Starting async job submit for node 69c17d6e2b2b51e9ad97a849 2026-03-25 17:50:40,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:40,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17d6e2b2b51e9ad97a849 HTTP/1.1" 200 None 2026-03-25 17:50:40,894 - lava_callback - DEBUG - Processing node 69c17d6e2b2b51e9ad97a849: baseline-arm-clabbe 2026-03-25 17:50:40,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17d6e2b2b51e9ad97a849 2026-03-25 17:50:40,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:40,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17d6e2b2b51e9ad97a849 HTTP/1.1" 200 None 2026-03-25 17:50:40,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:40,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:50:40,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:50:40,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17d6e2b2b51e9ad97a849 HTTP/1.1" 200 None 2026-03-25 17:50:40,961 - lava_callback - ERROR - Error processing callback for node 69c17d6e2b2b51e9ad97a849: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38690 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:51:27,334 - lava_callback - INFO - Received callback for node 69c17d942b2b51e9ad97a857 INFO: 172.21.0.1:38704 - "POST /node/69c17d942b2b51e9ad97a857 HTTP/1.0" 202 Accepted 2026-03-25 17:51:27,339 - lava_callback - INFO - Starting async job submit for node 69c17d942b2b51e9ad97a857 2026-03-25 17:51:27,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:51:27,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17d942b2b51e9ad97a857 HTTP/1.1" 200 None 2026-03-25 17:51:27,355 - lava_callback - DEBUG - Processing node 69c17d942b2b51e9ad97a857: baseline-arm-baylibre 2026-03-25 17:51:27,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17d942b2b51e9ad97a857 2026-03-25 17:51:27,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:51:27,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17d942b2b51e9ad97a857 HTTP/1.1" 200 None 2026-03-25 17:51:27,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:51:27,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:51:27,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:51:27,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17d942b2b51e9ad97a857 HTTP/1.1" 200 None 2026-03-25 17:51:27,420 - lava_callback - ERROR - Error processing callback for node 69c17d942b2b51e9ad97a857: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:52:20,851 - lava_callback - INFO - Received callback for node 69c17dbf2b2b51e9ad97a861 INFO: 172.21.0.1:55990 - "POST /node/69c17dbf2b2b51e9ad97a861 HTTP/1.0" 202 Accepted 2026-03-25 17:52:20,856 - lava_callback - INFO - Starting async job submit for node 69c17dbf2b2b51e9ad97a861 2026-03-25 17:52:20,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:52:20,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17dbf2b2b51e9ad97a861 HTTP/1.1" 200 None 2026-03-25 17:52:20,872 - lava_callback - DEBUG - Processing node 69c17dbf2b2b51e9ad97a861: baseline-arm-clabbe 2026-03-25 17:52:20,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17dbf2b2b51e9ad97a861 2026-03-25 17:52:20,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:52:20,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17dbf2b2b51e9ad97a861 HTTP/1.1" 200 None 2026-03-25 17:52:20,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:52:20,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:52:20,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:52:20,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17dbf2b2b51e9ad97a861 HTTP/1.1" 200 None 2026-03-25 17:52:20,949 - lava_callback - ERROR - Error processing callback for node 69c17dbf2b2b51e9ad97a861: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39770 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:52:47,263 - lava_callback - INFO - Received callback for node 69c17de62b2b51e9ad97a871 INFO: 172.21.0.1:39782 - "POST /node/69c17de62b2b51e9ad97a871 HTTP/1.0" 202 Accepted 2026-03-25 17:52:47,268 - lava_callback - INFO - Starting async job submit for node 69c17de62b2b51e9ad97a871 2026-03-25 17:52:47,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:52:47,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17de62b2b51e9ad97a871 HTTP/1.1" 200 None 2026-03-25 17:52:47,286 - lava_callback - DEBUG - Processing node 69c17de62b2b51e9ad97a871: baseline-arm-baylibre 2026-03-25 17:52:47,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17de62b2b51e9ad97a871 2026-03-25 17:52:47,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:52:47,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17de62b2b51e9ad97a871 HTTP/1.1" 200 None 2026-03-25 17:52:47,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:52:47,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:52:47,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:52:47,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17de62b2b51e9ad97a871 HTTP/1.1" 200 None 2026-03-25 17:52:47,346 - lava_callback - ERROR - Error processing callback for node 69c17de62b2b51e9ad97a871: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50156 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:53:26,895 - lava_callback - INFO - Received callback for node 69c4118b944faaf0e7f60ddd INFO: 172.21.0.1:50166 - "POST /node/69c4118b944faaf0e7f60ddd HTTP/1.0" 202 Accepted 2026-03-25 17:53:26,901 - lava_callback - INFO - Starting async job submit for node 69c4118b944faaf0e7f60ddd 2026-03-25 17:53:26,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:26,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4118b944faaf0e7f60ddd HTTP/1.1" 200 None 2026-03-25 17:53:26,934 - lava_callback - DEBUG - Processing node 69c4118b944faaf0e7f60ddd: baseline-nfs-arm64 2026-03-25 17:53:27,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:53:27,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:53:27,484 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118b944faaf0e7f60ddd/log.txt.gz 2026-03-25 17:53:27,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:53:27,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:53:27,971 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118b944faaf0e7f60ddd/lava-logs.yaml 2026-03-25 17:53:27,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:53:28,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:53:28,163 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c4118b944faaf0e7f60ddd/lava_callback.json.gz 2026-03-25 17:53:28,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:28,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4118b944faaf0e7f60ddd HTTP/1.1" 200 None 2026-03-25 17:53:28,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:28,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:53:28,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:28,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4118b944faaf0e7f60ddd HTTP/1.1" 200 None 2026-03-25 17:53:28,246 - lava_callback - INFO - Completed processing callback for node 69c4118b944faaf0e7f60ddd 2026-03-25 17:53:30,752 - lava_callback - INFO - Received callback for node 69c41f5f944faaf0e7f612e6 INFO: 172.21.0.1:53258 - "POST /node/69c41f5f944faaf0e7f612e6 HTTP/1.0" 202 Accepted 2026-03-25 17:53:30,759 - lava_callback - INFO - Starting async job submit for node 69c41f5f944faaf0e7f612e6 2026-03-25 17:53:30,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:30,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41f5f944faaf0e7f612e6 HTTP/1.1" 200 None 2026-03-25 17:53:30,818 - lava_callback - DEBUG - Processing node 69c41f5f944faaf0e7f612e6: baseline-arm64 2026-03-25 17:53:31,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:53:31,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:53:31,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41f5f944faaf0e7f612e6/log.txt.gz 2026-03-25 17:53:31,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:53:31,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:53:31,722 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41f5f944faaf0e7f612e6/lava-logs.yaml 2026-03-25 17:53:31,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:53:31,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:53:31,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c41f5f944faaf0e7f612e6/lava_callback.json.gz DEBUG: Setup failed for 69c41f5f944faaf0e7f612e6. Transitting job node result: incomplete -> fail 2026-03-25 17:53:32,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:32,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41f5f944faaf0e7f612e6 HTTP/1.1" 200 None 2026-03-25 17:53:32,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:32,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:53:32,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:32,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41f5f944faaf0e7f612e6 HTTP/1.1" 200 None 2026-03-25 17:53:32,142 - lava_callback - INFO - Completed processing callback for node 69c41f5f944faaf0e7f612e6 INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:53:40,921 - lava_callback - INFO - Received callback for node 69c17e142b2b51e9ad97a87f INFO: 172.21.0.1:56704 - "POST /node/69c17e142b2b51e9ad97a87f HTTP/1.0" 202 Accepted 2026-03-25 17:53:40,926 - lava_callback - INFO - Starting async job submit for node 69c17e142b2b51e9ad97a87f 2026-03-25 17:53:40,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:40,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e142b2b51e9ad97a87f HTTP/1.1" 200 None 2026-03-25 17:53:40,942 - lava_callback - DEBUG - Processing node 69c17e142b2b51e9ad97a87f: baseline-arm-clabbe 2026-03-25 17:53:40,942 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17e142b2b51e9ad97a87f 2026-03-25 17:53:40,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:40,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e142b2b51e9ad97a87f HTTP/1.1" 200 None 2026-03-25 17:53:40,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:40,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:53:40,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:40,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e142b2b51e9ad97a87f HTTP/1.1" 200 None 2026-03-25 17:53:40,993 - lava_callback - ERROR - Error processing callback for node 69c17e142b2b51e9ad97a87f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:53:42,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:53:42,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36092 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:54:20,898 - lava_callback - INFO - Received callback for node 69c17e3c2b2b51e9ad97a88a INFO: 172.21.0.1:55220 - "POST /node/69c17e3c2b2b51e9ad97a88a HTTP/1.0" 202 Accepted 2026-03-25 17:54:20,904 - lava_callback - INFO - Starting async job submit for node 69c17e3c2b2b51e9ad97a88a 2026-03-25 17:54:20,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:54:20,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e3c2b2b51e9ad97a88a HTTP/1.1" 200 None 2026-03-25 17:54:20,928 - lava_callback - DEBUG - Processing node 69c17e3c2b2b51e9ad97a88a: baseline-arm-clabbe 2026-03-25 17:54:20,928 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17e3c2b2b51e9ad97a88a 2026-03-25 17:54:20,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:54:20,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e3c2b2b51e9ad97a88a HTTP/1.1" 200 None 2026-03-25 17:54:20,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:54:20,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:54:20,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:54:20,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e3c2b2b51e9ad97a88a HTTP/1.1" 200 None 2026-03-25 17:54:20,982 - lava_callback - ERROR - Error processing callback for node 69c17e3c2b2b51e9ad97a88a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:55:20,976 - lava_callback - INFO - Received callback for node 69c17e7b2b2b51e9ad97a898 INFO: 172.21.0.1:57312 - "POST /node/69c17e7b2b2b51e9ad97a898 HTTP/1.0" 202 Accepted 2026-03-25 17:55:20,981 - lava_callback - INFO - Starting async job submit for node 69c17e7b2b2b51e9ad97a898 2026-03-25 17:55:20,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:55:21,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e7b2b2b51e9ad97a898 HTTP/1.1" 200 None 2026-03-25 17:55:21,012 - lava_callback - DEBUG - Processing node 69c17e7b2b2b51e9ad97a898: baseline-arm-clabbe 2026-03-25 17:55:21,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17e7b2b2b51e9ad97a898 2026-03-25 17:55:21,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:55:21,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e7b2b2b51e9ad97a898 HTTP/1.1" 200 None 2026-03-25 17:55:21,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:55:21,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 17:55:21,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:55:21,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e7b2b2b51e9ad97a898 HTTP/1.1" 200 None 2026-03-25 17:55:21,066 - lava_callback - ERROR - Error processing callback for node 69c17e7b2b2b51e9ad97a898: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39524 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:56:07,418 - lava_callback - INFO - Received callback for node 69c17eb52b2b51e9ad97a921 INFO: 172.21.0.1:39540 - "POST /node/69c17eb52b2b51e9ad97a921 HTTP/1.0" 202 Accepted 2026-03-25 17:56:07,424 - lava_callback - INFO - Starting async job submit for node 69c17eb52b2b51e9ad97a921 2026-03-25 17:56:07,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:07,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb52b2b51e9ad97a921 HTTP/1.1" 200 None 2026-03-25 17:56:07,445 - lava_callback - DEBUG - Processing node 69c17eb52b2b51e9ad97a921: baseline-arm64-baylibre 2026-03-25 17:56:07,445 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17eb52b2b51e9ad97a921 2026-03-25 17:56:07,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:07,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb52b2b51e9ad97a921 HTTP/1.1" 200 None 2026-03-25 17:56:07,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:07,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:07,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:07,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eb52b2b51e9ad97a921 HTTP/1.1" 200 None 2026-03-25 17:56:07,503 - lava_callback - ERROR - Error processing callback for node 69c17eb52b2b51e9ad97a921: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35198 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:56:27,393 - lava_callback - INFO - Received callback for node 69c17eb72b2b51e9ad97a924 INFO: 172.21.0.1:35206 - "POST /node/69c17eb72b2b51e9ad97a924 HTTP/1.0" 202 Accepted 2026-03-25 17:56:27,399 - lava_callback - INFO - Starting async job submit for node 69c17eb72b2b51e9ad97a924 2026-03-25 17:56:27,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:27,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb72b2b51e9ad97a924 HTTP/1.1" 200 None 2026-03-25 17:56:27,442 - lava_callback - DEBUG - Processing node 69c17eb72b2b51e9ad97a924: baseline-arm64-baylibre 2026-03-25 17:56:27,442 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17eb72b2b51e9ad97a924 2026-03-25 17:56:27,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:27,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb72b2b51e9ad97a924 HTTP/1.1" 200 None 2026-03-25 17:56:27,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:27,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:27,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:27,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eb72b2b51e9ad97a924 HTTP/1.1" 200 None 2026-03-25 17:56:27,520 - lava_callback - ERROR - Error processing callback for node 69c17eb72b2b51e9ad97a924: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:28,066 - lava_callback - INFO - Received callback for node 69c17eb82b2b51e9ad97a927 INFO: 172.21.0.1:35212 - "POST /node/69c17eb82b2b51e9ad97a927 HTTP/1.0" 202 Accepted 2026-03-25 17:56:28,075 - lava_callback - INFO - Starting async job submit for node 69c17eb82b2b51e9ad97a927 2026-03-25 17:56:28,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:28,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb82b2b51e9ad97a927 HTTP/1.1" 200 None 2026-03-25 17:56:28,098 - lava_callback - DEBUG - Processing node 69c17eb82b2b51e9ad97a927: baseline-arm64-baylibre 2026-03-25 17:56:28,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17eb82b2b51e9ad97a927 2026-03-25 17:56:28,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:28,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb82b2b51e9ad97a927 HTTP/1.1" 200 None 2026-03-25 17:56:28,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:28,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:28,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:28,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eb82b2b51e9ad97a927 HTTP/1.1" 200 None 2026-03-25 17:56:28,187 - lava_callback - ERROR - Error processing callback for node 69c17eb82b2b51e9ad97a927: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:28,732 - lava_callback - INFO - Received callback for node 69c17eba2b2b51e9ad97a932 INFO: 172.21.0.1:35216 - "POST /node/69c17eba2b2b51e9ad97a932 HTTP/1.0" 202 Accepted 2026-03-25 17:56:28,737 - lava_callback - INFO - Starting async job submit for node 69c17eba2b2b51e9ad97a932 2026-03-25 17:56:28,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:28,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eba2b2b51e9ad97a932 HTTP/1.1" 200 None 2026-03-25 17:56:28,753 - lava_callback - DEBUG - Processing node 69c17eba2b2b51e9ad97a932: baseline-arm64-baylibre 2026-03-25 17:56:28,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17eba2b2b51e9ad97a932 2026-03-25 17:56:28,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:28,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eba2b2b51e9ad97a932 HTTP/1.1" 200 None 2026-03-25 17:56:28,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:28,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:28,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:28,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eba2b2b51e9ad97a932 HTTP/1.1" 200 None 2026-03-25 17:56:28,806 - lava_callback - ERROR - Error processing callback for node 69c17eba2b2b51e9ad97a932: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:29,375 - lava_callback - INFO - Received callback for node 69c17ebc2b2b51e9ad97a935 INFO: 172.21.0.1:35224 - "POST /node/69c17ebc2b2b51e9ad97a935 HTTP/1.0" 202 Accepted 2026-03-25 17:56:29,381 - lava_callback - INFO - Starting async job submit for node 69c17ebc2b2b51e9ad97a935 2026-03-25 17:56:29,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:29,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ebc2b2b51e9ad97a935 HTTP/1.1" 200 None 2026-03-25 17:56:29,398 - lava_callback - DEBUG - Processing node 69c17ebc2b2b51e9ad97a935: baseline-arm64-baylibre 2026-03-25 17:56:29,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17ebc2b2b51e9ad97a935 2026-03-25 17:56:29,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:29,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ebc2b2b51e9ad97a935 HTTP/1.1" 200 None 2026-03-25 17:56:29,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:29,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:29,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:29,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ebc2b2b51e9ad97a935 HTTP/1.1" 200 None 2026-03-25 17:56:29,489 - lava_callback - ERROR - Error processing callback for node 69c17ebc2b2b51e9ad97a935: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:30,025 - lava_callback - INFO - Received callback for node 69c17ebe2b2b51e9ad97a950 INFO: 172.21.0.1:42524 - "POST /node/69c17ebe2b2b51e9ad97a950 HTTP/1.0" 202 Accepted 2026-03-25 17:56:30,031 - lava_callback - INFO - Starting async job submit for node 69c17ebe2b2b51e9ad97a950 2026-03-25 17:56:30,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:30,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ebe2b2b51e9ad97a950 HTTP/1.1" 200 None 2026-03-25 17:56:30,048 - lava_callback - DEBUG - Processing node 69c17ebe2b2b51e9ad97a950: baseline-arm64-baylibre 2026-03-25 17:56:30,049 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17ebe2b2b51e9ad97a950 2026-03-25 17:56:30,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:30,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ebe2b2b51e9ad97a950 HTTP/1.1" 200 None 2026-03-25 17:56:30,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:30,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:30,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:30,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ebe2b2b51e9ad97a950 HTTP/1.1" 200 None 2026-03-25 17:56:30,114 - lava_callback - ERROR - Error processing callback for node 69c17ebe2b2b51e9ad97a950: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:56:40,984 - lava_callback - INFO - Received callback for node 69c17ecf2b2b51e9ad97a97c INFO: 172.21.0.1:52172 - "POST /node/69c17ecf2b2b51e9ad97a97c HTTP/1.0" 202 Accepted 2026-03-25 17:56:40,990 - lava_callback - INFO - Starting async job submit for node 69c17ecf2b2b51e9ad97a97c 2026-03-25 17:56:40,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:41,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ecf2b2b51e9ad97a97c HTTP/1.1" 200 None 2026-03-25 17:56:41,013 - lava_callback - DEBUG - Processing node 69c17ecf2b2b51e9ad97a97c: baseline-arm64-clabbe 2026-03-25 17:56:41,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17ecf2b2b51e9ad97a97c 2026-03-25 17:56:41,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:41,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ecf2b2b51e9ad97a97c HTTP/1.1" 200 None 2026-03-25 17:56:41,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:41,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:41,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:41,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ecf2b2b51e9ad97a97c HTTP/1.1" 200 None 2026-03-25 17:56:41,090 - lava_callback - ERROR - Error processing callback for node 69c17ecf2b2b51e9ad97a97c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:41,670 - lava_callback - INFO - Received callback for node 69c17ed12b2b51e9ad97a97f INFO: 172.21.0.1:52186 - "POST /node/69c17ed12b2b51e9ad97a97f HTTP/1.0" 202 Accepted 2026-03-25 17:56:41,677 - lava_callback - INFO - Starting async job submit for node 69c17ed12b2b51e9ad97a97f 2026-03-25 17:56:41,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:41,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed12b2b51e9ad97a97f HTTP/1.1" 200 None 2026-03-25 17:56:41,724 - lava_callback - DEBUG - Processing node 69c17ed12b2b51e9ad97a97f: baseline-arm64-clabbe 2026-03-25 17:56:41,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17ed12b2b51e9ad97a97f 2026-03-25 17:56:41,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:41,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed12b2b51e9ad97a97f HTTP/1.1" 200 None 2026-03-25 17:56:41,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:41,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:41,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:41,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ed12b2b51e9ad97a97f HTTP/1.1" 200 None 2026-03-25 17:56:41,793 - lava_callback - ERROR - Error processing callback for node 69c17ed12b2b51e9ad97a97f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:42,350 - lava_callback - INFO - Received callback for node 69c17ed22b2b51e9ad97a982 INFO: 172.21.0.1:52200 - "POST /node/69c17ed22b2b51e9ad97a982 HTTP/1.0" 202 Accepted 2026-03-25 17:56:42,359 - lava_callback - INFO - Starting async job submit for node 69c17ed22b2b51e9ad97a982 2026-03-25 17:56:42,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:42,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed22b2b51e9ad97a982 HTTP/1.1" 200 None 2026-03-25 17:56:42,383 - lava_callback - DEBUG - Processing node 69c17ed22b2b51e9ad97a982: baseline-arm64-clabbe 2026-03-25 17:56:42,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17ed22b2b51e9ad97a982 2026-03-25 17:56:42,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:42,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed22b2b51e9ad97a982 HTTP/1.1" 200 None 2026-03-25 17:56:42,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:42,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:42,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:42,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ed22b2b51e9ad97a982 HTTP/1.1" 200 None 2026-03-25 17:56:42,453 - lava_callback - ERROR - Error processing callback for node 69c17ed22b2b51e9ad97a982: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:43,063 - lava_callback - INFO - Received callback for node 69c17ed22b2b51e9ad97a985 INFO: 172.21.0.1:52206 - "POST /node/69c17ed22b2b51e9ad97a985 HTTP/1.0" 202 Accepted 2026-03-25 17:56:43,070 - lava_callback - INFO - Starting async job submit for node 69c17ed22b2b51e9ad97a985 2026-03-25 17:56:43,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:43,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed22b2b51e9ad97a985 HTTP/1.1" 200 None 2026-03-25 17:56:43,088 - lava_callback - DEBUG - Processing node 69c17ed22b2b51e9ad97a985: baseline-arm64-clabbe 2026-03-25 17:56:43,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17ed22b2b51e9ad97a985 2026-03-25 17:56:43,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:43,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed22b2b51e9ad97a985 HTTP/1.1" 200 None 2026-03-25 17:56:43,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:43,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:43,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:43,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ed22b2b51e9ad97a985 HTTP/1.1" 200 None 2026-03-25 17:56:43,195 - lava_callback - ERROR - Error processing callback for node 69c17ed22b2b51e9ad97a985: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:43,713 - lava_callback - INFO - Received callback for node 69c17ed42b2b51e9ad97a98b INFO: 172.21.0.1:52210 - "POST /node/69c17ed42b2b51e9ad97a98b HTTP/1.0" 202 Accepted 2026-03-25 17:56:43,719 - lava_callback - INFO - Starting async job submit for node 69c17ed42b2b51e9ad97a98b 2026-03-25 17:56:43,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:43,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed42b2b51e9ad97a98b HTTP/1.1" 200 None 2026-03-25 17:56:43,745 - lava_callback - DEBUG - Processing node 69c17ed42b2b51e9ad97a98b: baseline-arm64-clabbe 2026-03-25 17:56:43,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17ed42b2b51e9ad97a98b 2026-03-25 17:56:43,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:43,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed42b2b51e9ad97a98b HTTP/1.1" 200 None 2026-03-25 17:56:43,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:43,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:43,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:43,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ed42b2b51e9ad97a98b HTTP/1.1" 200 None 2026-03-25 17:56:43,815 - lava_callback - ERROR - Error processing callback for node 69c17ed42b2b51e9ad97a98b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 17:56:44,407 - lava_callback - INFO - Received callback for node 69c17ed52b2b51e9ad97a98f INFO: 172.21.0.1:52220 - "POST /node/69c17ed52b2b51e9ad97a98f HTTP/1.0" 202 Accepted 2026-03-25 17:56:44,414 - lava_callback - INFO - Starting async job submit for node 69c17ed52b2b51e9ad97a98f 2026-03-25 17:56:44,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:44,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed52b2b51e9ad97a98f HTTP/1.1" 200 None 2026-03-25 17:56:44,433 - lava_callback - DEBUG - Processing node 69c17ed52b2b51e9ad97a98f: baseline-arm64-clabbe 2026-03-25 17:56:44,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c17ed52b2b51e9ad97a98f 2026-03-25 17:56:44,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:44,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed52b2b51e9ad97a98f HTTP/1.1" 200 None 2026-03-25 17:56:44,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:44,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-25 17:56:44,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:56:44,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ed52b2b51e9ad97a98f HTTP/1.1" 200 None 2026-03-25 17:56:44,487 - lava_callback - ERROR - Error processing callback for node 69c17ed52b2b51e9ad97a98f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32890 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:59:27,643 - lava_callback - INFO - Received callback for node 69c4224c944faaf0e7f613a7 INFO: 172.21.0.1:32894 - "POST /node/69c4224c944faaf0e7f613a7 HTTP/1.0" 202 Accepted 2026-03-25 17:59:27,650 - lava_callback - INFO - Starting async job submit for node 69c4224c944faaf0e7f613a7 2026-03-25 17:59:27,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:59:27,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4224c944faaf0e7f613a7 HTTP/1.1" 200 None 2026-03-25 17:59:27,696 - lava_callback - DEBUG - Processing node 69c4224c944faaf0e7f613a7: baseline-arm64 2026-03-25 17:59:27,859 - lava_callback - WARNING - Failed to upload log 2026-03-25 17:59:27,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:59:28,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:59:28,127 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4224c944faaf0e7f613a7/lava-logs.yaml 2026-03-25 17:59:28,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 17:59:28,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 17:59:28,264 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c4224c944faaf0e7f613a7/lava_callback.json.gz 2026-03-25 17:59:28,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:59:28,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4224c944faaf0e7f613a7 HTTP/1.1" 200 None 2026-03-25 17:59:28,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:59:28,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 17:59:28,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:59:28,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4224c944faaf0e7f613a7 HTTP/1.1" 200 None 2026-03-25 17:59:28,445 - lava_callback - INFO - Completed processing callback for node 69c4224c944faaf0e7f613a7 INFO: 172.21.0.1:52020 - "GET / HTTP/1.0" 200 OK 2026-03-25 17:59:42,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 17:59:42,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:03:17,017 - lava_callback - INFO - Received callback for node 69c411b0944faaf0e7f60e5b INFO: 172.21.0.1:59624 - "POST /node/69c411b0944faaf0e7f60e5b HTTP/1.0" 202 Accepted 2026-03-25 18:03:17,024 - lava_callback - INFO - Starting async job submit for node 69c411b0944faaf0e7f60e5b 2026-03-25 18:03:17,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:03:17,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b0944faaf0e7f60e5b HTTP/1.1" 200 None 2026-03-25 18:03:17,061 - lava_callback - DEBUG - Processing node 69c411b0944faaf0e7f60e5b: baseline-arm64-broonie 2026-03-25 18:03:17,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:03:17,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:03:17,467 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411b0944faaf0e7f60e5b/log.txt.gz 2026-03-25 18:03:17,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:03:17,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:03:17,823 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411b0944faaf0e7f60e5b/lava-logs.yaml 2026-03-25 18:03:17,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:03:17,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:03:17,990 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411b0944faaf0e7f60e5b/lava_callback.json.gz 2026-03-25 18:03:18,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:03:18,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b0944faaf0e7f60e5b HTTP/1.1" 200 None 2026-03-25 18:03:18,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:03:18,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:03:18,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:03:18,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411b0944faaf0e7f60e5b HTTP/1.1" 200 None 2026-03-25 18:03:18,105 - lava_callback - INFO - Completed processing callback for node 69c411b0944faaf0e7f60e5b INFO: 172.21.0.1:33418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:03:42,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:03:42,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:04:35,744 - lava_callback - INFO - Received callback for node 69c42348944faaf0e7f613d8 INFO: 172.21.0.1:39862 - "POST /node/69c42348944faaf0e7f613d8 HTTP/1.0" 202 Accepted 2026-03-25 18:04:35,752 - lava_callback - INFO - Starting async job submit for node 69c42348944faaf0e7f613d8 2026-03-25 18:04:35,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:04:35,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42348944faaf0e7f613d8 HTTP/1.1" 200 None 2026-03-25 18:04:35,798 - lava_callback - DEBUG - Processing node 69c42348944faaf0e7f613d8: baseline-arm64 2026-03-25 18:04:35,997 - lava_callback - WARNING - Failed to upload log 2026-03-25 18:04:36,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:04:36,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:04:36,336 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c42348944faaf0e7f613d8/lava-logs.yaml 2026-03-25 18:04:36,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:04:36,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:04:36,498 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c42348944faaf0e7f613d8/lava_callback.json.gz 2026-03-25 18:04:36,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:39872 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:04:36,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42348944faaf0e7f613d8 HTTP/1.1" 200 None 2026-03-25 18:04:36,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:04:36,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:04:36,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:04:36,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42348944faaf0e7f613d8 HTTP/1.1" 200 None 2026-03-25 18:04:36,655 - lava_callback - INFO - Completed processing callback for node 69c42348944faaf0e7f613d8 2026-03-25 18:04:42,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:04:42,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:08:25,354 - lava_callback - INFO - Received callback for node 69c4242c944faaf0e7f613f5 INFO: 172.21.0.1:37888 - "POST /node/69c4242c944faaf0e7f613f5 HTTP/1.0" 202 Accepted 2026-03-25 18:08:25,360 - lava_callback - INFO - Starting async job submit for node 69c4242c944faaf0e7f613f5 2026-03-25 18:08:25,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:25,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4242c944faaf0e7f613f5 HTTP/1.1" 200 None 2026-03-25 18:08:25,394 - lava_callback - DEBUG - Processing node 69c4242c944faaf0e7f613f5: baseline-x86 2026-03-25 18:08:25,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:08:25,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:08:25,828 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c4242c944faaf0e7f613f5/log.txt.gz 2026-03-25 18:08:25,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:08:26,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:08:26,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c4242c944faaf0e7f613f5/lava-logs.yaml 2026-03-25 18:08:26,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:08:26,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:08:26,341 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c4242c944faaf0e7f613f5/lava_callback.json.gz 2026-03-25 18:08:26,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:26,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4242c944faaf0e7f613f5 HTTP/1.1" 200 None 2026-03-25 18:08:26,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:26,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40aef944faaf0e7f5e438 HTTP/1.1" 200 None 2026-03-25 18:08:26,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:26,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4242c944faaf0e7f613f5 HTTP/1.1" 200 None 2026-03-25 18:08:26,431 - lava_callback - INFO - Completed processing callback for node 69c4242c944faaf0e7f613f5 INFO: 172.21.0.1:37890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:08:42,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:42,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 18:08:44,165 - lava_callback - INFO - Received callback for node 69c410c9944faaf0e7f60c89 INFO: 172.21.0.1:56898 - "POST /node/69c410c9944faaf0e7f60c89 HTTP/1.0" 202 Accepted 2026-03-25 18:08:44,213 - lava_callback - INFO - Starting async job submit for node 69c410c9944faaf0e7f60c89 2026-03-25 18:08:44,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:44,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c9944faaf0e7f60c89 HTTP/1.1" 200 None 2026-03-25 18:08:44,253 - lava_callback - DEBUG - Processing node 69c410c9944faaf0e7f60c89: baseline-arm-pengutronix 2026-03-25 18:08:44,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:08:44,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:08:44,502 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c9944faaf0e7f60c89/log.txt.gz 2026-03-25 18:08:44,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:08:44,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:08:44,860 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c9944faaf0e7f60c89/lava-logs.yaml 2026-03-25 18:08:44,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:08:45,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:08:45,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c410c9944faaf0e7f60c89/lava_callback.json.gz DEBUG: Setup failed for 69c410c9944faaf0e7f60c89. Transitting job node result: incomplete -> fail 2026-03-25 18:08:45,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:45,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c9944faaf0e7f60c89 HTTP/1.1" 200 None 2026-03-25 18:08:45,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:45,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 18:08:45,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:08:45,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410c9944faaf0e7f60c89 HTTP/1.1" 200 None 2026-03-25 18:08:45,278 - lava_callback - INFO - Completed processing callback for node 69c410c9944faaf0e7f60c89 INFO: 172.21.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:09:12,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:09:12,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53658 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:15:14,126 - lava_callback - INFO - Received callback for node 69c42180944faaf0e7f61369 INFO: 172.21.0.1:38972 - "POST /node/69c42180944faaf0e7f61369 HTTP/1.0" 202 Accepted 2026-03-25 18:15:14,135 - lava_callback - INFO - Starting async job submit for node 69c42180944faaf0e7f61369 2026-03-25 18:15:14,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:15:14,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42180944faaf0e7f61369 HTTP/1.1" 200 None 2026-03-25 18:15:14,196 - lava_callback - DEBUG - Processing node 69c42180944faaf0e7f61369: baseline-nfs-arm64 INFO: 172.21.0.1:38982 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 18:15:15,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:15:15,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:15:15,525 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42180944faaf0e7f61369/log.txt.gz 2026-03-25 18:15:16,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:15:16,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:15:16,412 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42180944faaf0e7f61369/lava-logs.yaml 2026-03-25 18:15:16,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:38994 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:15:16,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:15:16,636 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42180944faaf0e7f61369/lava_callback.json.gz DEBUG: Setup failed for 69c42180944faaf0e7f61369. Transitting job node result: incomplete -> fail 2026-03-25 18:15:16,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:15:16,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42180944faaf0e7f61369 HTTP/1.1" 200 None 2026-03-25 18:15:16,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:15:16,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:15:16,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:15:16,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42180944faaf0e7f61369 HTTP/1.1" 200 None 2026-03-25 18:15:16,909 - lava_callback - INFO - Completed processing callback for node 69c42180944faaf0e7f61369 INFO: 172.21.0.1:47254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:15:42,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:15:42,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55588 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:16:19,468 - lava_callback - INFO - Received callback for node 69c422ff944faaf0e7f613d2 INFO: 172.21.0.1:55602 - "POST /node/69c422ff944faaf0e7f613d2 HTTP/1.0" 202 Accepted 2026-03-25 18:16:19,476 - lava_callback - INFO - Starting async job submit for node 69c422ff944faaf0e7f613d2 2026-03-25 18:16:19,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:16:19,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c422ff944faaf0e7f613d2 HTTP/1.1" 200 None 2026-03-25 18:16:19,547 - lava_callback - DEBUG - Processing node 69c422ff944faaf0e7f613d2: baseline-nfs-arm64 2026-03-25 18:16:20,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:16:21,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:16:21,670 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c422ff944faaf0e7f613d2/log.txt.gz 2026-03-25 18:16:22,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:16:22,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:16:22,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c422ff944faaf0e7f613d2/lava-logs.yaml 2026-03-25 18:16:22,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:16:22,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:16:22,609 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c422ff944faaf0e7f613d2/lava_callback.json.gz DEBUG: Setup failed for 69c422ff944faaf0e7f613d2. Transitting job node result: incomplete -> fail 2026-03-25 18:16:22,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:16:22,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c422ff944faaf0e7f613d2 HTTP/1.1" 200 None 2026-03-25 18:16:22,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:16:22,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:16:22,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:16:22,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c422ff944faaf0e7f613d2 HTTP/1.1" 200 None 2026-03-25 18:16:22,873 - lava_callback - INFO - Completed processing callback for node 69c422ff944faaf0e7f613d2 INFO: 172.21.0.1:50168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54424 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:16:42,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:16:42,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:17:40,132 - lava_callback - INFO - Received callback for node 69c42585944faaf0e7f61456 INFO: 172.21.0.1:53266 - "POST /node/69c42585944faaf0e7f61456 HTTP/1.0" 202 Accepted 2026-03-25 18:17:40,140 - lava_callback - INFO - Starting async job submit for node 69c42585944faaf0e7f61456 2026-03-25 18:17:40,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:40,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42585944faaf0e7f61456 HTTP/1.1" 200 None 2026-03-25 18:17:40,191 - lava_callback - DEBUG - Processing node 69c42585944faaf0e7f61456: baseline-arm64 2026-03-25 18:17:40,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:17:40,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:17:40,721 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c42585944faaf0e7f61456/log.txt.gz 2026-03-25 18:17:40,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:17:41,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:17:41,163 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c42585944faaf0e7f61456/lava-logs.yaml 2026-03-25 18:17:41,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:17:41,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:17:41,347 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c42585944faaf0e7f61456/lava_callback.json.gz DEBUG: Setup failed for 69c42585944faaf0e7f61456. Transitting job node result: incomplete -> fail 2026-03-25 18:17:41,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:41,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42585944faaf0e7f61456 HTTP/1.1" 200 None 2026-03-25 18:17:41,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:41,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:17:41,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:41,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42585944faaf0e7f61456 HTTP/1.1" 200 None 2026-03-25 18:17:41,559 - lava_callback - INFO - Completed processing callback for node 69c42585944faaf0e7f61456 2026-03-25 18:17:42,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:42,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 18:17:43,890 - lava_callback - INFO - Received callback for node 69c4229e944faaf0e7f613bb INFO: 172.21.0.1:53278 - "POST /node/69c4229e944faaf0e7f613bb HTTP/1.0" 202 Accepted 2026-03-25 18:17:43,897 - lava_callback - INFO - Starting async job submit for node 69c4229e944faaf0e7f613bb 2026-03-25 18:17:43,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:43,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4229e944faaf0e7f613bb HTTP/1.1" 200 None 2026-03-25 18:17:43,992 - lava_callback - DEBUG - Processing node 69c4229e944faaf0e7f613bb: ltp-smoke 2026-03-25 18:17:44,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:17:44,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:17:44,605 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c4229e944faaf0e7f613bb/log.txt.gz 2026-03-25 18:17:44,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:17:45,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:17:45,101 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c4229e944faaf0e7f613bb/lava-logs.yaml 2026-03-25 18:17:45,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:17:45,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:17:45,271 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c4229e944faaf0e7f613bb/lava_callback.json.gz 2026-03-25 18:17:45,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:45,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4229e944faaf0e7f613bb HTTP/1.1" 200 None 2026-03-25 18:17:45,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:45,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ace944faaf0e7f5e40e HTTP/1.1" 200 None 2026-03-25 18:17:45,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:17:45,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4229e944faaf0e7f613bb HTTP/1.1" 200 None 2026-03-25 18:17:45,613 - lava_callback - INFO - Completed processing callback for node 69c4229e944faaf0e7f613bb INFO: 172.21.0.1:53292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36656 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:18:12,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:12,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48828 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:18:18,076 - lava_callback - INFO - Received callback for node 69c422ca944faaf0e7f613c8 INFO: 172.21.0.1:48834 - "POST /node/69c422ca944faaf0e7f613c8 HTTP/1.0" 202 Accepted 2026-03-25 18:18:18,083 - lava_callback - INFO - Starting async job submit for node 69c422ca944faaf0e7f613c8 2026-03-25 18:18:18,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:18,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c422ca944faaf0e7f613c8 HTTP/1.1" 200 None 2026-03-25 18:18:18,154 - lava_callback - DEBUG - Processing node 69c422ca944faaf0e7f613c8: baseline-arm 2026-03-25 18:18:18,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:18:18,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:18:18,980 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c422ca944faaf0e7f613c8/log.txt.gz 2026-03-25 18:18:19,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:18:19,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:18:19,567 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c422ca944faaf0e7f613c8/lava-logs.yaml 2026-03-25 18:18:19,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:18:19,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:18:19,753 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c422ca944faaf0e7f613c8/lava_callback.json.gz DEBUG: Setup failed for 69c422ca944faaf0e7f613c8. Transitting job node result: incomplete -> fail 2026-03-25 18:18:19,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:19,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c422ca944faaf0e7f613c8 HTTP/1.1" 200 None 2026-03-25 18:18:19,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:19,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 18:18:19,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:19,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c422ca944faaf0e7f613c8 HTTP/1.1" 200 None 2026-03-25 18:18:20,065 - lava_callback - INFO - Completed processing callback for node 69c422ca944faaf0e7f613c8 2026-03-25 18:18:22,422 - lava_callback - INFO - Received callback for node 69c423a0944faaf0e7f613e7 INFO: 172.21.0.1:60426 - "POST /node/69c423a0944faaf0e7f613e7 HTTP/1.0" 202 Accepted 2026-03-25 18:18:22,429 - lava_callback - INFO - Starting async job submit for node 69c423a0944faaf0e7f613e7 2026-03-25 18:18:22,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:22,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c423a0944faaf0e7f613e7 HTTP/1.1" 200 None 2026-03-25 18:18:22,498 - lava_callback - DEBUG - Processing node 69c423a0944faaf0e7f613e7: baseline-arm64 2026-03-25 18:18:23,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:18:23,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:18:23,370 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c423a0944faaf0e7f613e7/log.txt.gz 2026-03-25 18:18:23,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:18:24,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:18:24,011 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c423a0944faaf0e7f613e7/lava-logs.yaml 2026-03-25 18:18:24,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:18:24,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:18:24,172 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c423a0944faaf0e7f613e7/lava_callback.json.gz DEBUG: Setup failed for 69c423a0944faaf0e7f613e7. Transitting job node result: incomplete -> fail 2026-03-25 18:18:24,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:24,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c423a0944faaf0e7f613e7 HTTP/1.1" 200 None 2026-03-25 18:18:24,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:24,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:18:24,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:24,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c423a0944faaf0e7f613e7 HTTP/1.1" 200 None 2026-03-25 18:18:24,434 - lava_callback - INFO - Completed processing callback for node 69c423a0944faaf0e7f613e7 INFO: 172.21.0.1:60436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59090 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:18:42,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:18:42,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41726 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:46:30,408 - lava_callback - INFO - Received callback for node 69c18a842b2b51e9ad97add9 INFO: 172.21.0.1:54134 - "POST /node/69c18a842b2b51e9ad97add9 HTTP/1.0" 202 Accepted 2026-03-25 18:46:30,413 - lava_callback - INFO - Starting async job submit for node 69c18a842b2b51e9ad97add9 2026-03-25 18:46:30,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:46:30,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18a842b2b51e9ad97add9 HTTP/1.1" 200 None 2026-03-25 18:46:30,429 - lava_callback - DEBUG - Processing node 69c18a842b2b51e9ad97add9: baseline-arm-baylibre 2026-03-25 18:46:30,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18a842b2b51e9ad97add9 2026-03-25 18:46:30,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:46:30,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18a842b2b51e9ad97add9 HTTP/1.1" 200 None 2026-03-25 18:46:30,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:46:30,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:46:30,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:46:30,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18a842b2b51e9ad97add9 HTTP/1.1" 200 None 2026-03-25 18:46:30,493 - lava_callback - ERROR - Error processing callback for node 69c18a842b2b51e9ad97add9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:47:50,362 - lava_callback - INFO - Received callback for node 69c18ac02b2b51e9ad97ade8 INFO: 172.21.0.1:33722 - "POST /node/69c18ac02b2b51e9ad97ade8 HTTP/1.0" 202 Accepted 2026-03-25 18:47:50,368 - lava_callback - INFO - Starting async job submit for node 69c18ac02b2b51e9ad97ade8 2026-03-25 18:47:50,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:47:50,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18ac02b2b51e9ad97ade8 HTTP/1.1" 200 None 2026-03-25 18:47:50,384 - lava_callback - DEBUG - Processing node 69c18ac02b2b51e9ad97ade8: baseline-arm-baylibre 2026-03-25 18:47:50,384 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18ac02b2b51e9ad97ade8 2026-03-25 18:47:50,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:47:50,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18ac02b2b51e9ad97ade8 HTTP/1.1" 200 None 2026-03-25 18:47:50,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:47:50,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:47:50,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:47:50,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18ac02b2b51e9ad97ade8 HTTP/1.1" 200 None 2026-03-25 18:47:50,444 - lava_callback - ERROR - Error processing callback for node 69c18ac02b2b51e9ad97ade8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56228 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:49:50,296 - lava_callback - INFO - Received callback for node 69c18b392b2b51e9ad97adf9 INFO: 172.21.0.1:46480 - "POST /node/69c18b392b2b51e9ad97adf9 HTTP/1.0" 202 Accepted 2026-03-25 18:49:50,301 - lava_callback - INFO - Starting async job submit for node 69c18b392b2b51e9ad97adf9 2026-03-25 18:49:50,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:49:50,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18b392b2b51e9ad97adf9 HTTP/1.1" 200 None 2026-03-25 18:49:50,318 - lava_callback - DEBUG - Processing node 69c18b392b2b51e9ad97adf9: baseline-arm-baylibre 2026-03-25 18:49:50,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18b392b2b51e9ad97adf9 2026-03-25 18:49:50,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:49:50,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18b392b2b51e9ad97adf9 HTTP/1.1" 200 None 2026-03-25 18:49:50,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:49:50,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:49:50,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:49:50,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18b392b2b51e9ad97adf9 HTTP/1.1" 200 None 2026-03-25 18:49:50,389 - lava_callback - ERROR - Error processing callback for node 69c18b392b2b51e9ad97adf9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56544 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:50:35,850 - lava_callback - INFO - Received callback for node 69c42b0c944faaf0e7f61533 INFO: 172.21.0.1:58522 - "POST /node/69c42b0c944faaf0e7f61533 HTTP/1.0" 202 Accepted 2026-03-25 18:50:35,858 - lava_callback - INFO - Starting async job submit for node 69c42b0c944faaf0e7f61533 2026-03-25 18:50:35,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:35,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42b0c944faaf0e7f61533 HTTP/1.1" 200 None 2026-03-25 18:50:35,940 - lava_callback - DEBUG - Processing node 69c42b0c944faaf0e7f61533: baseline-nfs-arm64 INFO: 172.21.0.1:58528 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:50:36,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:50:36,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:50:36,881 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42b0c944faaf0e7f61533/log.txt.gz 2026-03-25 18:50:37,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:50:37,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:50:37,551 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42b0c944faaf0e7f61533/lava-logs.yaml 2026-03-25 18:50:37,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:50:37,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:50:37,735 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42b0c944faaf0e7f61533/lava_callback.json.gz DEBUG: Setup failed for 69c42b0c944faaf0e7f61533. Transitting job node result: incomplete -> fail 2026-03-25 18:50:37,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:37,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42b0c944faaf0e7f61533 HTTP/1.1" 200 None 2026-03-25 18:50:37,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:37,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:50:37,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:37,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42b0c944faaf0e7f61533 HTTP/1.1" 200 None 2026-03-25 18:50:37,982 - lava_callback - INFO - Completed processing callback for node 69c42b0c944faaf0e7f61533 2026-03-25 18:50:42,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:42,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44108 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:50:50,302 - lava_callback - INFO - Received callback for node 69c18b762b2b51e9ad97ae07 INFO: 172.21.0.1:34404 - "POST /node/69c18b762b2b51e9ad97ae07 HTTP/1.0" 202 Accepted 2026-03-25 18:50:50,308 - lava_callback - INFO - Starting async job submit for node 69c18b762b2b51e9ad97ae07 2026-03-25 18:50:50,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:50,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18b762b2b51e9ad97ae07 HTTP/1.1" 200 None 2026-03-25 18:50:50,332 - lava_callback - DEBUG - Processing node 69c18b762b2b51e9ad97ae07: baseline-arm-baylibre 2026-03-25 18:50:50,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18b762b2b51e9ad97ae07 2026-03-25 18:50:50,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:50,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18b762b2b51e9ad97ae07 HTTP/1.1" 200 None 2026-03-25 18:50:50,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:50,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:50:50,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:50:50,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18b762b2b51e9ad97ae07 HTTP/1.1" 200 None 2026-03-25 18:50:50,390 - lava_callback - ERROR - Error processing callback for node 69c18b762b2b51e9ad97ae07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36458 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:51:50,397 - lava_callback - INFO - Received callback for node 69c18bb32b2b51e9ad97ae16 INFO: 172.21.0.1:52258 - "POST /node/69c18bb32b2b51e9ad97ae16 HTTP/1.0" 202 Accepted 2026-03-25 18:51:50,403 - lava_callback - INFO - Starting async job submit for node 69c18bb32b2b51e9ad97ae16 2026-03-25 18:51:50,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:51:50,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18bb32b2b51e9ad97ae16 HTTP/1.1" 200 None 2026-03-25 18:51:50,439 - lava_callback - DEBUG - Processing node 69c18bb32b2b51e9ad97ae16: baseline-arm-baylibre 2026-03-25 18:51:50,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18bb32b2b51e9ad97ae16 2026-03-25 18:51:50,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:51:50,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18bb32b2b51e9ad97ae16 HTTP/1.1" 200 None 2026-03-25 18:51:50,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:51:50,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:51:50,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:51:50,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18bb32b2b51e9ad97ae16 HTTP/1.1" 200 None 2026-03-25 18:51:50,541 - lava_callback - ERROR - Error processing callback for node 69c18bb32b2b51e9ad97ae16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59036 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:52:07,404 - lava_callback - INFO - Received callback for node 69c42b85944faaf0e7f61551 INFO: 172.21.0.1:59052 - "POST /node/69c42b85944faaf0e7f61551 HTTP/1.0" 202 Accepted 2026-03-25 18:52:07,411 - lava_callback - INFO - Starting async job submit for node 69c42b85944faaf0e7f61551 2026-03-25 18:52:07,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:52:07,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42b85944faaf0e7f61551 HTTP/1.1" 200 None 2026-03-25 18:52:07,497 - lava_callback - DEBUG - Processing node 69c42b85944faaf0e7f61551: baseline-arm64 2026-03-25 18:52:08,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:52:08,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:52:08,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c42b85944faaf0e7f61551/log.txt.gz 2026-03-25 18:52:08,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:52:09,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:52:09,077 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c42b85944faaf0e7f61551/lava-logs.yaml 2026-03-25 18:52:09,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:52:09,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:52:09,298 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c42b85944faaf0e7f61551/lava_callback.json.gz DEBUG: Setup failed for 69c42b85944faaf0e7f61551. Transitting job node result: incomplete -> fail 2026-03-25 18:52:09,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:52:09,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42b85944faaf0e7f61551 HTTP/1.1" 200 None 2026-03-25 18:52:09,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:52:09,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:52:09,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:52:09,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42b85944faaf0e7f61551 HTTP/1.1" 200 None 2026-03-25 18:52:09,579 - lava_callback - INFO - Completed processing callback for node 69c42b85944faaf0e7f61551 2026-03-25 18:52:12,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:52:12,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:53:05,943 - lava_callback - INFO - Received callback for node 69c42a90944faaf0e7f6151a INFO: 172.21.0.1:47266 - "POST /node/69c42a90944faaf0e7f6151a HTTP/1.0" 202 Accepted 2026-03-25 18:53:05,993 - lava_callback - INFO - Starting async job submit for node 69c42a90944faaf0e7f6151a 2026-03-25 18:53:06,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:53:06,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42a90944faaf0e7f6151a HTTP/1.1" 200 None 2026-03-25 18:53:06,033 - lava_callback - DEBUG - Processing node 69c42a90944faaf0e7f6151a: baseline-arm-pengutronix 2026-03-25 18:53:06,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:53:06,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:53:06,312 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c42a90944faaf0e7f6151a/log.txt.gz 2026-03-25 18:53:06,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:47280 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:53:06,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:53:06,566 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c42a90944faaf0e7f6151a/lava-logs.yaml 2026-03-25 18:53:06,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:53:06,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:53:06,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c42a90944faaf0e7f6151a/lava_callback.json.gz DEBUG: Setup failed for 69c42a90944faaf0e7f6151a. Transitting job node result: incomplete -> fail 2026-03-25 18:53:06,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:53:06,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42a90944faaf0e7f6151a HTTP/1.1" 200 None 2026-03-25 18:53:06,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:53:06,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 18:53:06,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:53:06,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42a90944faaf0e7f6151a HTTP/1.1" 200 None 2026-03-25 18:53:07,032 - lava_callback - INFO - Completed processing callback for node 69c42a90944faaf0e7f6151a 2026-03-25 18:53:12,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:53:12,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:54:31,151 - lava_callback - INFO - Received callback for node 69c42ab6944faaf0e7f61527 INFO: 172.21.0.1:53610 - "POST /node/69c42ab6944faaf0e7f61527 HTTP/1.0" 202 Accepted 2026-03-25 18:54:31,159 - lava_callback - INFO - Starting async job submit for node 69c42ab6944faaf0e7f61527 2026-03-25 18:54:31,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:31,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42ab6944faaf0e7f61527 HTTP/1.1" 200 None 2026-03-25 18:54:31,219 - lava_callback - DEBUG - Processing node 69c42ab6944faaf0e7f61527: baseline-nfs-arm64 2026-03-25 18:54:32,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:54:32,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:54:32,541 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42ab6944faaf0e7f61527/log.txt.gz 2026-03-25 18:54:33,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:54:33,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:54:33,419 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42ab6944faaf0e7f61527/lava-logs.yaml 2026-03-25 18:54:33,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:54:33,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:54:33,653 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42ab6944faaf0e7f61527/lava_callback.json.gz DEBUG: Setup failed for 69c42ab6944faaf0e7f61527. Transitting job node result: incomplete -> fail 2026-03-25 18:54:33,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:33,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42ab6944faaf0e7f61527 HTTP/1.1" 200 None 2026-03-25 18:54:33,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:33,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 18:54:33,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:33,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42ab6944faaf0e7f61527 HTTP/1.1" 200 None 2026-03-25 18:54:33,919 - lava_callback - INFO - Completed processing callback for node 69c42ab6944faaf0e7f61527 INFO: 172.21.0.1:53614 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:54:42,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:42,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39026 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:54:48,262 - lava_callback - INFO - Received callback for node 69c42b54944faaf0e7f6153f INFO: 172.21.0.1:39040 - "POST /node/69c42b54944faaf0e7f6153f HTTP/1.0" 202 Accepted 2026-03-25 18:54:48,269 - lava_callback - INFO - Starting async job submit for node 69c42b54944faaf0e7f6153f 2026-03-25 18:54:48,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:48,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42b54944faaf0e7f6153f HTTP/1.1" 200 None 2026-03-25 18:54:48,353 - lava_callback - DEBUG - Processing node 69c42b54944faaf0e7f6153f: ltp-smoke 2026-03-25 18:54:48,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:54:48,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:54:48,980 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c42b54944faaf0e7f6153f/log.txt.gz 2026-03-25 18:54:49,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:54:49,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:54:49,501 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c42b54944faaf0e7f6153f/lava-logs.yaml 2026-03-25 18:54:49,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:54:49,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:54:49,691 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c42b54944faaf0e7f6153f/lava_callback.json.gz 2026-03-25 18:54:49,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:49,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42b54944faaf0e7f6153f HTTP/1.1" 200 None 2026-03-25 18:54:49,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:49,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ace944faaf0e7f5e40e HTTP/1.1" 200 None 2026-03-25 18:54:49,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:54:49,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42b54944faaf0e7f6153f HTTP/1.1" 200 None 2026-03-25 18:54:49,957 - lava_callback - INFO - Completed processing callback for node 69c42b54944faaf0e7f6153f INFO: 172.21.0.1:46092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55700 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:55:08,179 - lava_callback - INFO - Received callback for node 69c42b56944faaf0e7f61542 INFO: 172.21.0.1:55716 - "POST /node/69c42b56944faaf0e7f61542 HTTP/1.0" 202 Accepted 2026-03-25 18:55:08,186 - lava_callback - INFO - Starting async job submit for node 69c42b56944faaf0e7f61542 2026-03-25 18:55:08,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:55:08,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42b56944faaf0e7f61542 HTTP/1.1" 200 None 2026-03-25 18:55:08,254 - lava_callback - DEBUG - Processing node 69c42b56944faaf0e7f61542: baseline-arm 2026-03-25 18:55:08,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:55:08,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:55:08,970 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c42b56944faaf0e7f61542/log.txt.gz 2026-03-25 18:55:09,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:55:09,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:55:09,552 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c42b56944faaf0e7f61542/lava-logs.yaml 2026-03-25 18:55:09,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 18:55:09,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 18:55:09,739 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c42b56944faaf0e7f61542/lava_callback.json.gz DEBUG: Setup failed for 69c42b56944faaf0e7f61542. Transitting job node result: incomplete -> fail 2026-03-25 18:55:09,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:55:09,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42b56944faaf0e7f61542 HTTP/1.1" 200 None 2026-03-25 18:55:09,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:55:09,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 18:55:09,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:55:09,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42b56944faaf0e7f61542 HTTP/1.1" 200 None 2026-03-25 18:55:10,069 - lava_callback - INFO - Completed processing callback for node 69c42b56944faaf0e7f61542 2026-03-25 18:55:12,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:55:12,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:56:03,407 - lava_callback - INFO - Received callback for node 69c18cb12b2b51e9ad97ae77 INFO: 172.21.0.1:52908 - "POST /node/69c18cb12b2b51e9ad97ae77 HTTP/1.0" 202 Accepted 2026-03-25 18:56:03,413 - lava_callback - INFO - Starting async job submit for node 69c18cb12b2b51e9ad97ae77 2026-03-25 18:56:03,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:56:03,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18cb12b2b51e9ad97ae77 HTTP/1.1" 200 None 2026-03-25 18:56:03,432 - lava_callback - DEBUG - Processing node 69c18cb12b2b51e9ad97ae77: baseline-arm-clabbe 2026-03-25 18:56:03,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18cb12b2b51e9ad97ae77 2026-03-25 18:56:03,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:56:03,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18cb12b2b51e9ad97ae77 HTTP/1.1" 200 None 2026-03-25 18:56:03,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:56:03,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:56:03,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:56:03,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18cb12b2b51e9ad97ae77 HTTP/1.1" 200 None 2026-03-25 18:56:03,483 - lava_callback - ERROR - Error processing callback for node 69c18cb12b2b51e9ad97ae77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60134 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:56:43,403 - lava_callback - INFO - Received callback for node 69c18cda2b2b51e9ad97ae7e INFO: 172.21.0.1:46594 - "POST /node/69c18cda2b2b51e9ad97ae7e HTTP/1.0" 202 Accepted 2026-03-25 18:56:43,408 - lava_callback - INFO - Starting async job submit for node 69c18cda2b2b51e9ad97ae7e 2026-03-25 18:56:43,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:56:43,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18cda2b2b51e9ad97ae7e HTTP/1.1" 200 None 2026-03-25 18:56:43,425 - lava_callback - DEBUG - Processing node 69c18cda2b2b51e9ad97ae7e: baseline-arm-clabbe 2026-03-25 18:56:43,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18cda2b2b51e9ad97ae7e 2026-03-25 18:56:43,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:56:43,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18cda2b2b51e9ad97ae7e HTTP/1.1" 200 None 2026-03-25 18:56:43,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:56:43,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:56:43,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:56:43,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18cda2b2b51e9ad97ae7e HTTP/1.1" 200 None 2026-03-25 18:56:43,482 - lava_callback - ERROR - Error processing callback for node 69c18cda2b2b51e9ad97ae7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50938 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:58:43,521 - lava_callback - INFO - Received callback for node 69c18d5a2b2b51e9ad97aeb0 INFO: 172.21.0.1:33284 - "POST /node/69c18d5a2b2b51e9ad97aeb0 HTTP/1.0" 202 Accepted 2026-03-25 18:58:43,526 - lava_callback - INFO - Starting async job submit for node 69c18d5a2b2b51e9ad97aeb0 2026-03-25 18:58:43,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:58:43,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18d5a2b2b51e9ad97aeb0 HTTP/1.1" 200 None 2026-03-25 18:58:43,542 - lava_callback - DEBUG - Processing node 69c18d5a2b2b51e9ad97aeb0: baseline-arm-clabbe 2026-03-25 18:58:43,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18d5a2b2b51e9ad97aeb0 2026-03-25 18:58:43,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:58:43,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18d5a2b2b51e9ad97aeb0 HTTP/1.1" 200 None 2026-03-25 18:58:43,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:58:43,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:58:43,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:58:43,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18d5a2b2b51e9ad97aeb0 HTTP/1.1" 200 None 2026-03-25 18:58:43,623 - lava_callback - ERROR - Error processing callback for node 69c18d5a2b2b51e9ad97aeb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42972 - "GET / HTTP/1.0" 200 OK 2026-03-25 18:59:23,472 - lava_callback - INFO - Received callback for node 69c18d832b2b51e9ad97aec4 INFO: 172.21.0.1:35512 - "POST /node/69c18d832b2b51e9ad97aec4 HTTP/1.0" 202 Accepted 2026-03-25 18:59:23,477 - lava_callback - INFO - Starting async job submit for node 69c18d832b2b51e9ad97aec4 2026-03-25 18:59:23,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:59:23,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18d832b2b51e9ad97aec4 HTTP/1.1" 200 None 2026-03-25 18:59:23,494 - lava_callback - DEBUG - Processing node 69c18d832b2b51e9ad97aec4: baseline-arm-clabbe 2026-03-25 18:59:23,494 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18d832b2b51e9ad97aec4 2026-03-25 18:59:23,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:59:23,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18d832b2b51e9ad97aec4 HTTP/1.1" 200 None 2026-03-25 18:59:23,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:59:23,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 18:59:23,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 18:59:23,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18d832b2b51e9ad97aec4 HTTP/1.1" 200 None 2026-03-25 18:59:23,590 - lava_callback - ERROR - Error processing callback for node 69c18d832b2b51e9ad97aec4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:00:03,688 - lava_callback - INFO - Received callback for node 69c18dad2b2b51e9ad97aecf INFO: 172.21.0.1:33676 - "POST /node/69c18dad2b2b51e9ad97aecf HTTP/1.0" 202 Accepted 2026-03-25 19:00:03,694 - lava_callback - INFO - Starting async job submit for node 69c18dad2b2b51e9ad97aecf 2026-03-25 19:00:03,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:00:03,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18dad2b2b51e9ad97aecf HTTP/1.1" 200 None 2026-03-25 19:00:03,736 - lava_callback - DEBUG - Processing node 69c18dad2b2b51e9ad97aecf: baseline-arm-clabbe 2026-03-25 19:00:03,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c18dad2b2b51e9ad97aecf 2026-03-25 19:00:03,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:00:03,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18dad2b2b51e9ad97aecf HTTP/1.1" 200 None 2026-03-25 19:00:03,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:00:03,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c086a5ce0c9bc43bccb62b HTTP/1.1" 200 None 2026-03-25 19:00:03,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:00:03,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18dad2b2b51e9ad97aecf HTTP/1.1" 200 None 2026-03-25 19:00:03,811 - lava_callback - ERROR - Error processing callback for node 69c18dad2b2b51e9ad97aecf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58314 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:12:26,692 - lava_callback - INFO - Received callback for node 69c42f20944faaf0e7f61626 INFO: 172.21.0.1:58330 - "POST /node/69c42f20944faaf0e7f61626 HTTP/1.0" 202 Accepted 2026-03-25 19:12:26,745 - lava_callback - INFO - Starting async job submit for node 69c42f20944faaf0e7f61626 2026-03-25 19:12:26,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:12:26,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42f20944faaf0e7f61626 HTTP/1.1" 200 None 2026-03-25 19:12:26,814 - lava_callback - DEBUG - Processing node 69c42f20944faaf0e7f61626: baseline-arm-pengutronix 2026-03-25 19:12:26,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:12:27,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:12:27,142 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c42f20944faaf0e7f61626/log.txt.gz 2026-03-25 19:12:27,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:12:27,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:12:27,407 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c42f20944faaf0e7f61626/lava-logs.yaml 2026-03-25 19:12:27,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:12:27,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:12:27,567 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c42f20944faaf0e7f61626/lava_callback.json.gz DEBUG: Setup failed for 69c42f20944faaf0e7f61626. Transitting job node result: incomplete -> fail 2026-03-25 19:12:27,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:12:27,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42f20944faaf0e7f61626 HTTP/1.1" 200 None 2026-03-25 19:12:27,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:12:27,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:12:27,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:12:27,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42f20944faaf0e7f61626 HTTP/1.1" 200 None 2026-03-25 19:12:27,797 - lava_callback - INFO - Completed processing callback for node 69c42f20944faaf0e7f61626 INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:12:42,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:12:42,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:14:36,752 - lava_callback - INFO - Received callback for node 69c42f72944faaf0e7f61637 INFO: 172.21.0.1:58570 - "POST /node/69c42f72944faaf0e7f61637 HTTP/1.0" 202 Accepted 2026-03-25 19:14:36,760 - lava_callback - INFO - Starting async job submit for node 69c42f72944faaf0e7f61637 2026-03-25 19:14:36,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:14:36,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42f72944faaf0e7f61637 HTTP/1.1" 200 None 2026-03-25 19:14:36,818 - lava_callback - DEBUG - Processing node 69c42f72944faaf0e7f61637: baseline-nfs-arm64 2026-03-25 19:14:37,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:14:38,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:14:38,081 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42f72944faaf0e7f61637/log.txt.gz 2026-03-25 19:14:38,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:14:38,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:14:39,001 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42f72944faaf0e7f61637/lava-logs.yaml 2026-03-25 19:14:39,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:14:39,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:14:39,221 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c42f72944faaf0e7f61637/lava_callback.json.gz DEBUG: Setup failed for 69c42f72944faaf0e7f61637. Transitting job node result: incomplete -> fail 2026-03-25 19:14:39,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:14:39,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42f72944faaf0e7f61637 HTTP/1.1" 200 None 2026-03-25 19:14:39,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:14:39,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 19:14:39,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:14:39,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42f72944faaf0e7f61637 HTTP/1.1" 200 None 2026-03-25 19:14:39,457 - lava_callback - INFO - Completed processing callback for node 69c42f72944faaf0e7f61637 2026-03-25 19:14:42,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:14:42,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59070 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:17:51,904 - lava_callback - INFO - Received callback for node 69c191de2b2b51e9ad97af01 INFO: 172.21.0.1:51288 - "POST /node/69c191de2b2b51e9ad97af01 HTTP/1.0" 202 Accepted 2026-03-25 19:17:51,909 - lava_callback - INFO - Starting async job submit for node 69c191de2b2b51e9ad97af01 2026-03-25 19:17:51,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:17:51,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c191de2b2b51e9ad97af01 HTTP/1.1" 200 None 2026-03-25 19:17:51,929 - lava_callback - DEBUG - Processing node 69c191de2b2b51e9ad97af01: baseline-arm64-baylibre 2026-03-25 19:17:51,929 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c191de2b2b51e9ad97af01 2026-03-25 19:17:51,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:17:51,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c191de2b2b51e9ad97af01 HTTP/1.1" 200 None 2026-03-25 19:17:51,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:17:51,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:17:51,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:17:51,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c191de2b2b51e9ad97af01 HTTP/1.1" 200 None 2026-03-25 19:17:51,980 - lava_callback - ERROR - Error processing callback for node 69c191de2b2b51e9ad97af01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:19:51,955 - lava_callback - INFO - Received callback for node 69c192442b2b51e9ad97af17 INFO: 172.21.0.1:38562 - "POST /node/69c192442b2b51e9ad97af17 HTTP/1.0" 202 Accepted 2026-03-25 19:19:51,960 - lava_callback - INFO - Starting async job submit for node 69c192442b2b51e9ad97af17 2026-03-25 19:19:51,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:19:51,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c192442b2b51e9ad97af17 HTTP/1.1" 200 None 2026-03-25 19:19:51,987 - lava_callback - DEBUG - Processing node 69c192442b2b51e9ad97af17: baseline-arm64-baylibre 2026-03-25 19:19:51,987 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c192442b2b51e9ad97af17 2026-03-25 19:19:51,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:19:52,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c192442b2b51e9ad97af17 HTTP/1.1" 200 None 2026-03-25 19:19:52,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:19:52,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:19:52,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:19:52,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c192442b2b51e9ad97af17 HTTP/1.1" 200 None 2026-03-25 19:19:52,039 - lava_callback - ERROR - Error processing callback for node 69c192442b2b51e9ad97af17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46750 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:21:11,954 - lava_callback - INFO - Received callback for node 69c192992b2b51e9ad97af2f INFO: 172.21.0.1:44680 - "POST /node/69c192992b2b51e9ad97af2f HTTP/1.0" 202 Accepted 2026-03-25 19:21:11,960 - lava_callback - INFO - Starting async job submit for node 69c192992b2b51e9ad97af2f 2026-03-25 19:21:11,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:21:11,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c192992b2b51e9ad97af2f HTTP/1.1" 200 None 2026-03-25 19:21:11,978 - lava_callback - DEBUG - Processing node 69c192992b2b51e9ad97af2f: baseline-arm64-baylibre 2026-03-25 19:21:11,978 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c192992b2b51e9ad97af2f 2026-03-25 19:21:11,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:21:11,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c192992b2b51e9ad97af2f HTTP/1.1" 200 None 2026-03-25 19:21:11,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:21:12,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:21:12,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:21:12,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c192992b2b51e9ad97af2f HTTP/1.1" 200 None 2026-03-25 19:21:12,041 - lava_callback - ERROR - Error processing callback for node 69c192992b2b51e9ad97af2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55622 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:22:44,645 - lava_callback - INFO - Received callback for node 69c192fc2b2b51e9ad97af46 INFO: 172.21.0.1:57570 - "POST /node/69c192fc2b2b51e9ad97af46 HTTP/1.0" 202 Accepted 2026-03-25 19:22:44,651 - lava_callback - INFO - Starting async job submit for node 69c192fc2b2b51e9ad97af46 2026-03-25 19:22:44,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:22:44,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c192fc2b2b51e9ad97af46 HTTP/1.1" 200 None 2026-03-25 19:22:44,671 - lava_callback - DEBUG - Processing node 69c192fc2b2b51e9ad97af46: baseline-arm64-clabbe 2026-03-25 19:22:44,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c192fc2b2b51e9ad97af46 2026-03-25 19:22:44,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:22:44,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c192fc2b2b51e9ad97af46 HTTP/1.1" 200 None 2026-03-25 19:22:44,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:22:44,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:22:44,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:22:44,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c192fc2b2b51e9ad97af46 HTTP/1.1" 200 None 2026-03-25 19:22:44,729 - lava_callback - ERROR - Error processing callback for node 69c192fc2b2b51e9ad97af46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:24:24,715 - lava_callback - INFO - Received callback for node 69c193562b2b51e9ad97af68 INFO: 172.21.0.1:42558 - "POST /node/69c193562b2b51e9ad97af68 HTTP/1.0" 202 Accepted 2026-03-25 19:24:24,720 - lava_callback - INFO - Starting async job submit for node 69c193562b2b51e9ad97af68 2026-03-25 19:24:24,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:24:24,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c193562b2b51e9ad97af68 HTTP/1.1" 200 None 2026-03-25 19:24:24,737 - lava_callback - DEBUG - Processing node 69c193562b2b51e9ad97af68: baseline-arm64-clabbe 2026-03-25 19:24:24,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c193562b2b51e9ad97af68 2026-03-25 19:24:24,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:24:24,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c193562b2b51e9ad97af68 HTTP/1.1" 200 None 2026-03-25 19:24:24,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:24:24,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:24:24,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:24:24,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c193562b2b51e9ad97af68 HTTP/1.1" 200 None 2026-03-25 19:24:24,800 - lava_callback - ERROR - Error processing callback for node 69c193562b2b51e9ad97af68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40792 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:27:04,906 - lava_callback - INFO - Received callback for node 69c194032b2b51e9ad97af84 INFO: 172.21.0.1:43312 - "POST /node/69c194032b2b51e9ad97af84 HTTP/1.0" 202 Accepted 2026-03-25 19:27:04,911 - lava_callback - INFO - Starting async job submit for node 69c194032b2b51e9ad97af84 2026-03-25 19:27:04,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:27:04,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c194032b2b51e9ad97af84 HTTP/1.1" 200 None 2026-03-25 19:27:04,927 - lava_callback - DEBUG - Processing node 69c194032b2b51e9ad97af84: baseline-arm64-clabbe 2026-03-25 19:27:04,927 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c194032b2b51e9ad97af84 2026-03-25 19:27:04,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:27:04,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c194032b2b51e9ad97af84 HTTP/1.1" 200 None 2026-03-25 19:27:04,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:27:04,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:27:04,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:27:04,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c194032b2b51e9ad97af84 HTTP/1.1" 200 None 2026-03-25 19:27:04,985 - lava_callback - ERROR - Error processing callback for node 69c194032b2b51e9ad97af84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:28:44,935 - lava_callback - INFO - Received callback for node 69c1945b2b2b51e9ad97af91 INFO: 172.21.0.1:50758 - "POST /node/69c1945b2b2b51e9ad97af91 HTTP/1.0" 202 Accepted 2026-03-25 19:28:44,941 - lava_callback - INFO - Starting async job submit for node 69c1945b2b2b51e9ad97af91 2026-03-25 19:28:44,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:28:44,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1945b2b2b51e9ad97af91 HTTP/1.1" 200 None 2026-03-25 19:28:44,957 - lava_callback - DEBUG - Processing node 69c1945b2b2b51e9ad97af91: baseline-arm64-clabbe 2026-03-25 19:28:44,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1945b2b2b51e9ad97af91 2026-03-25 19:28:44,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:28:44,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1945b2b2b51e9ad97af91 HTTP/1.1" 200 None 2026-03-25 19:28:44,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:28:44,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:28:44,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:28:45,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1945b2b2b51e9ad97af91 HTTP/1.1" 200 None 2026-03-25 19:28:45,028 - lava_callback - ERROR - Error processing callback for node 69c1945b2b2b51e9ad97af91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54010 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:30:05,143 - lava_callback - INFO - Received callback for node 69c194b32b2b51e9ad97af99 INFO: 172.21.0.1:34528 - "POST /node/69c194b32b2b51e9ad97af99 HTTP/1.0" 202 Accepted 2026-03-25 19:30:05,149 - lava_callback - INFO - Starting async job submit for node 69c194b32b2b51e9ad97af99 2026-03-25 19:30:05,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:30:05,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c194b32b2b51e9ad97af99 HTTP/1.1" 200 None 2026-03-25 19:30:05,165 - lava_callback - DEBUG - Processing node 69c194b32b2b51e9ad97af99: baseline-arm64-clabbe 2026-03-25 19:30:05,165 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c194b32b2b51e9ad97af99 2026-03-25 19:30:05,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:30:05,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c194b32b2b51e9ad97af99 HTTP/1.1" 200 None 2026-03-25 19:30:05,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:30:05,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:30:05,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:30:05,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c194b32b2b51e9ad97af99 HTTP/1.1" 200 None 2026-03-25 19:30:05,229 - lava_callback - ERROR - Error processing callback for node 69c194b32b2b51e9ad97af99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48182 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:31:38,836 - lava_callback - INFO - Received callback for node 69c41144944faaf0e7f60d4c INFO: 172.21.0.1:48198 - "POST /node/69c41144944faaf0e7f60d4c HTTP/1.0" 202 Accepted 2026-03-25 19:31:38,842 - lava_callback - INFO - Starting async job submit for node 69c41144944faaf0e7f60d4c 2026-03-25 19:31:38,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:38,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41144944faaf0e7f60d4c HTTP/1.1" 200 None 2026-03-25 19:31:38,883 - lava_callback - DEBUG - Processing node 69c41144944faaf0e7f60d4c: baseline-x86 2026-03-25 19:31:39,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:31:39,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:31:39,439 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c41144944faaf0e7f60d4c/log.txt.gz 2026-03-25 19:31:39,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:31:39,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:31:39,823 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c41144944faaf0e7f60d4c/lava-logs.yaml 2026-03-25 19:31:39,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:31:40,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:31:40,008 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c41144944faaf0e7f60d4c/lava_callback.json.gz 2026-03-25 19:31:40,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:40,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41144944faaf0e7f60d4c HTTP/1.1" 200 None 2026-03-25 19:31:40,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:40,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40aef944faaf0e7f5e438 HTTP/1.1" 200 None 2026-03-25 19:31:40,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:40,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41144944faaf0e7f60d4c HTTP/1.1" 200 None 2026-03-25 19:31:40,087 - lava_callback - INFO - Completed processing callback for node 69c41144944faaf0e7f60d4c 2026-03-25 19:31:42,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:42,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-25 19:31:45,029 - lava_callback - INFO - Received callback for node 69c1950c2b2b51e9ad97afa8 INFO: 172.21.0.1:39496 - "POST /node/69c1950c2b2b51e9ad97afa8 HTTP/1.0" 202 Accepted 2026-03-25 19:31:45,035 - lava_callback - INFO - Starting async job submit for node 69c1950c2b2b51e9ad97afa8 2026-03-25 19:31:45,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:45,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1950c2b2b51e9ad97afa8 HTTP/1.1" 200 None 2026-03-25 19:31:45,054 - lava_callback - DEBUG - Processing node 69c1950c2b2b51e9ad97afa8: baseline-arm64-clabbe 2026-03-25 19:31:45,055 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1950c2b2b51e9ad97afa8 2026-03-25 19:31:45,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:45,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1950c2b2b51e9ad97afa8 HTTP/1.1" 200 None 2026-03-25 19:31:45,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:45,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-25 19:31:45,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:31:45,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1950c2b2b51e9ad97afa8 HTTP/1.1" 200 None 2026-03-25 19:31:45,137 - lava_callback - ERROR - Error processing callback for node 69c1950c2b2b51e9ad97afa8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39198 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:39:37,717 - lava_callback - INFO - Received callback for node 69c410b4944faaf0e7f60c22 INFO: 172.21.0.1:39206 - "POST /node/69c410b4944faaf0e7f60c22 HTTP/1.0" 202 Accepted 2026-03-25 19:39:37,723 - lava_callback - INFO - Starting async job submit for node 69c410b4944faaf0e7f60c22 2026-03-25 19:39:37,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:39:37,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b4944faaf0e7f60c22 HTTP/1.1" 200 None 2026-03-25 19:39:37,762 - lava_callback - DEBUG - Processing node 69c410b4944faaf0e7f60c22: baseline-arm-broonie 2026-03-25 19:39:37,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:39:38,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:39:38,124 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b4944faaf0e7f60c22/log.txt.gz 2026-03-25 19:39:38,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:39:38,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:39:38,449 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b4944faaf0e7f60c22/lava-logs.yaml 2026-03-25 19:39:38,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:39:38,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:39:38,626 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c410b4944faaf0e7f60c22/lava_callback.json.gz 2026-03-25 19:39:38,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:39:38,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b4944faaf0e7f60c22 HTTP/1.1" 200 None 2026-03-25 19:39:38,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:39:38,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:39:38,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:39:38,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410b4944faaf0e7f60c22 HTTP/1.1" 200 None 2026-03-25 19:39:38,733 - lava_callback - INFO - Completed processing callback for node 69c410b4944faaf0e7f60c22 2026-03-25 19:39:42,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:39:42,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46644 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:42:07,092 - lava_callback - INFO - Received callback for node 69c410de944faaf0e7f60ca0 INFO: 172.21.0.1:46654 - "POST /node/69c410de944faaf0e7f60ca0 HTTP/1.0" 202 Accepted 2026-03-25 19:42:07,099 - lava_callback - INFO - Starting async job submit for node 69c410de944faaf0e7f60ca0 2026-03-25 19:42:07,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:42:07,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410de944faaf0e7f60ca0 HTTP/1.1" 200 None 2026-03-25 19:42:07,158 - lava_callback - DEBUG - Processing node 69c410de944faaf0e7f60ca0: ltp-cap_bounds 2026-03-25 19:42:07,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:42:07,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:42:07,684 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69c410de944faaf0e7f60ca0/log.txt.gz 2026-03-25 19:42:07,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:42:08,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:42:08,175 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69c410de944faaf0e7f60ca0/lava-logs.yaml 2026-03-25 19:42:08,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:42:08,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:42:08,346 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69c410de944faaf0e7f60ca0/lava_callback.json.gz 2026-03-25 19:42:08,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:42:08,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410de944faaf0e7f60ca0 HTTP/1.1" 200 None 2026-03-25 19:42:08,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:42:08,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:42:08,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:42:08,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410de944faaf0e7f60ca0 HTTP/1.1" 200 None 2026-03-25 19:42:08,428 - lava_callback - INFO - Completed processing callback for node 69c410de944faaf0e7f60ca0 2026-03-25 19:42:12,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:42:12,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56524 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:43:37,912 - lava_callback - INFO - Received callback for node 69c410e0944faaf0e7f60ca3 INFO: 172.21.0.1:56536 - "POST /node/69c410e0944faaf0e7f60ca3 HTTP/1.0" 202 Accepted 2026-03-25 19:43:37,918 - lava_callback - INFO - Starting async job submit for node 69c410e0944faaf0e7f60ca3 2026-03-25 19:43:37,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:43:37,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e0944faaf0e7f60ca3 HTTP/1.1" 200 None 2026-03-25 19:43:37,958 - lava_callback - DEBUG - Processing node 69c410e0944faaf0e7f60ca3: ltp-containers 2026-03-25 19:43:38,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:43:38,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:43:38,581 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69c410e0944faaf0e7f60ca3/log.txt.gz 2026-03-25 19:43:38,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:43:39,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:43:39,043 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69c410e0944faaf0e7f60ca3/lava-logs.yaml 2026-03-25 19:43:39,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:43:39,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:43:39,207 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69c410e0944faaf0e7f60ca3/lava_callback.json.gz 2026-03-25 19:43:39,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:43:39,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e0944faaf0e7f60ca3 HTTP/1.1" 200 None 2026-03-25 19:43:39,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:43:39,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:43:39,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:43:39,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410e0944faaf0e7f60ca3 HTTP/1.1" 200 None 2026-03-25 19:43:39,306 - lava_callback - INFO - Completed processing callback for node 69c410e0944faaf0e7f60ca3 2026-03-25 19:43:42,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:43:42,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:45:38,967 - lava_callback - INFO - Received callback for node 69c410e1944faaf0e7f60ca6 INFO: 172.21.0.1:46286 - "POST /node/69c410e1944faaf0e7f60ca6 HTTP/1.0" 202 Accepted 2026-03-25 19:45:38,974 - lava_callback - INFO - Starting async job submit for node 69c410e1944faaf0e7f60ca6 2026-03-25 19:45:38,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:45:39,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e1944faaf0e7f60ca6 HTTP/1.1" 200 None 2026-03-25 19:45:39,017 - lava_callback - DEBUG - Processing node 69c410e1944faaf0e7f60ca6: ltp-controllers 2026-03-25 19:45:39,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:45:39,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:45:39,631 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69c410e1944faaf0e7f60ca6/log.txt.gz 2026-03-25 19:45:39,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:45:40,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:45:40,203 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69c410e1944faaf0e7f60ca6/lava-logs.yaml 2026-03-25 19:45:40,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:45:40,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:45:40,398 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69c410e1944faaf0e7f60ca6/lava_callback.json.gz 2026-03-25 19:45:40,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:45:40,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e1944faaf0e7f60ca6 HTTP/1.1" 200 None 2026-03-25 19:45:40,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:45:40,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:45:40,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:45:40,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410e1944faaf0e7f60ca6 HTTP/1.1" 200 None 2026-03-25 19:45:40,490 - lava_callback - INFO - Completed processing callback for node 69c410e1944faaf0e7f60ca6 2026-03-25 19:45:42,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:45:42,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42296 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:48:27,138 - lava_callback - INFO - Received callback for node 69c410e4944faaf0e7f60ca9 INFO: 172.21.0.1:42304 - "POST /node/69c410e4944faaf0e7f60ca9 HTTP/1.0" 202 Accepted 2026-03-25 19:48:27,145 - lava_callback - INFO - Starting async job submit for node 69c410e4944faaf0e7f60ca9 2026-03-25 19:48:27,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:27,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e4944faaf0e7f60ca9 HTTP/1.1" 200 None 2026-03-25 19:48:27,213 - lava_callback - DEBUG - Processing node 69c410e4944faaf0e7f60ca9: ltp-cve 2026-03-25 19:48:27,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:48:27,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:48:27,768 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69c410e4944faaf0e7f60ca9/log.txt.gz 2026-03-25 19:48:27,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:48:28,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:48:28,209 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69c410e4944faaf0e7f60ca9/lava-logs.yaml 2026-03-25 19:48:28,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:48:28,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:48:28,375 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69c410e4944faaf0e7f60ca9/lava_callback.json.gz 2026-03-25 19:48:28,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:28,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e4944faaf0e7f60ca9 HTTP/1.1" 200 None 2026-03-25 19:48:28,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:28,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:48:28,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:28,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410e4944faaf0e7f60ca9 HTTP/1.1" 200 None 2026-03-25 19:48:28,471 - lava_callback - INFO - Completed processing callback for node 69c410e4944faaf0e7f60ca9 INFO: 172.21.0.1:58330 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:48:42,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:42,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48016 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:48:58,163 - lava_callback - INFO - Received callback for node 69c410e8944faaf0e7f60cc0 INFO: 172.21.0.1:48026 - "POST /node/69c410e8944faaf0e7f60cc0 HTTP/1.0" 202 Accepted 2026-03-25 19:48:58,169 - lava_callback - INFO - Starting async job submit for node 69c410e8944faaf0e7f60cc0 2026-03-25 19:48:58,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:58,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e8944faaf0e7f60cc0 HTTP/1.1" 200 None 2026-03-25 19:48:58,210 - lava_callback - DEBUG - Processing node 69c410e8944faaf0e7f60cc0: ltp-fs_bind 2026-03-25 19:48:58,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:48:58,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:48:58,809 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69c410e8944faaf0e7f60cc0/log.txt.gz 2026-03-25 19:48:59,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:48:59,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:48:59,302 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69c410e8944faaf0e7f60cc0/lava-logs.yaml 2026-03-25 19:48:59,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:48:59,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:48:59,474 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69c410e8944faaf0e7f60cc0/lava_callback.json.gz 2026-03-25 19:48:59,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:59,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410e8944faaf0e7f60cc0 HTTP/1.1" 200 None 2026-03-25 19:48:59,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:59,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:48:59,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:48:59,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410e8944faaf0e7f60cc0 HTTP/1.1" 200 None 2026-03-25 19:48:59,557 - lava_callback - INFO - Completed processing callback for node 69c410e8944faaf0e7f60cc0 INFO: 172.21.0.1:54554 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:49:12,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:49:12,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45888 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:52:47,578 - lava_callback - INFO - Received callback for node 69c410ec944faaf0e7f60cc8 INFO: 172.21.0.1:45900 - "POST /node/69c410ec944faaf0e7f60cc8 HTTP/1.0" 202 Accepted 2026-03-25 19:52:47,585 - lava_callback - INFO - Starting async job submit for node 69c410ec944faaf0e7f60cc8 2026-03-25 19:52:47,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:52:47,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ec944faaf0e7f60cc8 HTTP/1.1" 200 None 2026-03-25 19:52:47,627 - lava_callback - DEBUG - Processing node 69c410ec944faaf0e7f60cc8: ltp-input 2026-03-25 19:52:47,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:52:48,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:52:48,109 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69c410ec944faaf0e7f60cc8/log.txt.gz 2026-03-25 19:52:48,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:52:48,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:52:48,563 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69c410ec944faaf0e7f60cc8/lava-logs.yaml 2026-03-25 19:52:48,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:52:48,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:52:48,753 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69c410ec944faaf0e7f60cc8/lava_callback.json.gz 2026-03-25 19:52:48,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:52:48,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ec944faaf0e7f60cc8 HTTP/1.1" 200 None 2026-03-25 19:52:48,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:52:48,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:52:48,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:52:48,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410ec944faaf0e7f60cc8 HTTP/1.1" 200 None 2026-03-25 19:52:48,863 - lava_callback - INFO - Completed processing callback for node 69c410ec944faaf0e7f60cc8 INFO: 172.21.0.1:36194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:53:12,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:53:12,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:53:38,371 - lava_callback - INFO - Received callback for node 69c410ee944faaf0e7f60ccb INFO: 172.21.0.1:37240 - "POST /node/69c410ee944faaf0e7f60ccb HTTP/1.0" 202 Accepted 2026-03-25 19:53:38,378 - lava_callback - INFO - Starting async job submit for node 69c410ee944faaf0e7f60ccb 2026-03-25 19:53:38,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:53:38,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ee944faaf0e7f60ccb HTTP/1.1" 200 None 2026-03-25 19:53:38,419 - lava_callback - DEBUG - Processing node 69c410ee944faaf0e7f60ccb: ltp-ipc 2026-03-25 19:53:38,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:53:38,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:53:38,949 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69c410ee944faaf0e7f60ccb/log.txt.gz 2026-03-25 19:53:39,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:53:39,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:53:39,401 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69c410ee944faaf0e7f60ccb/lava-logs.yaml 2026-03-25 19:53:39,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:53:39,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:53:39,581 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69c410ee944faaf0e7f60ccb/lava_callback.json.gz 2026-03-25 19:53:39,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:53:39,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ee944faaf0e7f60ccb HTTP/1.1" 200 None 2026-03-25 19:53:39,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:53:39,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:53:39,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:53:39,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410ee944faaf0e7f60ccb HTTP/1.1" 200 None 2026-03-25 19:53:39,664 - lava_callback - INFO - Completed processing callback for node 69c410ee944faaf0e7f60ccb 2026-03-25 19:53:42,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:53:42,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58662 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:54:18,623 - lava_callback - INFO - Received callback for node 69c410f0944faaf0e7f60cce INFO: 172.21.0.1:58676 - "POST /node/69c410f0944faaf0e7f60cce HTTP/1.0" 202 Accepted 2026-03-25 19:54:18,630 - lava_callback - INFO - Starting async job submit for node 69c410f0944faaf0e7f60cce 2026-03-25 19:54:18,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:54:18,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f0944faaf0e7f60cce HTTP/1.1" 200 None 2026-03-25 19:54:18,670 - lava_callback - DEBUG - Processing node 69c410f0944faaf0e7f60cce: ltp-pty 2026-03-25 19:54:19,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:54:23,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:54:23,196 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69c410f0944faaf0e7f60cce/log.txt.gz 2026-03-25 19:54:23,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:54:23,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:54:23,639 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69c410f0944faaf0e7f60cce/lava-logs.yaml 2026-03-25 19:54:23,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:54:23,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:54:23,819 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69c410f0944faaf0e7f60cce/lava_callback.json.gz 2026-03-25 19:54:23,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:54:23,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f0944faaf0e7f60cce HTTP/1.1" 200 None 2026-03-25 19:54:23,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:54:23,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:54:23,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:54:23,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410f0944faaf0e7f60cce HTTP/1.1" 200 None 2026-03-25 19:54:23,912 - lava_callback - INFO - Completed processing callback for node 69c410f0944faaf0e7f60cce INFO: 172.21.0.1:59302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38662 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:54:42,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:54:43,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36582 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:54:59,011 - lava_callback - INFO - Received callback for node 69c410ea944faaf0e7f60cc5 INFO: 172.21.0.1:36594 - "POST /node/69c410ea944faaf0e7f60cc5 HTTP/1.0" 202 Accepted 2026-03-25 19:54:59,017 - lava_callback - INFO - Starting async job submit for node 69c410ea944faaf0e7f60cc5 2026-03-25 19:54:59,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:54:59,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ea944faaf0e7f60cc5 HTTP/1.1" 200 None 2026-03-25 19:54:59,068 - lava_callback - DEBUG - Processing node 69c410ea944faaf0e7f60cc5: ltp-fsx 2026-03-25 19:54:59,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:54:59,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:54:59,602 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69c410ea944faaf0e7f60cc5/log.txt.gz 2026-03-25 19:54:59,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:55:00,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:55:00,069 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69c410ea944faaf0e7f60cc5/lava-logs.yaml 2026-03-25 19:55:00,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:55:00,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:55:00,251 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69c410ea944faaf0e7f60cc5/lava_callback.json.gz 2026-03-25 19:55:00,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:55:00,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ea944faaf0e7f60cc5 HTTP/1.1" 200 None 2026-03-25 19:55:00,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:55:00,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:55:00,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:55:00,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410ea944faaf0e7f60cc5 HTTP/1.1" 200 None 2026-03-25 19:55:00,343 - lava_callback - INFO - Completed processing callback for node 69c410ea944faaf0e7f60cc5 INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:55:13,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:55:13,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36000 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:56:47,442 - lava_callback - INFO - Received callback for node 69c410f2944faaf0e7f60cd5 INFO: 172.21.0.1:36014 - "POST /node/69c410f2944faaf0e7f60cd5 HTTP/1.0" 202 Accepted 2026-03-25 19:56:47,448 - lava_callback - INFO - Starting async job submit for node 69c410f2944faaf0e7f60cd5 2026-03-25 19:56:47,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:36030 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:56:47,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f2944faaf0e7f60cd5 HTTP/1.1" 200 None 2026-03-25 19:56:47,498 - lava_callback - DEBUG - Processing node 69c410f2944faaf0e7f60cd5: ltp-sched 2026-03-25 19:56:47,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:56:48,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:56:48,004 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69c410f2944faaf0e7f60cd5/log.txt.gz 2026-03-25 19:56:48,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:56:48,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:56:48,423 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69c410f2944faaf0e7f60cd5/lava-logs.yaml 2026-03-25 19:56:48,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:56:48,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:56:48,645 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69c410f2944faaf0e7f60cd5/lava_callback.json.gz 2026-03-25 19:56:48,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:56:48,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f2944faaf0e7f60cd5 HTTP/1.1" 200 None 2026-03-25 19:56:48,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:56:48,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:56:48,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:56:48,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410f2944faaf0e7f60cd5 HTTP/1.1" 200 None 2026-03-25 19:56:48,771 - lava_callback - INFO - Completed processing callback for node 69c410f2944faaf0e7f60cd5 INFO: 172.21.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41212 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:57:13,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:57:13,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:58:07,740 - lava_callback - INFO - Received callback for node 69c411a4944faaf0e7f60e3c INFO: 172.21.0.1:46264 - "POST /node/69c411a4944faaf0e7f60e3c HTTP/1.0" 202 Accepted 2026-03-25 19:58:07,746 - lava_callback - INFO - Starting async job submit for node 69c411a4944faaf0e7f60e3c 2026-03-25 19:58:07,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:07,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411a4944faaf0e7f60e3c HTTP/1.1" 200 None 2026-03-25 19:58:07,792 - lava_callback - DEBUG - Processing node 69c411a4944faaf0e7f60e3c: baseline-arm64-broonie 2026-03-25 19:58:08,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:08,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:08,159 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411a4944faaf0e7f60e3c/log.txt.gz 2026-03-25 19:58:08,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:08,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:08,499 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411a4944faaf0e7f60e3c/lava-logs.yaml 2026-03-25 19:58:08,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:08,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:08,675 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411a4944faaf0e7f60e3c/lava_callback.json.gz 2026-03-25 19:58:08,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:08,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411a4944faaf0e7f60e3c HTTP/1.1" 200 None 2026-03-25 19:58:08,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:08,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 19:58:08,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:08,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411a4944faaf0e7f60e3c HTTP/1.1" 200 None 2026-03-25 19:58:08,765 - lava_callback - INFO - Completed processing callback for node 69c411a4944faaf0e7f60e3c 2026-03-25 19:58:13,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:13,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:58:18,489 - lava_callback - INFO - Received callback for node 69c410f4944faaf0e7f60cd8 INFO: 172.21.0.1:51518 - "POST /node/69c410f4944faaf0e7f60cd8 HTTP/1.0" 202 Accepted 2026-03-25 19:58:18,495 - lava_callback - INFO - Starting async job submit for node 69c410f4944faaf0e7f60cd8 2026-03-25 19:58:18,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:18,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f4944faaf0e7f60cd8 HTTP/1.1" 200 None 2026-03-25 19:58:18,536 - lava_callback - DEBUG - Processing node 69c410f4944faaf0e7f60cd8: ltp-smoke 2026-03-25 19:58:18,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:19,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:19,082 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c410f4944faaf0e7f60cd8/log.txt.gz 2026-03-25 19:58:19,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:19,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:19,527 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c410f4944faaf0e7f60cd8/lava-logs.yaml 2026-03-25 19:58:19,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:19,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:19,693 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c410f4944faaf0e7f60cd8/lava_callback.json.gz 2026-03-25 19:58:19,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:19,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f4944faaf0e7f60cd8 HTTP/1.1" 200 None 2026-03-25 19:58:19,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:19,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:58:19,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:19,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410f4944faaf0e7f60cd8 HTTP/1.1" 200 None 2026-03-25 19:58:19,788 - lava_callback - INFO - Completed processing callback for node 69c410f4944faaf0e7f60cd8 2026-03-25 19:58:20,146 - lava_callback - INFO - Received callback for node 69c410f7944faaf0e7f60ce1 INFO: 172.21.0.1:51096 - "POST /node/69c410f7944faaf0e7f60ce1 HTTP/1.0" 202 Accepted 2026-03-25 19:58:20,152 - lava_callback - INFO - Starting async job submit for node 69c410f7944faaf0e7f60ce1 2026-03-25 19:58:20,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:20,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f7944faaf0e7f60ce1 HTTP/1.1" 200 None 2026-03-25 19:58:20,196 - lava_callback - DEBUG - Processing node 69c410f7944faaf0e7f60ce1: ltp-syscalls-ipc 2026-03-25 19:58:20,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:20,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:20,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69c410f7944faaf0e7f60ce1/log.txt.gz 2026-03-25 19:58:20,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:21,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:21,122 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69c410f7944faaf0e7f60ce1/lava-logs.yaml 2026-03-25 19:58:21,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 19:58:21,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 19:58:21,297 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69c410f7944faaf0e7f60ce1/lava_callback.json.gz 2026-03-25 19:58:21,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:21,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f7944faaf0e7f60ce1 HTTP/1.1" 200 None 2026-03-25 19:58:21,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:21,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 19:58:21,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:21,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410f7944faaf0e7f60ce1 HTTP/1.1" 200 None 2026-03-25 19:58:21,388 - lava_callback - INFO - Completed processing callback for node 69c410f7944faaf0e7f60ce1 INFO: 172.21.0.1:51098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK 2026-03-25 19:58:43,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 19:58:43,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:00:47,490 - lava_callback - INFO - Received callback for node 69c410fb944faaf0e7f60ced INFO: 172.21.0.1:55054 - "POST /node/69c410fb944faaf0e7f60ced HTTP/1.0" 202 Accepted 2026-03-25 20:00:47,497 - lava_callback - INFO - Starting async job submit for node 69c410fb944faaf0e7f60ced 2026-03-25 20:00:47,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:00:47,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410fb944faaf0e7f60ced HTTP/1.1" 200 None 2026-03-25 20:00:47,564 - lava_callback - DEBUG - Processing node 69c410fb944faaf0e7f60ced: ltp-watchqueue 2026-03-25 20:00:47,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 20:00:48,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 20:00:48,057 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69c410fb944faaf0e7f60ced/log.txt.gz 2026-03-25 20:00:48,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 20:00:48,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 20:00:48,498 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69c410fb944faaf0e7f60ced/lava-logs.yaml 2026-03-25 20:00:48,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 20:00:48,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 20:00:48,689 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69c410fb944faaf0e7f60ced/lava_callback.json.gz 2026-03-25 20:00:48,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:00:48,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410fb944faaf0e7f60ced HTTP/1.1" 200 None 2026-03-25 20:00:48,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:00:48,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 20:00:48,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:00:48,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410fb944faaf0e7f60ced HTTP/1.1" 200 None 2026-03-25 20:00:48,843 - lava_callback - INFO - Completed processing callback for node 69c410fb944faaf0e7f60ced INFO: 172.21.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47320 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:01:13,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:01:13,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47338 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:47346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53492 - "GET /security.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:45754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43200 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:02:20,065 - lava_callback - INFO - Received callback for node 69c410f9944faaf0e7f60ce4 INFO: 172.21.0.1:56234 - "POST /node/69c410f9944faaf0e7f60ce4 HTTP/1.0" 202 Accepted 2026-03-25 20:02:20,072 - lava_callback - INFO - Starting async job submit for node 69c410f9944faaf0e7f60ce4 2026-03-25 20:02:20,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:02:20,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f9944faaf0e7f60ce4 HTTP/1.1" 200 None 2026-03-25 20:02:20,149 - lava_callback - DEBUG - Processing node 69c410f9944faaf0e7f60ce4: ltp-timers 2026-03-25 20:02:20,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 20:02:20,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 20:02:20,712 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69c410f9944faaf0e7f60ce4/log.txt.gz 2026-03-25 20:02:20,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 20:02:21,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 20:02:21,172 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69c410f9944faaf0e7f60ce4/lava-logs.yaml 2026-03-25 20:02:21,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 20:02:21,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 20:02:21,405 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69c410f9944faaf0e7f60ce4/lava_callback.json.gz 2026-03-25 20:02:21,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:02:21,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f9944faaf0e7f60ce4 HTTP/1.1" 200 None 2026-03-25 20:02:21,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:02:21,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 20:02:21,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:02:21,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410f9944faaf0e7f60ce4 HTTP/1.1" 200 None 2026-03-25 20:02:21,509 - lava_callback - INFO - Completed processing callback for node 69c410f9944faaf0e7f60ce4 INFO: 172.21.0.1:56248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:02:43,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:02:43,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:48740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51820 - "GET /security.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:45216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42220 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:41:56,901 - lava_callback - INFO - Received callback for node 69c1a5822b2b51e9ad97b03c INFO: 172.21.0.1:42230 - "POST /node/69c1a5822b2b51e9ad97b03c HTTP/1.0" 202 Accepted 2026-03-25 20:41:56,906 - lava_callback - INFO - Starting async job submit for node 69c1a5822b2b51e9ad97b03c 2026-03-25 20:41:56,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:41:56,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a5822b2b51e9ad97b03c HTTP/1.1" 200 None 2026-03-25 20:41:56,922 - lava_callback - DEBUG - Processing node 69c1a5822b2b51e9ad97b03c: baseline-arm-baylibre 2026-03-25 20:41:56,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a5822b2b51e9ad97b03c 2026-03-25 20:41:56,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:41:56,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a5822b2b51e9ad97b03c HTTP/1.1" 200 None 2026-03-25 20:41:56,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:41:56,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:41:56,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:41:56,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a5822b2b51e9ad97b03c HTTP/1.1" 200 None 2026-03-25 20:41:56,985 - lava_callback - ERROR - Error processing callback for node 69c1a5822b2b51e9ad97b03c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54734 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:42:36,427 - lava_callback - INFO - Received callback for node 69c1a5ab2b2b51e9ad97b048 INFO: 172.21.0.1:48492 - "POST /node/69c1a5ab2b2b51e9ad97b048 HTTP/1.0" 202 Accepted 2026-03-25 20:42:36,435 - lava_callback - INFO - Starting async job submit for node 69c1a5ab2b2b51e9ad97b048 2026-03-25 20:42:36,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:42:36,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a5ab2b2b51e9ad97b048 HTTP/1.1" 200 None 2026-03-25 20:42:36,455 - lava_callback - DEBUG - Processing node 69c1a5ab2b2b51e9ad97b048: baseline-arm-baylibre 2026-03-25 20:42:36,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a5ab2b2b51e9ad97b048 2026-03-25 20:42:36,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:42:36,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a5ab2b2b51e9ad97b048 HTTP/1.1" 200 None 2026-03-25 20:42:36,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:42:36,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:42:36,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:42:36,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a5ab2b2b51e9ad97b048 HTTP/1.1" 200 None 2026-03-25 20:42:36,516 - lava_callback - ERROR - Error processing callback for node 69c1a5ab2b2b51e9ad97b048: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 20:43:16,530 - lava_callback - INFO - Received callback for node 69c1a5d52b2b51e9ad97b057 INFO: 172.21.0.1:36694 - "POST /node/69c1a5d52b2b51e9ad97b057 HTTP/1.0" 202 Accepted 2026-03-25 20:43:16,540 - lava_callback - INFO - Starting async job submit for node 69c1a5d52b2b51e9ad97b057 2026-03-25 20:43:16,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:36698 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:43:16,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a5d52b2b51e9ad97b057 HTTP/1.1" 200 None 2026-03-25 20:43:16,562 - lava_callback - DEBUG - Processing node 69c1a5d52b2b51e9ad97b057: baseline-arm-baylibre 2026-03-25 20:43:16,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a5d52b2b51e9ad97b057 2026-03-25 20:43:16,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:43:16,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a5d52b2b51e9ad97b057 HTTP/1.1" 200 None 2026-03-25 20:43:16,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:43:16,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:43:16,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:43:16,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a5d52b2b51e9ad97b057 HTTP/1.1" 200 None 2026-03-25 20:43:16,617 - lava_callback - ERROR - Error processing callback for node 69c1a5d52b2b51e9ad97b057: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47880 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:43:56,557 - lava_callback - INFO - Received callback for node 69c1a5ff2b2b51e9ad97b067 INFO: 172.21.0.1:47894 - "POST /node/69c1a5ff2b2b51e9ad97b067 HTTP/1.0" 202 Accepted 2026-03-25 20:43:56,563 - lava_callback - INFO - Starting async job submit for node 69c1a5ff2b2b51e9ad97b067 2026-03-25 20:43:56,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:43:56,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a5ff2b2b51e9ad97b067 HTTP/1.1" 200 None 2026-03-25 20:43:56,583 - lava_callback - DEBUG - Processing node 69c1a5ff2b2b51e9ad97b067: baseline-arm-baylibre 2026-03-25 20:43:56,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a5ff2b2b51e9ad97b067 2026-03-25 20:43:56,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:43:56,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a5ff2b2b51e9ad97b067 HTTP/1.1" 200 None 2026-03-25 20:43:56,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:43:56,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:43:56,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:43:56,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a5ff2b2b51e9ad97b067 HTTP/1.1" 200 None 2026-03-25 20:43:56,664 - lava_callback - ERROR - Error processing callback for node 69c1a5ff2b2b51e9ad97b067: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34400 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:44:36,668 - lava_callback - INFO - Received callback for node 69c1a6262b2b51e9ad97b071 INFO: 172.21.0.1:34416 - "POST /node/69c1a6262b2b51e9ad97b071 HTTP/1.0" 202 Accepted 2026-03-25 20:44:36,673 - lava_callback - INFO - Starting async job submit for node 69c1a6262b2b51e9ad97b071 2026-03-25 20:44:36,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:44:36,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a6262b2b51e9ad97b071 HTTP/1.1" 200 None 2026-03-25 20:44:36,688 - lava_callback - DEBUG - Processing node 69c1a6262b2b51e9ad97b071: baseline-arm-baylibre 2026-03-25 20:44:36,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a6262b2b51e9ad97b071 2026-03-25 20:44:36,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:44:36,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a6262b2b51e9ad97b071 HTTP/1.1" 200 None 2026-03-25 20:44:36,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:44:36,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:44:36,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:44:36,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a6262b2b51e9ad97b071 HTTP/1.1" 200 None 2026-03-25 20:44:36,746 - lava_callback - ERROR - Error processing callback for node 69c1a6262b2b51e9ad97b071: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38794 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:45:16,597 - lava_callback - INFO - Received callback for node 69c1a64e2b2b51e9ad97b07e INFO: 172.21.0.1:38798 - "POST /node/69c1a64e2b2b51e9ad97b07e HTTP/1.0" 202 Accepted 2026-03-25 20:45:16,603 - lava_callback - INFO - Starting async job submit for node 69c1a64e2b2b51e9ad97b07e 2026-03-25 20:45:16,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:45:16,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a64e2b2b51e9ad97b07e HTTP/1.1" 200 None 2026-03-25 20:45:16,619 - lava_callback - DEBUG - Processing node 69c1a64e2b2b51e9ad97b07e: baseline-arm-baylibre 2026-03-25 20:45:16,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a64e2b2b51e9ad97b07e 2026-03-25 20:45:16,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:45:16,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a64e2b2b51e9ad97b07e HTTP/1.1" 200 None 2026-03-25 20:45:16,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:45:16,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:45:16,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:45:16,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a64e2b2b51e9ad97b07e HTTP/1.1" 200 None 2026-03-25 20:45:16,671 - lava_callback - ERROR - Error processing callback for node 69c1a64e2b2b51e9ad97b07e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:45:56,713 - lava_callback - INFO - Received callback for node 69c1a6762b2b51e9ad97b08e INFO: 172.21.0.1:54836 - "POST /node/69c1a6762b2b51e9ad97b08e HTTP/1.0" 202 Accepted 2026-03-25 20:45:56,718 - lava_callback - INFO - Starting async job submit for node 69c1a6762b2b51e9ad97b08e 2026-03-25 20:45:56,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:45:56,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a6762b2b51e9ad97b08e HTTP/1.1" 200 None 2026-03-25 20:45:56,734 - lava_callback - DEBUG - Processing node 69c1a6762b2b51e9ad97b08e: baseline-arm-baylibre 2026-03-25 20:45:56,735 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a6762b2b51e9ad97b08e 2026-03-25 20:45:56,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:45:56,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a6762b2b51e9ad97b08e HTTP/1.1" 200 None 2026-03-25 20:45:56,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:45:56,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:45:56,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:45:56,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a6762b2b51e9ad97b08e HTTP/1.1" 200 None 2026-03-25 20:45:56,800 - lava_callback - ERROR - Error processing callback for node 69c1a6762b2b51e9ad97b08e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42258 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:46:36,673 - lava_callback - INFO - Received callback for node 69c1a69d2b2b51e9ad97b098 INFO: 172.21.0.1:42274 - "POST /node/69c1a69d2b2b51e9ad97b098 HTTP/1.0" 202 Accepted 2026-03-25 20:46:36,679 - lava_callback - INFO - Starting async job submit for node 69c1a69d2b2b51e9ad97b098 2026-03-25 20:46:36,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:46:36,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a69d2b2b51e9ad97b098 HTTP/1.1" 200 None 2026-03-25 20:46:36,698 - lava_callback - DEBUG - Processing node 69c1a69d2b2b51e9ad97b098: baseline-arm-baylibre 2026-03-25 20:46:36,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a69d2b2b51e9ad97b098 2026-03-25 20:46:36,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:46:36,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a69d2b2b51e9ad97b098 HTTP/1.1" 200 None 2026-03-25 20:46:36,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:46:36,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:46:36,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:46:36,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a69d2b2b51e9ad97b098 HTTP/1.1" 200 None 2026-03-25 20:46:36,754 - lava_callback - ERROR - Error processing callback for node 69c1a69d2b2b51e9ad97b098: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57962 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:47:16,790 - lava_callback - INFO - Received callback for node 69c1a6c52b2b51e9ad97b0a5 INFO: 172.21.0.1:57968 - "POST /node/69c1a6c52b2b51e9ad97b0a5 HTTP/1.0" 202 Accepted 2026-03-25 20:47:16,795 - lava_callback - INFO - Starting async job submit for node 69c1a6c52b2b51e9ad97b0a5 2026-03-25 20:47:16,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:47:16,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a6c52b2b51e9ad97b0a5 HTTP/1.1" 200 None 2026-03-25 20:47:16,814 - lava_callback - DEBUG - Processing node 69c1a6c52b2b51e9ad97b0a5: baseline-arm-baylibre 2026-03-25 20:47:16,814 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a6c52b2b51e9ad97b0a5 2026-03-25 20:47:16,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:47:16,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a6c52b2b51e9ad97b0a5 HTTP/1.1" 200 None 2026-03-25 20:47:16,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:47:16,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:47:16,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:47:16,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a6c52b2b51e9ad97b0a5 HTTP/1.1" 200 None 2026-03-25 20:47:16,868 - lava_callback - ERROR - Error processing callback for node 69c1a6c52b2b51e9ad97b0a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55686 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:47:56,752 - lava_callback - INFO - Received callback for node 69c1a6ed2b2b51e9ad97b0b7 INFO: 172.21.0.1:55688 - "POST /node/69c1a6ed2b2b51e9ad97b0b7 HTTP/1.0" 202 Accepted 2026-03-25 20:47:56,758 - lava_callback - INFO - Starting async job submit for node 69c1a6ed2b2b51e9ad97b0b7 2026-03-25 20:47:56,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:47:56,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a6ed2b2b51e9ad97b0b7 HTTP/1.1" 200 None 2026-03-25 20:47:56,775 - lava_callback - DEBUG - Processing node 69c1a6ed2b2b51e9ad97b0b7: baseline-arm-baylibre 2026-03-25 20:47:56,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a6ed2b2b51e9ad97b0b7 2026-03-25 20:47:56,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:47:56,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a6ed2b2b51e9ad97b0b7 HTTP/1.1" 200 None 2026-03-25 20:47:56,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:47:56,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:47:56,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:47:56,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a6ed2b2b51e9ad97b0b7 HTTP/1.1" 200 None 2026-03-25 20:47:56,828 - lava_callback - ERROR - Error processing callback for node 69c1a6ed2b2b51e9ad97b0b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:48:48,569 - lava_callback - INFO - Received callback for node 69c1a71a2b2b51e9ad97b0c6 INFO: 172.21.0.1:35862 - "POST /node/69c1a71a2b2b51e9ad97b0c6 HTTP/1.0" 202 Accepted 2026-03-25 20:48:48,575 - lava_callback - INFO - Starting async job submit for node 69c1a71a2b2b51e9ad97b0c6 2026-03-25 20:48:48,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:48:48,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a71a2b2b51e9ad97b0c6 HTTP/1.1" 200 None 2026-03-25 20:48:48,592 - lava_callback - DEBUG - Processing node 69c1a71a2b2b51e9ad97b0c6: baseline-arm-clabbe 2026-03-25 20:48:48,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a71a2b2b51e9ad97b0c6 2026-03-25 20:48:48,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:48:48,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a71a2b2b51e9ad97b0c6 HTTP/1.1" 200 None 2026-03-25 20:48:48,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:48:48,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:48:48,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:48:48,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a71a2b2b51e9ad97b0c6 HTTP/1.1" 200 None 2026-03-25 20:48:48,658 - lava_callback - ERROR - Error processing callback for node 69c1a71a2b2b51e9ad97b0c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35456 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:49:16,956 - lava_callback - INFO - Received callback for node 69c1a7412b2b51e9ad97b0d6 INFO: 172.21.0.1:35468 - "POST /node/69c1a7412b2b51e9ad97b0d6 HTTP/1.0" 202 Accepted 2026-03-25 20:49:16,962 - lava_callback - INFO - Starting async job submit for node 69c1a7412b2b51e9ad97b0d6 2026-03-25 20:49:16,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:49:16,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a7412b2b51e9ad97b0d6 HTTP/1.1" 200 None 2026-03-25 20:49:16,999 - lava_callback - DEBUG - Processing node 69c1a7412b2b51e9ad97b0d6: baseline-arm-baylibre 2026-03-25 20:49:17,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a7412b2b51e9ad97b0d6 2026-03-25 20:49:17,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:49:17,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a7412b2b51e9ad97b0d6 HTTP/1.1" 200 None 2026-03-25 20:49:17,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:49:17,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:49:17,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:49:17,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a7412b2b51e9ad97b0d6 HTTP/1.1" 200 None 2026-03-25 20:49:17,084 - lava_callback - ERROR - Error processing callback for node 69c1a7412b2b51e9ad97b0d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57956 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:50:48,619 - lava_callback - INFO - Received callback for node 69c1a79c2b2b51e9ad97b0f3 INFO: 172.21.0.1:57960 - "POST /node/69c1a79c2b2b51e9ad97b0f3 HTTP/1.0" 202 Accepted 2026-03-25 20:50:48,625 - lava_callback - INFO - Starting async job submit for node 69c1a79c2b2b51e9ad97b0f3 2026-03-25 20:50:48,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:50:48,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a79c2b2b51e9ad97b0f3 HTTP/1.1" 200 None 2026-03-25 20:50:48,650 - lava_callback - DEBUG - Processing node 69c1a79c2b2b51e9ad97b0f3: baseline-arm-clabbe 2026-03-25 20:50:48,650 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a79c2b2b51e9ad97b0f3 2026-03-25 20:50:48,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:50:48,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a79c2b2b51e9ad97b0f3 HTTP/1.1" 200 None 2026-03-25 20:50:48,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:50:48,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:50:48,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:50:48,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a79c2b2b51e9ad97b0f3 HTTP/1.1" 200 None 2026-03-25 20:50:48,734 - lava_callback - ERROR - Error processing callback for node 69c1a79c2b2b51e9ad97b0f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55558 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:51:28,593 - lava_callback - INFO - Received callback for node 69c1a7c52b2b51e9ad97b107 INFO: 172.21.0.1:55564 - "POST /node/69c1a7c52b2b51e9ad97b107 HTTP/1.0" 202 Accepted 2026-03-25 20:51:28,598 - lava_callback - INFO - Starting async job submit for node 69c1a7c52b2b51e9ad97b107 2026-03-25 20:51:28,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:51:28,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a7c52b2b51e9ad97b107 HTTP/1.1" 200 None 2026-03-25 20:51:28,623 - lava_callback - DEBUG - Processing node 69c1a7c52b2b51e9ad97b107: baseline-arm-clabbe 2026-03-25 20:51:28,624 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a7c52b2b51e9ad97b107 2026-03-25 20:51:28,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:51:28,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a7c52b2b51e9ad97b107 HTTP/1.1" 200 None 2026-03-25 20:51:28,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:51:28,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:51:28,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:51:28,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a7c52b2b51e9ad97b107 HTTP/1.1" 200 None 2026-03-25 20:51:28,711 - lava_callback - ERROR - Error processing callback for node 69c1a7c52b2b51e9ad97b107: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38534 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:52:48,732 - lava_callback - INFO - Received callback for node 69c1a8162b2b51e9ad97b11e INFO: 172.21.0.1:38536 - "POST /node/69c1a8162b2b51e9ad97b11e HTTP/1.0" 202 Accepted 2026-03-25 20:52:48,738 - lava_callback - INFO - Starting async job submit for node 69c1a8162b2b51e9ad97b11e 2026-03-25 20:52:48,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:52:48,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a8162b2b51e9ad97b11e HTTP/1.1" 200 None 2026-03-25 20:52:48,768 - lava_callback - DEBUG - Processing node 69c1a8162b2b51e9ad97b11e: baseline-arm-clabbe 2026-03-25 20:52:48,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a8162b2b51e9ad97b11e 2026-03-25 20:52:48,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:52:48,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a8162b2b51e9ad97b11e HTTP/1.1" 200 None 2026-03-25 20:52:48,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:52:48,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:52:48,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:52:48,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a8162b2b51e9ad97b11e HTTP/1.1" 200 None 2026-03-25 20:52:48,836 - lava_callback - ERROR - Error processing callback for node 69c1a8162b2b51e9ad97b11e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58350 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:53:28,715 - lava_callback - INFO - Received callback for node 69c1a83e2b2b51e9ad97b130 INFO: 172.21.0.1:58364 - "POST /node/69c1a83e2b2b51e9ad97b130 HTTP/1.0" 202 Accepted 2026-03-25 20:53:28,721 - lava_callback - INFO - Starting async job submit for node 69c1a83e2b2b51e9ad97b130 2026-03-25 20:53:28,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:53:28,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a83e2b2b51e9ad97b130 HTTP/1.1" 200 None 2026-03-25 20:53:28,737 - lava_callback - DEBUG - Processing node 69c1a83e2b2b51e9ad97b130: baseline-arm-clabbe 2026-03-25 20:53:28,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a83e2b2b51e9ad97b130 2026-03-25 20:53:28,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:53:28,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a83e2b2b51e9ad97b130 HTTP/1.1" 200 None 2026-03-25 20:53:28,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:53:28,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:53:28,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:53:28,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a83e2b2b51e9ad97b130 HTTP/1.1" 200 None 2026-03-25 20:53:28,791 - lava_callback - ERROR - Error processing callback for node 69c1a83e2b2b51e9ad97b130: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43868 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:54:08,817 - lava_callback - INFO - Received callback for node 69c1a8662b2b51e9ad97b13d INFO: 172.21.0.1:43882 - "POST /node/69c1a8662b2b51e9ad97b13d HTTP/1.0" 202 Accepted 2026-03-25 20:54:08,822 - lava_callback - INFO - Starting async job submit for node 69c1a8662b2b51e9ad97b13d 2026-03-25 20:54:08,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:54:08,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a8662b2b51e9ad97b13d HTTP/1.1" 200 None 2026-03-25 20:54:08,839 - lava_callback - DEBUG - Processing node 69c1a8662b2b51e9ad97b13d: baseline-arm-clabbe 2026-03-25 20:54:08,839 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a8662b2b51e9ad97b13d 2026-03-25 20:54:08,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:54:08,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a8662b2b51e9ad97b13d HTTP/1.1" 200 None 2026-03-25 20:54:08,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:54:08,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:54:08,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:54:08,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a8662b2b51e9ad97b13d HTTP/1.1" 200 None 2026-03-25 20:54:08,895 - lava_callback - ERROR - Error processing callback for node 69c1a8662b2b51e9ad97b13d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40936 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:54:48,793 - lava_callback - INFO - Received callback for node 69c1a88e2b2b51e9ad97b14b INFO: 172.21.0.1:40948 - "POST /node/69c1a88e2b2b51e9ad97b14b HTTP/1.0" 202 Accepted 2026-03-25 20:54:48,799 - lava_callback - INFO - Starting async job submit for node 69c1a88e2b2b51e9ad97b14b 2026-03-25 20:54:48,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:54:48,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a88e2b2b51e9ad97b14b HTTP/1.1" 200 None 2026-03-25 20:54:48,815 - lava_callback - DEBUG - Processing node 69c1a88e2b2b51e9ad97b14b: baseline-arm-clabbe 2026-03-25 20:54:48,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a88e2b2b51e9ad97b14b 2026-03-25 20:54:48,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:54:48,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a88e2b2b51e9ad97b14b HTTP/1.1" 200 None 2026-03-25 20:54:48,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:54:48,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:54:48,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:54:48,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a88e2b2b51e9ad97b14b HTTP/1.1" 200 None 2026-03-25 20:54:48,915 - lava_callback - ERROR - Error processing callback for node 69c1a88e2b2b51e9ad97b14b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34056 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:56:08,876 - lava_callback - INFO - Received callback for node 69c1a8df2b2b51e9ad97b167 INFO: 172.21.0.1:34072 - "POST /node/69c1a8df2b2b51e9ad97b167 HTTP/1.0" 202 Accepted 2026-03-25 20:56:08,882 - lava_callback - INFO - Starting async job submit for node 69c1a8df2b2b51e9ad97b167 2026-03-25 20:56:08,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:56:08,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a8df2b2b51e9ad97b167 HTTP/1.1" 200 None 2026-03-25 20:56:08,897 - lava_callback - DEBUG - Processing node 69c1a8df2b2b51e9ad97b167: baseline-arm-clabbe 2026-03-25 20:56:08,898 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a8df2b2b51e9ad97b167 2026-03-25 20:56:08,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:56:08,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a8df2b2b51e9ad97b167 HTTP/1.1" 200 None 2026-03-25 20:56:08,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:56:08,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:56:08,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:56:08,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a8df2b2b51e9ad97b167 HTTP/1.1" 200 None 2026-03-25 20:56:09,004 - lava_callback - ERROR - Error processing callback for node 69c1a8df2b2b51e9ad97b167: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:57:48,965 - lava_callback - INFO - Received callback for node 69c1a9372b2b51e9ad97b187 INFO: 172.21.0.1:45854 - "POST /node/69c1a9372b2b51e9ad97b187 HTTP/1.0" 202 Accepted 2026-03-25 20:57:48,971 - lava_callback - INFO - Starting async job submit for node 69c1a9372b2b51e9ad97b187 2026-03-25 20:57:48,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:57:48,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9372b2b51e9ad97b187 HTTP/1.1" 200 None 2026-03-25 20:57:48,987 - lava_callback - DEBUG - Processing node 69c1a9372b2b51e9ad97b187: baseline-arm-clabbe 2026-03-25 20:57:48,987 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a9372b2b51e9ad97b187 2026-03-25 20:57:48,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:57:49,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9372b2b51e9ad97b187 HTTP/1.1" 200 None 2026-03-25 20:57:49,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:57:49,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 20:57:49,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:57:49,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a9372b2b51e9ad97b187 HTTP/1.1" 200 None 2026-03-25 20:57:49,054 - lava_callback - ERROR - Error processing callback for node 69c1a9372b2b51e9ad97b187: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:58:17,451 - lava_callback - INFO - Received callback for node 69c1a9592b2b51e9ad97b196 INFO: 172.21.0.1:45970 - "POST /node/69c1a9592b2b51e9ad97b196 HTTP/1.0" 202 Accepted 2026-03-25 20:58:17,456 - lava_callback - INFO - Starting async job submit for node 69c1a9592b2b51e9ad97b196 2026-03-25 20:58:17,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:58:17,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9592b2b51e9ad97b196 HTTP/1.1" 200 None 2026-03-25 20:58:17,481 - lava_callback - DEBUG - Processing node 69c1a9592b2b51e9ad97b196: baseline-arm-baylibre 2026-03-25 20:58:17,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a9592b2b51e9ad97b196 2026-03-25 20:58:17,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:58:17,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9592b2b51e9ad97b196 HTTP/1.1" 200 None 2026-03-25 20:58:17,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:58:17,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 20:58:17,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:58:17,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a9592b2b51e9ad97b196 HTTP/1.1" 200 None 2026-03-25 20:58:17,536 - lava_callback - ERROR - Error processing callback for node 69c1a9592b2b51e9ad97b196: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58148 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:58:57,345 - lava_callback - INFO - Received callback for node 69c1a9822b2b51e9ad97b1a7 INFO: 172.21.0.1:58154 - "POST /node/69c1a9822b2b51e9ad97b1a7 HTTP/1.0" 202 Accepted 2026-03-25 20:58:57,350 - lava_callback - INFO - Starting async job submit for node 69c1a9822b2b51e9ad97b1a7 2026-03-25 20:58:57,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:58:57,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9822b2b51e9ad97b1a7 HTTP/1.1" 200 None 2026-03-25 20:58:57,366 - lava_callback - DEBUG - Processing node 69c1a9822b2b51e9ad97b1a7: baseline-arm-baylibre 2026-03-25 20:58:57,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a9822b2b51e9ad97b1a7 2026-03-25 20:58:57,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:58:57,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9822b2b51e9ad97b1a7 HTTP/1.1" 200 None 2026-03-25 20:58:57,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:58:57,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 20:58:57,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:58:57,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a9822b2b51e9ad97b1a7 HTTP/1.1" 200 None 2026-03-25 20:58:57,425 - lava_callback - ERROR - Error processing callback for node 69c1a9822b2b51e9ad97b1a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59262 - "GET / HTTP/1.0" 200 OK 2026-03-25 20:59:37,403 - lava_callback - INFO - Received callback for node 69c1a9a92b2b51e9ad97b1b0 INFO: 172.21.0.1:59274 - "POST /node/69c1a9a92b2b51e9ad97b1b0 HTTP/1.0" 202 Accepted 2026-03-25 20:59:37,409 - lava_callback - INFO - Starting async job submit for node 69c1a9a92b2b51e9ad97b1b0 2026-03-25 20:59:37,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:59:37,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9a92b2b51e9ad97b1b0 HTTP/1.1" 200 None 2026-03-25 20:59:37,426 - lava_callback - DEBUG - Processing node 69c1a9a92b2b51e9ad97b1b0: baseline-arm-baylibre 2026-03-25 20:59:37,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a9a92b2b51e9ad97b1b0 2026-03-25 20:59:37,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:59:37,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9a92b2b51e9ad97b1b0 HTTP/1.1" 200 None 2026-03-25 20:59:37,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:59:37,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 20:59:37,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 20:59:37,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a9a92b2b51e9ad97b1b0 HTTP/1.1" 200 None 2026-03-25 20:59:37,482 - lava_callback - ERROR - Error processing callback for node 69c1a9a92b2b51e9ad97b1b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51680 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:00:17,472 - lava_callback - INFO - Received callback for node 69c1a9d12b2b51e9ad97b1bc INFO: 172.21.0.1:51692 - "POST /node/69c1a9d12b2b51e9ad97b1bc HTTP/1.0" 202 Accepted 2026-03-25 21:00:17,477 - lava_callback - INFO - Starting async job submit for node 69c1a9d12b2b51e9ad97b1bc 2026-03-25 21:00:17,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:00:17,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9d12b2b51e9ad97b1bc HTTP/1.1" 200 None 2026-03-25 21:00:17,493 - lava_callback - DEBUG - Processing node 69c1a9d12b2b51e9ad97b1bc: baseline-arm-baylibre 2026-03-25 21:00:17,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a9d12b2b51e9ad97b1bc 2026-03-25 21:00:17,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:00:17,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9d12b2b51e9ad97b1bc HTTP/1.1" 200 None 2026-03-25 21:00:17,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:00:17,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 21:00:17,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:00:17,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a9d12b2b51e9ad97b1bc HTTP/1.1" 200 None 2026-03-25 21:00:17,568 - lava_callback - ERROR - Error processing callback for node 69c1a9d12b2b51e9ad97b1bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32806 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:00:57,614 - lava_callback - INFO - Received callback for node 69c1a9fa2b2b51e9ad97b1cc INFO: 172.21.0.1:32808 - "POST /node/69c1a9fa2b2b51e9ad97b1cc HTTP/1.0" 202 Accepted 2026-03-25 21:00:57,620 - lava_callback - INFO - Starting async job submit for node 69c1a9fa2b2b51e9ad97b1cc 2026-03-25 21:00:57,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:00:57,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9fa2b2b51e9ad97b1cc HTTP/1.1" 200 None 2026-03-25 21:00:57,636 - lava_callback - DEBUG - Processing node 69c1a9fa2b2b51e9ad97b1cc: baseline-arm-baylibre 2026-03-25 21:00:57,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1a9fa2b2b51e9ad97b1cc 2026-03-25 21:00:57,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:00:57,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1a9fa2b2b51e9ad97b1cc HTTP/1.1" 200 None 2026-03-25 21:00:57,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:00:57,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 21:00:57,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:00:57,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1a9fa2b2b51e9ad97b1cc HTTP/1.1" 200 None 2026-03-25 21:00:57,692 - lava_callback - ERROR - Error processing callback for node 69c1a9fa2b2b51e9ad97b1cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:01:37,519 - lava_callback - INFO - Received callback for node 69c1aa212b2b51e9ad97b1d8 INFO: 172.21.0.1:58616 - "POST /node/69c1aa212b2b51e9ad97b1d8 HTTP/1.0" 202 Accepted 2026-03-25 21:01:37,524 - lava_callback - INFO - Starting async job submit for node 69c1aa212b2b51e9ad97b1d8 2026-03-25 21:01:37,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:01:37,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aa212b2b51e9ad97b1d8 HTTP/1.1" 200 None 2026-03-25 21:01:37,546 - lava_callback - DEBUG - Processing node 69c1aa212b2b51e9ad97b1d8: baseline-arm-baylibre 2026-03-25 21:01:37,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1aa212b2b51e9ad97b1d8 2026-03-25 21:01:37,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:01:37,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aa212b2b51e9ad97b1d8 HTTP/1.1" 200 None 2026-03-25 21:01:37,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:01:37,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 21:01:37,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:01:37,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1aa212b2b51e9ad97b1d8 HTTP/1.1" 200 None 2026-03-25 21:01:37,602 - lava_callback - ERROR - Error processing callback for node 69c1aa212b2b51e9ad97b1d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46352 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:02:09,358 - lava_callback - INFO - Received callback for node 69c1aa4d2b2b51e9ad97b1e6 INFO: 172.21.0.1:46358 - "POST /node/69c1aa4d2b2b51e9ad97b1e6 HTTP/1.0" 202 Accepted 2026-03-25 21:02:09,364 - lava_callback - INFO - Starting async job submit for node 69c1aa4d2b2b51e9ad97b1e6 2026-03-25 21:02:09,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:02:09,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aa4d2b2b51e9ad97b1e6 HTTP/1.1" 200 None 2026-03-25 21:02:09,379 - lava_callback - DEBUG - Processing node 69c1aa4d2b2b51e9ad97b1e6: baseline-arm-clabbe 2026-03-25 21:02:09,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1aa4d2b2b51e9ad97b1e6 2026-03-25 21:02:09,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:02:09,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aa4d2b2b51e9ad97b1e6 HTTP/1.1" 200 None 2026-03-25 21:02:09,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:02:09,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 21:02:09,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:02:09,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1aa4d2b2b51e9ad97b1e6 HTTP/1.1" 200 None 2026-03-25 21:02:09,440 - lava_callback - ERROR - Error processing callback for node 69c1aa4d2b2b51e9ad97b1e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:04:09,237 - lava_callback - INFO - Received callback for node 69c1aac62b2b51e9ad97b218 INFO: 172.21.0.1:55948 - "POST /node/69c1aac62b2b51e9ad97b218 HTTP/1.0" 202 Accepted 2026-03-25 21:04:09,242 - lava_callback - INFO - Starting async job submit for node 69c1aac62b2b51e9ad97b218 2026-03-25 21:04:09,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:04:09,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aac62b2b51e9ad97b218 HTTP/1.1" 200 None 2026-03-25 21:04:09,269 - lava_callback - DEBUG - Processing node 69c1aac62b2b51e9ad97b218: baseline-arm-clabbe 2026-03-25 21:04:09,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1aac62b2b51e9ad97b218 2026-03-25 21:04:09,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:04:09,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aac62b2b51e9ad97b218 HTTP/1.1" 200 None 2026-03-25 21:04:09,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:04:09,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 21:04:09,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:04:09,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1aac62b2b51e9ad97b218 HTTP/1.1" 200 None 2026-03-25 21:04:09,330 - lava_callback - ERROR - Error processing callback for node 69c1aac62b2b51e9ad97b218: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51260 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:05:09,284 - lava_callback - INFO - Received callback for node 69c1aaef2b2b51e9ad97b230 INFO: 172.21.0.1:51262 - "POST /node/69c1aaef2b2b51e9ad97b230 HTTP/1.0" 202 Accepted 2026-03-25 21:05:09,289 - lava_callback - INFO - Starting async job submit for node 69c1aaef2b2b51e9ad97b230 2026-03-25 21:05:09,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:05:09,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aaef2b2b51e9ad97b230 HTTP/1.1" 200 None 2026-03-25 21:05:09,310 - lava_callback - DEBUG - Processing node 69c1aaef2b2b51e9ad97b230: baseline-arm-clabbe 2026-03-25 21:05:09,311 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1aaef2b2b51e9ad97b230 2026-03-25 21:05:09,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:05:09,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aaef2b2b51e9ad97b230 HTTP/1.1" 200 None 2026-03-25 21:05:09,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:05:09,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 21:05:09,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:05:09,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1aaef2b2b51e9ad97b230 HTTP/1.1" 200 None 2026-03-25 21:05:09,373 - lava_callback - ERROR - Error processing callback for node 69c1aaef2b2b51e9ad97b230: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48556 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:05:49,248 - lava_callback - INFO - Received callback for node 69c1ab172b2b51e9ad97b238 INFO: 172.21.0.1:48560 - "POST /node/69c1ab172b2b51e9ad97b238 HTTP/1.0" 202 Accepted 2026-03-25 21:05:49,254 - lava_callback - INFO - Starting async job submit for node 69c1ab172b2b51e9ad97b238 2026-03-25 21:05:49,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:05:49,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ab172b2b51e9ad97b238 HTTP/1.1" 200 None 2026-03-25 21:05:49,274 - lava_callback - DEBUG - Processing node 69c1ab172b2b51e9ad97b238: baseline-arm-clabbe 2026-03-25 21:05:49,274 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ab172b2b51e9ad97b238 2026-03-25 21:05:49,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:05:49,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ab172b2b51e9ad97b238 HTTP/1.1" 200 None 2026-03-25 21:05:49,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:05:49,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 21:05:49,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:05:49,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ab172b2b51e9ad97b238 HTTP/1.1" 200 None 2026-03-25 21:05:49,333 - lava_callback - ERROR - Error processing callback for node 69c1ab172b2b51e9ad97b238: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:06:29,349 - lava_callback - INFO - Received callback for node 69c1ab402b2b51e9ad97b249 INFO: 172.21.0.1:44400 - "POST /node/69c1ab402b2b51e9ad97b249 HTTP/1.0" 202 Accepted 2026-03-25 21:06:29,355 - lava_callback - INFO - Starting async job submit for node 69c1ab402b2b51e9ad97b249 2026-03-25 21:06:29,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:06:29,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ab402b2b51e9ad97b249 HTTP/1.1" 200 None 2026-03-25 21:06:29,371 - lava_callback - DEBUG - Processing node 69c1ab402b2b51e9ad97b249: baseline-arm-clabbe 2026-03-25 21:06:29,371 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ab402b2b51e9ad97b249 2026-03-25 21:06:29,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:06:29,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ab402b2b51e9ad97b249 HTTP/1.1" 200 None 2026-03-25 21:06:29,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:06:29,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 21:06:29,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:06:29,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ab402b2b51e9ad97b249 HTTP/1.1" 200 None 2026-03-25 21:06:29,437 - lava_callback - ERROR - Error processing callback for node 69c1ab402b2b51e9ad97b249: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52080 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:07:09,319 - lava_callback - INFO - Received callback for node 69c1ab682b2b51e9ad97b25b INFO: 172.21.0.1:52088 - "POST /node/69c1ab682b2b51e9ad97b25b HTTP/1.0" 202 Accepted 2026-03-25 21:07:09,324 - lava_callback - INFO - Starting async job submit for node 69c1ab682b2b51e9ad97b25b 2026-03-25 21:07:09,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:07:09,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ab682b2b51e9ad97b25b HTTP/1.1" 200 None 2026-03-25 21:07:09,342 - lava_callback - DEBUG - Processing node 69c1ab682b2b51e9ad97b25b: baseline-arm-clabbe 2026-03-25 21:07:09,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ab682b2b51e9ad97b25b 2026-03-25 21:07:09,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:07:09,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ab682b2b51e9ad97b25b HTTP/1.1" 200 None 2026-03-25 21:07:09,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:07:09,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 21:07:09,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:07:09,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ab682b2b51e9ad97b25b HTTP/1.1" 200 None 2026-03-25 21:07:09,403 - lava_callback - ERROR - Error processing callback for node 69c1ab682b2b51e9ad97b25b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33764 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:07:49,371 - lava_callback - INFO - Received callback for node 69c1ab8f2b2b51e9ad97b264 INFO: 172.21.0.1:33780 - "POST /node/69c1ab8f2b2b51e9ad97b264 HTTP/1.0" 202 Accepted 2026-03-25 21:07:49,376 - lava_callback - INFO - Starting async job submit for node 69c1ab8f2b2b51e9ad97b264 2026-03-25 21:07:49,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:07:49,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ab8f2b2b51e9ad97b264 HTTP/1.1" 200 None 2026-03-25 21:07:49,407 - lava_callback - DEBUG - Processing node 69c1ab8f2b2b51e9ad97b264: baseline-arm-clabbe 2026-03-25 21:07:49,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ab8f2b2b51e9ad97b264 2026-03-25 21:07:49,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:07:49,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ab8f2b2b51e9ad97b264 HTTP/1.1" 200 None 2026-03-25 21:07:49,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:07:49,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 21:07:49,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:07:49,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ab8f2b2b51e9ad97b264 HTTP/1.1" 200 None 2026-03-25 21:07:49,469 - lava_callback - ERROR - Error processing callback for node 69c1ab8f2b2b51e9ad97b264: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32968 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:08:29,348 - lava_callback - INFO - Received callback for node 69c1abb72b2b51e9ad97b26f INFO: 172.21.0.1:32978 - "POST /node/69c1abb72b2b51e9ad97b26f HTTP/1.0" 202 Accepted 2026-03-25 21:08:29,355 - lava_callback - INFO - Starting async job submit for node 69c1abb72b2b51e9ad97b26f 2026-03-25 21:08:29,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:29,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1abb72b2b51e9ad97b26f HTTP/1.1" 200 None 2026-03-25 21:08:29,381 - lava_callback - DEBUG - Processing node 69c1abb72b2b51e9ad97b26f: baseline-arm-clabbe 2026-03-25 21:08:29,381 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1abb72b2b51e9ad97b26f 2026-03-25 21:08:29,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:29,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1abb72b2b51e9ad97b26f HTTP/1.1" 200 None 2026-03-25 21:08:29,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:29,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-25 21:08:29,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:29,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1abb72b2b51e9ad97b26f HTTP/1.1" 200 None 2026-03-25 21:08:29,433 - lava_callback - ERROR - Error processing callback for node 69c1abb72b2b51e9ad97b26f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-25 21:08:31,691 - lava_callback - INFO - Received callback for node 69c433a9944faaf0e7f6167d INFO: 172.21.0.1:38488 - "POST /node/69c433a9944faaf0e7f6167d HTTP/1.0" 202 Accepted 2026-03-25 21:08:31,737 - lava_callback - INFO - Starting async job submit for node 69c433a9944faaf0e7f6167d 2026-03-25 21:08:31,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:31,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c433a9944faaf0e7f6167d HTTP/1.1" 200 None 2026-03-25 21:08:31,777 - lava_callback - DEBUG - Processing node 69c433a9944faaf0e7f6167d: baseline-arm-pengutronix 2026-03-25 21:08:31,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 21:08:32,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 21:08:32,104 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c433a9944faaf0e7f6167d/log.txt.gz 2026-03-25 21:08:32,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 21:08:32,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 21:08:32,395 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c433a9944faaf0e7f6167d/lava-logs.yaml 2026-03-25 21:08:32,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 21:08:32,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 21:08:32,536 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c433a9944faaf0e7f6167d/lava_callback.json.gz DEBUG: Setup failed for 69c433a9944faaf0e7f6167d. Transitting job node result: incomplete -> fail 2026-03-25 21:08:32,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:32,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c433a9944faaf0e7f6167d HTTP/1.1" 200 None 2026-03-25 21:08:32,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:32,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-25 21:08:32,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:32,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c433a9944faaf0e7f6167d HTTP/1.1" 200 None 2026-03-25 21:08:32,709 - lava_callback - INFO - Completed processing callback for node 69c433a9944faaf0e7f6167d INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:08:43,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:08:43,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:09:09,465 - lava_callback - INFO - Received callback for node 69c1abe02b2b51e9ad97b281 INFO: 172.21.0.1:55334 - "POST /node/69c1abe02b2b51e9ad97b281 HTTP/1.0" 202 Accepted 2026-03-25 21:09:09,470 - lava_callback - INFO - Starting async job submit for node 69c1abe02b2b51e9ad97b281 2026-03-25 21:09:09,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:09:09,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1abe02b2b51e9ad97b281 HTTP/1.1" 200 None 2026-03-25 21:09:09,486 - lava_callback - DEBUG - Processing node 69c1abe02b2b51e9ad97b281: baseline-arm-clabbe 2026-03-25 21:09:09,486 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1abe02b2b51e9ad97b281 2026-03-25 21:09:09,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:09:09,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1abe02b2b51e9ad97b281 HTTP/1.1" 200 None 2026-03-25 21:09:09,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:09:09,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 21:09:09,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:09:09,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1abe02b2b51e9ad97b281 HTTP/1.1" 200 None 2026-03-25 21:09:09,552 - lava_callback - ERROR - Error processing callback for node 69c1abe02b2b51e9ad97b281: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:09:49,393 - lava_callback - INFO - Received callback for node 69c1ac082b2b51e9ad97b289 INFO: 172.21.0.1:48860 - "POST /node/69c1ac082b2b51e9ad97b289 HTTP/1.0" 202 Accepted 2026-03-25 21:09:49,398 - lava_callback - INFO - Starting async job submit for node 69c1ac082b2b51e9ad97b289 2026-03-25 21:09:49,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:09:49,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ac082b2b51e9ad97b289 HTTP/1.1" 200 None 2026-03-25 21:09:49,415 - lava_callback - DEBUG - Processing node 69c1ac082b2b51e9ad97b289: baseline-arm-clabbe 2026-03-25 21:09:49,415 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ac082b2b51e9ad97b289 2026-03-25 21:09:49,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:09:49,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ac082b2b51e9ad97b289 HTTP/1.1" 200 None 2026-03-25 21:09:49,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:09:49,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 21:09:49,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:09:49,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ac082b2b51e9ad97b289 HTTP/1.1" 200 None 2026-03-25 21:09:49,467 - lava_callback - ERROR - Error processing callback for node 69c1ac082b2b51e9ad97b289: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38400 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:18:58,803 - lava_callback - INFO - Received callback for node 69c1ae332b2b51e9ad97b2e5 INFO: 172.21.0.1:38406 - "POST /node/69c1ae332b2b51e9ad97b2e5 HTTP/1.0" 202 Accepted 2026-03-25 21:18:58,808 - lava_callback - INFO - Starting async job submit for node 69c1ae332b2b51e9ad97b2e5 2026-03-25 21:18:58,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:18:58,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ae332b2b51e9ad97b2e5 HTTP/1.1" 200 None 2026-03-25 21:18:58,824 - lava_callback - DEBUG - Processing node 69c1ae332b2b51e9ad97b2e5: baseline-arm64-baylibre 2026-03-25 21:18:58,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ae332b2b51e9ad97b2e5 2026-03-25 21:18:58,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:18:58,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ae332b2b51e9ad97b2e5 HTTP/1.1" 200 None 2026-03-25 21:18:58,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:18:58,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:18:58,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:18:58,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ae332b2b51e9ad97b2e5 HTTP/1.1" 200 None 2026-03-25 21:18:58,876 - lava_callback - ERROR - Error processing callback for node 69c1ae332b2b51e9ad97b2e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:20:18,573 - lava_callback - INFO - Received callback for node 69c1ae8a2b2b51e9ad97b2f3 INFO: 172.21.0.1:48514 - "POST /node/69c1ae8a2b2b51e9ad97b2f3 HTTP/1.0" 202 Accepted 2026-03-25 21:20:18,579 - lava_callback - INFO - Starting async job submit for node 69c1ae8a2b2b51e9ad97b2f3 2026-03-25 21:20:18,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:20:18,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ae8a2b2b51e9ad97b2f3 HTTP/1.1" 200 None 2026-03-25 21:20:18,595 - lava_callback - DEBUG - Processing node 69c1ae8a2b2b51e9ad97b2f3: baseline-arm64-baylibre 2026-03-25 21:20:18,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ae8a2b2b51e9ad97b2f3 2026-03-25 21:20:18,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:20:18,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ae8a2b2b51e9ad97b2f3 HTTP/1.1" 200 None 2026-03-25 21:20:18,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:20:18,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:20:18,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:20:18,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ae8a2b2b51e9ad97b2f3 HTTP/1.1" 200 None 2026-03-25 21:20:18,655 - lava_callback - ERROR - Error processing callback for node 69c1ae8a2b2b51e9ad97b2f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43276 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:21:38,655 - lava_callback - INFO - Received callback for node 69c1aee02b2b51e9ad97b2fc INFO: 172.21.0.1:43282 - "POST /node/69c1aee02b2b51e9ad97b2fc HTTP/1.0" 202 Accepted 2026-03-25 21:21:38,661 - lava_callback - INFO - Starting async job submit for node 69c1aee02b2b51e9ad97b2fc 2026-03-25 21:21:38,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:21:38,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aee02b2b51e9ad97b2fc HTTP/1.1" 200 None 2026-03-25 21:21:38,699 - lava_callback - DEBUG - Processing node 69c1aee02b2b51e9ad97b2fc: baseline-arm64-baylibre 2026-03-25 21:21:38,699 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1aee02b2b51e9ad97b2fc 2026-03-25 21:21:38,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:21:38,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1aee02b2b51e9ad97b2fc HTTP/1.1" 200 None 2026-03-25 21:21:38,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:21:38,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:21:38,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:21:38,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1aee02b2b51e9ad97b2fc HTTP/1.1" 200 None 2026-03-25 21:21:38,750 - lava_callback - ERROR - Error processing callback for node 69c1aee02b2b51e9ad97b2fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36116 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:24:38,882 - lava_callback - INFO - Received callback for node 69c1af892b2b51e9ad97b31a INFO: 172.21.0.1:36122 - "POST /node/69c1af892b2b51e9ad97b31a HTTP/1.0" 202 Accepted 2026-03-25 21:24:38,892 - lava_callback - INFO - Starting async job submit for node 69c1af892b2b51e9ad97b31a 2026-03-25 21:24:38,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:24:38,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1af892b2b51e9ad97b31a HTTP/1.1" 200 None 2026-03-25 21:24:38,918 - lava_callback - DEBUG - Processing node 69c1af892b2b51e9ad97b31a: baseline-arm64-baylibre 2026-03-25 21:24:38,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1af892b2b51e9ad97b31a 2026-03-25 21:24:38,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:24:38,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1af892b2b51e9ad97b31a HTTP/1.1" 200 None 2026-03-25 21:24:38,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:24:38,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:24:38,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:24:38,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1af892b2b51e9ad97b31a HTTP/1.1" 200 None 2026-03-25 21:24:38,974 - lava_callback - ERROR - Error processing callback for node 69c1af892b2b51e9ad97b31a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:25:58,869 - lava_callback - INFO - Received callback for node 69c1afe02b2b51e9ad97b327 INFO: 172.21.0.1:60844 - "POST /node/69c1afe02b2b51e9ad97b327 HTTP/1.0" 202 Accepted 2026-03-25 21:25:58,874 - lava_callback - INFO - Starting async job submit for node 69c1afe02b2b51e9ad97b327 2026-03-25 21:25:58,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:25:58,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1afe02b2b51e9ad97b327 HTTP/1.1" 200 None 2026-03-25 21:25:58,901 - lava_callback - DEBUG - Processing node 69c1afe02b2b51e9ad97b327: baseline-arm64-baylibre 2026-03-25 21:25:58,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1afe02b2b51e9ad97b327 2026-03-25 21:25:58,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:25:58,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1afe02b2b51e9ad97b327 HTTP/1.1" 200 None 2026-03-25 21:25:58,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:25:58,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:25:58,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:25:58,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1afe02b2b51e9ad97b327 HTTP/1.1" 200 None 2026-03-25 21:25:58,971 - lava_callback - ERROR - Error processing callback for node 69c1afe02b2b51e9ad97b327: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56500 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:27:39,201 - lava_callback - INFO - Received callback for node 69c1b0362b2b51e9ad97b335 INFO: 172.21.0.1:56516 - "POST /node/69c1b0362b2b51e9ad97b335 HTTP/1.0" 202 Accepted 2026-03-25 21:27:39,207 - lava_callback - INFO - Starting async job submit for node 69c1b0362b2b51e9ad97b335 2026-03-25 21:27:39,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:27:39,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b0362b2b51e9ad97b335 HTTP/1.1" 200 None 2026-03-25 21:27:39,227 - lava_callback - DEBUG - Processing node 69c1b0362b2b51e9ad97b335: baseline-arm64-baylibre 2026-03-25 21:27:39,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b0362b2b51e9ad97b335 2026-03-25 21:27:39,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:27:39,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b0362b2b51e9ad97b335 HTTP/1.1" 200 None 2026-03-25 21:27:39,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:27:39,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:27:39,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:27:39,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b0362b2b51e9ad97b335 HTTP/1.1" 200 None 2026-03-25 21:27:39,294 - lava_callback - ERROR - Error processing callback for node 69c1b0362b2b51e9ad97b335: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48420 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:28:50,302 - lava_callback - INFO - Received callback for node 69c1b0842b2b51e9ad97b33b INFO: 172.21.0.1:39582 - "POST /node/69c1b0842b2b51e9ad97b33b HTTP/1.0" 202 Accepted 2026-03-25 21:28:50,308 - lava_callback - INFO - Starting async job submit for node 69c1b0842b2b51e9ad97b33b 2026-03-25 21:28:50,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:28:50,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b0842b2b51e9ad97b33b HTTP/1.1" 200 None 2026-03-25 21:28:50,325 - lava_callback - DEBUG - Processing node 69c1b0842b2b51e9ad97b33b: baseline-arm-clabbe 2026-03-25 21:28:50,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b0842b2b51e9ad97b33b 2026-03-25 21:28:50,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:28:50,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b0842b2b51e9ad97b33b HTTP/1.1" 200 None 2026-03-25 21:28:50,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:28:50,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-25 21:28:50,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:28:50,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b0842b2b51e9ad97b33b HTTP/1.1" 200 None 2026-03-25 21:28:50,383 - lava_callback - ERROR - Error processing callback for node 69c1b0842b2b51e9ad97b33b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60622 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:29:22,033 - lava_callback - INFO - Received callback for node 69c411ae944faaf0e7f60e58 INFO: 172.21.0.1:44296 - "POST /node/69c411ae944faaf0e7f60e58 HTTP/1.0" 202 Accepted 2026-03-25 21:29:22,039 - lava_callback - INFO - Starting async job submit for node 69c411ae944faaf0e7f60e58 2026-03-25 21:29:22,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:22,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411ae944faaf0e7f60e58 HTTP/1.1" 200 None 2026-03-25 21:29:22,084 - lava_callback - DEBUG - Processing node 69c411ae944faaf0e7f60e58: baseline-arm64-broonie 2026-03-25 21:29:22,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 21:29:22,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 21:29:22,526 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411ae944faaf0e7f60e58/log.txt.gz 2026-03-25 21:29:22,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 21:29:22,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 21:29:22,899 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411ae944faaf0e7f60e58/lava-logs.yaml 2026-03-25 21:29:22,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-25 21:29:23,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-25 21:29:23,066 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c411ae944faaf0e7f60e58/lava_callback.json.gz 2026-03-25 21:29:23,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:23,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411ae944faaf0e7f60e58 HTTP/1.1" 200 None 2026-03-25 21:29:23,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:23,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-25 21:29:23,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:23,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411ae944faaf0e7f60e58 HTTP/1.1" 200 None 2026-03-25 21:29:23,151 - lava_callback - INFO - Completed processing callback for node 69c411ae944faaf0e7f60e58 INFO: 172.21.0.1:44306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58820 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:29:43,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:43,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60948 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:29:50,301 - lava_callback - INFO - Received callback for node 69c1b0bb2b2b51e9ad97b34b INFO: 172.21.0.1:33130 - "POST /node/69c1b0bb2b2b51e9ad97b34b HTTP/1.0" 202 Accepted 2026-03-25 21:29:50,307 - lava_callback - INFO - Starting async job submit for node 69c1b0bb2b2b51e9ad97b34b 2026-03-25 21:29:50,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:50,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b0bb2b2b51e9ad97b34b HTTP/1.1" 200 None 2026-03-25 21:29:50,323 - lava_callback - DEBUG - Processing node 69c1b0bb2b2b51e9ad97b34b: baseline-arm64-clabbe 2026-03-25 21:29:50,323 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b0bb2b2b51e9ad97b34b 2026-03-25 21:29:50,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:50,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b0bb2b2b51e9ad97b34b HTTP/1.1" 200 None 2026-03-25 21:29:50,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:50,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:29:50,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:29:50,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b0bb2b2b51e9ad97b34b HTTP/1.1" 200 None 2026-03-25 21:29:50,380 - lava_callback - ERROR - Error processing callback for node 69c1b0bb2b2b51e9ad97b34b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:31:10,329 - lava_callback - INFO - Received callback for node 69c1b1102b2b51e9ad97b358 INFO: 172.21.0.1:41978 - "POST /node/69c1b1102b2b51e9ad97b358 HTTP/1.0" 202 Accepted 2026-03-25 21:31:10,334 - lava_callback - INFO - Starting async job submit for node 69c1b1102b2b51e9ad97b358 2026-03-25 21:31:10,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:31:10,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b1102b2b51e9ad97b358 HTTP/1.1" 200 None 2026-03-25 21:31:10,363 - lava_callback - DEBUG - Processing node 69c1b1102b2b51e9ad97b358: baseline-arm64-clabbe 2026-03-25 21:31:10,363 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b1102b2b51e9ad97b358 2026-03-25 21:31:10,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:31:10,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b1102b2b51e9ad97b358 HTTP/1.1" 200 None 2026-03-25 21:31:10,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:31:10,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:31:10,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:31:10,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b1102b2b51e9ad97b358 HTTP/1.1" 200 None 2026-03-25 21:31:10,420 - lava_callback - ERROR - Error processing callback for node 69c1b1102b2b51e9ad97b358: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:32:30,364 - lava_callback - INFO - Received callback for node 69c1b1652b2b51e9ad97b36a INFO: 172.21.0.1:52530 - "POST /node/69c1b1652b2b51e9ad97b36a HTTP/1.0" 202 Accepted 2026-03-25 21:32:30,370 - lava_callback - INFO - Starting async job submit for node 69c1b1652b2b51e9ad97b36a 2026-03-25 21:32:30,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:32:30,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b1652b2b51e9ad97b36a HTTP/1.1" 200 None 2026-03-25 21:32:30,395 - lava_callback - DEBUG - Processing node 69c1b1652b2b51e9ad97b36a: baseline-arm64-clabbe 2026-03-25 21:32:30,395 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b1652b2b51e9ad97b36a 2026-03-25 21:32:30,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:32:30,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b1652b2b51e9ad97b36a HTTP/1.1" 200 None 2026-03-25 21:32:30,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:32:30,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:32:30,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:32:30,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b1652b2b51e9ad97b36a HTTP/1.1" 200 None 2026-03-25 21:32:30,459 - lava_callback - ERROR - Error processing callback for node 69c1b1652b2b51e9ad97b36a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:34:10,491 - lava_callback - INFO - Received callback for node 69c1b1bd2b2b51e9ad97b378 INFO: 172.21.0.1:38974 - "POST /node/69c1b1bd2b2b51e9ad97b378 HTTP/1.0" 202 Accepted 2026-03-25 21:34:10,497 - lava_callback - INFO - Starting async job submit for node 69c1b1bd2b2b51e9ad97b378 2026-03-25 21:34:10,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:34:10,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b1bd2b2b51e9ad97b378 HTTP/1.1" 200 None 2026-03-25 21:34:10,515 - lava_callback - DEBUG - Processing node 69c1b1bd2b2b51e9ad97b378: baseline-arm64-clabbe 2026-03-25 21:34:10,515 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b1bd2b2b51e9ad97b378 2026-03-25 21:34:10,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:34:10,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b1bd2b2b51e9ad97b378 HTTP/1.1" 200 None 2026-03-25 21:34:10,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:34:10,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:34:10,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:34:10,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b1bd2b2b51e9ad97b378 HTTP/1.1" 200 None 2026-03-25 21:34:10,572 - lava_callback - ERROR - Error processing callback for node 69c1b1bd2b2b51e9ad97b378: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:35:30,537 - lava_callback - INFO - Received callback for node 69c1b2152b2b51e9ad97b382 INFO: 172.21.0.1:59156 - "POST /node/69c1b2152b2b51e9ad97b382 HTTP/1.0" 202 Accepted 2026-03-25 21:35:30,542 - lava_callback - INFO - Starting async job submit for node 69c1b2152b2b51e9ad97b382 2026-03-25 21:35:30,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:35:30,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b2152b2b51e9ad97b382 HTTP/1.1" 200 None 2026-03-25 21:35:30,558 - lava_callback - DEBUG - Processing node 69c1b2152b2b51e9ad97b382: baseline-arm64-clabbe 2026-03-25 21:35:30,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b2152b2b51e9ad97b382 2026-03-25 21:35:30,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:35:30,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b2152b2b51e9ad97b382 HTTP/1.1" 200 None 2026-03-25 21:35:30,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:35:30,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:35:30,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:35:30,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b2152b2b51e9ad97b382 HTTP/1.1" 200 None 2026-03-25 21:35:30,617 - lava_callback - ERROR - Error processing callback for node 69c1b2152b2b51e9ad97b382: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53102 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:36:50,603 - lava_callback - INFO - Received callback for node 69c1b26b2b2b51e9ad97b38f INFO: 172.21.0.1:48780 - "POST /node/69c1b26b2b2b51e9ad97b38f HTTP/1.0" 202 Accepted 2026-03-25 21:36:50,610 - lava_callback - INFO - Starting async job submit for node 69c1b26b2b2b51e9ad97b38f 2026-03-25 21:36:50,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:36:50,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b26b2b2b51e9ad97b38f HTTP/1.1" 200 None 2026-03-25 21:36:50,626 - lava_callback - DEBUG - Processing node 69c1b26b2b2b51e9ad97b38f: baseline-arm64-clabbe 2026-03-25 21:36:50,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b26b2b2b51e9ad97b38f 2026-03-25 21:36:50,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:36:50,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b26b2b2b51e9ad97b38f HTTP/1.1" 200 None 2026-03-25 21:36:50,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:36:50,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-25 21:36:50,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:36:50,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b26b2b2b51e9ad97b38f HTTP/1.1" 200 None 2026-03-25 21:36:50,685 - lava_callback - ERROR - Error processing callback for node 69c1b26b2b2b51e9ad97b38f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK 2026-03-25 21:58:20,802 - lava_callback - INFO - Received callback for node 69c1b77a2b2b51e9ad97b3df INFO: 172.21.0.1:39434 - "POST /node/69c1b77a2b2b51e9ad97b3df HTTP/1.0" 202 Accepted 2026-03-25 21:58:20,807 - lava_callback - INFO - Starting async job submit for node 69c1b77a2b2b51e9ad97b3df 2026-03-25 21:58:20,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:58:20,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b77a2b2b51e9ad97b3df HTTP/1.1" 200 None 2026-03-25 21:58:20,825 - lava_callback - DEBUG - Processing node 69c1b77a2b2b51e9ad97b3df: baseline-arm64-baylibre 2026-03-25 21:58:20,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b77a2b2b51e9ad97b3df 2026-03-25 21:58:20,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:58:20,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b77a2b2b51e9ad97b3df HTTP/1.1" 200 None 2026-03-25 21:58:20,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:58:20,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 21:58:20,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 21:58:20,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b77a2b2b51e9ad97b3df HTTP/1.1" 200 None 2026-03-25 21:58:20,886 - lava_callback - ERROR - Error processing callback for node 69c1b77a2b2b51e9ad97b3df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:00:00,725 - lava_callback - INFO - Received callback for node 69c1b7d02b2b51e9ad97b3ef INFO: 172.21.0.1:43144 - "POST /node/69c1b7d02b2b51e9ad97b3ef HTTP/1.0" 202 Accepted 2026-03-25 22:00:00,731 - lava_callback - INFO - Starting async job submit for node 69c1b7d02b2b51e9ad97b3ef 2026-03-25 22:00:00,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:00:00,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b7d02b2b51e9ad97b3ef HTTP/1.1" 200 None 2026-03-25 22:00:00,747 - lava_callback - DEBUG - Processing node 69c1b7d02b2b51e9ad97b3ef: baseline-arm64-baylibre 2026-03-25 22:00:00,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b7d02b2b51e9ad97b3ef 2026-03-25 22:00:00,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:00:00,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b7d02b2b51e9ad97b3ef HTTP/1.1" 200 None 2026-03-25 22:00:00,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:00:00,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:00:00,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:00:00,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b7d02b2b51e9ad97b3ef HTTP/1.1" 200 None 2026-03-25 22:00:00,820 - lava_callback - ERROR - Error processing callback for node 69c1b7d02b2b51e9ad97b3ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:02:20,841 - lava_callback - INFO - Received callback for node 69c1b8572b2b51e9ad97b405 INFO: 172.21.0.1:50120 - "POST /node/69c1b8572b2b51e9ad97b405 HTTP/1.0" 202 Accepted 2026-03-25 22:02:20,847 - lava_callback - INFO - Starting async job submit for node 69c1b8572b2b51e9ad97b405 2026-03-25 22:02:20,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:02:20,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b8572b2b51e9ad97b405 HTTP/1.1" 200 None 2026-03-25 22:02:20,862 - lava_callback - DEBUG - Processing node 69c1b8572b2b51e9ad97b405: baseline-arm64-baylibre 2026-03-25 22:02:20,863 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b8572b2b51e9ad97b405 2026-03-25 22:02:20,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:02:20,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b8572b2b51e9ad97b405 HTTP/1.1" 200 None 2026-03-25 22:02:20,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:02:20,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:02:20,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:02:20,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b8572b2b51e9ad97b405 HTTP/1.1" 200 None 2026-03-25 22:02:20,965 - lava_callback - ERROR - Error processing callback for node 69c1b8572b2b51e9ad97b405: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38664 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:03:40,928 - lava_callback - INFO - Received callback for node 69c1b8af2b2b51e9ad97b41b INFO: 172.21.0.1:49750 - "POST /node/69c1b8af2b2b51e9ad97b41b HTTP/1.0" 202 Accepted 2026-03-25 22:03:40,933 - lava_callback - INFO - Starting async job submit for node 69c1b8af2b2b51e9ad97b41b 2026-03-25 22:03:40,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:03:40,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b8af2b2b51e9ad97b41b HTTP/1.1" 200 None 2026-03-25 22:03:40,949 - lava_callback - DEBUG - Processing node 69c1b8af2b2b51e9ad97b41b: baseline-arm64-baylibre 2026-03-25 22:03:40,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b8af2b2b51e9ad97b41b 2026-03-25 22:03:40,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:03:40,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b8af2b2b51e9ad97b41b HTTP/1.1" 200 None 2026-03-25 22:03:40,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:03:40,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:03:40,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:03:41,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b8af2b2b51e9ad97b41b HTTP/1.1" 200 None 2026-03-25 22:03:41,007 - lava_callback - ERROR - Error processing callback for node 69c1b8af2b2b51e9ad97b41b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33670 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:05:01,030 - lava_callback - INFO - Received callback for node 69c1b9072b2b51e9ad97b42f INFO: 172.21.0.1:36156 - "POST /node/69c1b9072b2b51e9ad97b42f HTTP/1.0" 202 Accepted 2026-03-25 22:05:01,036 - lava_callback - INFO - Starting async job submit for node 69c1b9072b2b51e9ad97b42f 2026-03-25 22:05:01,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:05:01,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b9072b2b51e9ad97b42f HTTP/1.1" 200 None 2026-03-25 22:05:01,073 - lava_callback - DEBUG - Processing node 69c1b9072b2b51e9ad97b42f: baseline-arm64-baylibre 2026-03-25 22:05:01,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b9072b2b51e9ad97b42f 2026-03-25 22:05:01,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:05:01,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b9072b2b51e9ad97b42f HTTP/1.1" 200 None 2026-03-25 22:05:01,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:05:01,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:05:01,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:05:01,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b9072b2b51e9ad97b42f HTTP/1.1" 200 None 2026-03-25 22:05:01,128 - lava_callback - ERROR - Error processing callback for node 69c1b9072b2b51e9ad97b42f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42622 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:06:31,841 - lava_callback - INFO - Received callback for node 69c1b9612b2b51e9ad97b442 INFO: 172.21.0.1:39520 - "POST /node/69c1b9612b2b51e9ad97b442 HTTP/1.0" 202 Accepted 2026-03-25 22:06:31,848 - lava_callback - INFO - Starting async job submit for node 69c1b9612b2b51e9ad97b442 2026-03-25 22:06:31,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:06:31,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b9612b2b51e9ad97b442 HTTP/1.1" 200 None 2026-03-25 22:06:31,865 - lava_callback - DEBUG - Processing node 69c1b9612b2b51e9ad97b442: baseline-arm64-clabbe 2026-03-25 22:06:31,865 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b9612b2b51e9ad97b442 2026-03-25 22:06:31,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:06:31,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b9612b2b51e9ad97b442 HTTP/1.1" 200 None 2026-03-25 22:06:31,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:06:31,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:06:31,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:06:31,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b9612b2b51e9ad97b442 HTTP/1.1" 200 None 2026-03-25 22:06:31,932 - lava_callback - ERROR - Error processing callback for node 69c1b9612b2b51e9ad97b442: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55918 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:08:11,784 - lava_callback - INFO - Received callback for node 69c1b9b62b2b51e9ad97b457 INFO: 172.21.0.1:43778 - "POST /node/69c1b9b62b2b51e9ad97b457 HTTP/1.0" 202 Accepted 2026-03-25 22:08:11,789 - lava_callback - INFO - Starting async job submit for node 69c1b9b62b2b51e9ad97b457 2026-03-25 22:08:11,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:08:11,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b9b62b2b51e9ad97b457 HTTP/1.1" 200 None 2026-03-25 22:08:11,805 - lava_callback - DEBUG - Processing node 69c1b9b62b2b51e9ad97b457: baseline-arm64-clabbe 2026-03-25 22:08:11,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1b9b62b2b51e9ad97b457 2026-03-25 22:08:11,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:08:11,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1b9b62b2b51e9ad97b457 HTTP/1.1" 200 None 2026-03-25 22:08:11,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:08:11,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:08:11,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:08:11,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1b9b62b2b51e9ad97b457 HTTP/1.1" 200 None 2026-03-25 22:08:11,863 - lava_callback - ERROR - Error processing callback for node 69c1b9b62b2b51e9ad97b457: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:09:31,839 - lava_callback - INFO - Received callback for node 69c1ba0e2b2b51e9ad97b465 INFO: 172.21.0.1:45768 - "POST /node/69c1ba0e2b2b51e9ad97b465 HTTP/1.0" 202 Accepted 2026-03-25 22:09:31,844 - lava_callback - INFO - Starting async job submit for node 69c1ba0e2b2b51e9ad97b465 2026-03-25 22:09:31,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:09:31,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ba0e2b2b51e9ad97b465 HTTP/1.1" 200 None 2026-03-25 22:09:31,860 - lava_callback - DEBUG - Processing node 69c1ba0e2b2b51e9ad97b465: baseline-arm64-clabbe 2026-03-25 22:09:31,860 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ba0e2b2b51e9ad97b465 2026-03-25 22:09:31,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:09:31,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ba0e2b2b51e9ad97b465 HTTP/1.1" 200 None 2026-03-25 22:09:31,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:09:31,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:09:31,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:09:31,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ba0e2b2b51e9ad97b465 HTTP/1.1" 200 None 2026-03-25 22:09:31,921 - lava_callback - ERROR - Error processing callback for node 69c1ba0e2b2b51e9ad97b465: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:10:51,861 - lava_callback - INFO - Received callback for node 69c1ba682b2b51e9ad97b47b INFO: 172.21.0.1:41736 - "POST /node/69c1ba682b2b51e9ad97b47b HTTP/1.0" 202 Accepted 2026-03-25 22:10:51,867 - lava_callback - INFO - Starting async job submit for node 69c1ba682b2b51e9ad97b47b 2026-03-25 22:10:51,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:10:51,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ba682b2b51e9ad97b47b HTTP/1.1" 200 None 2026-03-25 22:10:51,883 - lava_callback - DEBUG - Processing node 69c1ba682b2b51e9ad97b47b: baseline-arm64-clabbe 2026-03-25 22:10:51,883 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ba682b2b51e9ad97b47b 2026-03-25 22:10:51,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:10:51,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ba682b2b51e9ad97b47b HTTP/1.1" 200 None 2026-03-25 22:10:51,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:10:51,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:10:51,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:10:51,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ba682b2b51e9ad97b47b HTTP/1.1" 200 None 2026-03-25 22:10:51,934 - lava_callback - ERROR - Error processing callback for node 69c1ba682b2b51e9ad97b47b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60534 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:12:31,922 - lava_callback - INFO - Received callback for node 69c1bac02b2b51e9ad97b48e INFO: 172.21.0.1:36146 - "POST /node/69c1bac02b2b51e9ad97b48e HTTP/1.0" 202 Accepted 2026-03-25 22:12:31,928 - lava_callback - INFO - Starting async job submit for node 69c1bac02b2b51e9ad97b48e 2026-03-25 22:12:31,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:12:31,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1bac02b2b51e9ad97b48e HTTP/1.1" 200 None 2026-03-25 22:12:31,947 - lava_callback - DEBUG - Processing node 69c1bac02b2b51e9ad97b48e: baseline-arm64-clabbe 2026-03-25 22:12:31,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1bac02b2b51e9ad97b48e 2026-03-25 22:12:31,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:12:31,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1bac02b2b51e9ad97b48e HTTP/1.1" 200 None 2026-03-25 22:12:31,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:12:31,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:12:31,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:12:32,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1bac02b2b51e9ad97b48e HTTP/1.1" 200 None 2026-03-25 22:12:32,007 - lava_callback - ERROR - Error processing callback for node 69c1bac02b2b51e9ad97b48e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59876 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:13:51,964 - lava_callback - INFO - Received callback for node 69c1bb172b2b51e9ad97b4a0 INFO: 172.21.0.1:48520 - "POST /node/69c1bb172b2b51e9ad97b4a0 HTTP/1.0" 202 Accepted 2026-03-25 22:13:51,969 - lava_callback - INFO - Starting async job submit for node 69c1bb172b2b51e9ad97b4a0 2026-03-25 22:13:51,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:13:51,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1bb172b2b51e9ad97b4a0 HTTP/1.1" 200 None 2026-03-25 22:13:51,985 - lava_callback - DEBUG - Processing node 69c1bb172b2b51e9ad97b4a0: baseline-arm64-clabbe 2026-03-25 22:13:51,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1bb172b2b51e9ad97b4a0 2026-03-25 22:13:51,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:13:51,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1bb172b2b51e9ad97b4a0 HTTP/1.1" 200 None 2026-03-25 22:13:52,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:13:52,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:13:52,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:13:52,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1bb172b2b51e9ad97b4a0 HTTP/1.1" 200 None 2026-03-25 22:13:52,037 - lava_callback - ERROR - Error processing callback for node 69c1bb172b2b51e9ad97b4a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58174 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:15:12,087 - lava_callback - INFO - Received callback for node 69c1bb6c2b2b51e9ad97b4b5 INFO: 172.21.0.1:51100 - "POST /node/69c1bb6c2b2b51e9ad97b4b5 HTTP/1.0" 202 Accepted 2026-03-25 22:15:12,092 - lava_callback - INFO - Starting async job submit for node 69c1bb6c2b2b51e9ad97b4b5 2026-03-25 22:15:12,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:15:12,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1bb6c2b2b51e9ad97b4b5 HTTP/1.1" 200 None 2026-03-25 22:15:12,108 - lava_callback - DEBUG - Processing node 69c1bb6c2b2b51e9ad97b4b5: baseline-arm64-clabbe 2026-03-25 22:15:12,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1bb6c2b2b51e9ad97b4b5 2026-03-25 22:15:12,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:15:12,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1bb6c2b2b51e9ad97b4b5 HTTP/1.1" 200 None 2026-03-25 22:15:12,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:15:12,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-25 22:15:12,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:15:12,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1bb6c2b2b51e9ad97b4b5 HTTP/1.1" 200 None 2026-03-25 22:15:12,173 - lava_callback - ERROR - Error processing callback for node 69c1bb6c2b2b51e9ad97b4b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36790 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:41:22,996 - lava_callback - INFO - Received callback for node 69c1c1852b2b51e9ad97b51d INFO: 172.21.0.1:39580 - "POST /node/69c1c1852b2b51e9ad97b51d HTTP/1.0" 202 Accepted 2026-03-25 22:41:23,002 - lava_callback - INFO - Starting async job submit for node 69c1c1852b2b51e9ad97b51d 2026-03-25 22:41:23,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:41:23,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c1852b2b51e9ad97b51d HTTP/1.1" 200 None 2026-03-25 22:41:23,018 - lava_callback - DEBUG - Processing node 69c1c1852b2b51e9ad97b51d: baseline-arm-baylibre 2026-03-25 22:41:23,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c1852b2b51e9ad97b51d 2026-03-25 22:41:23,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:41:23,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c1852b2b51e9ad97b51d HTTP/1.1" 200 None 2026-03-25 22:41:23,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:41:23,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:41:23,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:41:23,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c1852b2b51e9ad97b51d HTTP/1.1" 200 None 2026-03-25 22:41:23,075 - lava_callback - ERROR - Error processing callback for node 69c1c1852b2b51e9ad97b51d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35904 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:42:02,940 - lava_callback - INFO - Received callback for node 69c1c1ae2b2b51e9ad97b529 INFO: 172.21.0.1:60222 - "POST /node/69c1c1ae2b2b51e9ad97b529 HTTP/1.0" 202 Accepted 2026-03-25 22:42:02,945 - lava_callback - INFO - Starting async job submit for node 69c1c1ae2b2b51e9ad97b529 2026-03-25 22:42:02,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:42:02,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c1ae2b2b51e9ad97b529 HTTP/1.1" 200 None 2026-03-25 22:42:02,966 - lava_callback - DEBUG - Processing node 69c1c1ae2b2b51e9ad97b529: baseline-arm-baylibre 2026-03-25 22:42:02,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c1ae2b2b51e9ad97b529 2026-03-25 22:42:02,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:42:02,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c1ae2b2b51e9ad97b529 HTTP/1.1" 200 None 2026-03-25 22:42:02,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:42:02,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:42:02,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:42:03,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c1ae2b2b51e9ad97b529 HTTP/1.1" 200 None 2026-03-25 22:42:03,023 - lava_callback - ERROR - Error processing callback for node 69c1c1ae2b2b51e9ad97b529: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:42:43,025 - lava_callback - INFO - Received callback for node 69c1c1d52b2b51e9ad97b530 INFO: 172.21.0.1:47078 - "POST /node/69c1c1d52b2b51e9ad97b530 HTTP/1.0" 202 Accepted 2026-03-25 22:42:43,033 - lava_callback - INFO - Starting async job submit for node 69c1c1d52b2b51e9ad97b530 2026-03-25 22:42:43,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:42:43,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c1d52b2b51e9ad97b530 HTTP/1.1" 200 None 2026-03-25 22:42:43,062 - lava_callback - DEBUG - Processing node 69c1c1d52b2b51e9ad97b530: baseline-arm-baylibre 2026-03-25 22:42:43,063 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c1d52b2b51e9ad97b530 2026-03-25 22:42:43,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:42:43,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c1d52b2b51e9ad97b530 HTTP/1.1" 200 None 2026-03-25 22:42:43,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:42:43,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:42:43,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:42:43,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c1d52b2b51e9ad97b530 HTTP/1.1" 200 None 2026-03-25 22:42:43,123 - lava_callback - ERROR - Error processing callback for node 69c1c1d52b2b51e9ad97b530: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44268 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:43:22,997 - lava_callback - INFO - Received callback for node 69c1c1fe2b2b51e9ad97b53a INFO: 172.21.0.1:57408 - "POST /node/69c1c1fe2b2b51e9ad97b53a HTTP/1.0" 202 Accepted 2026-03-25 22:43:23,004 - lava_callback - INFO - Starting async job submit for node 69c1c1fe2b2b51e9ad97b53a 2026-03-25 22:43:23,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:43:23,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c1fe2b2b51e9ad97b53a HTTP/1.1" 200 None 2026-03-25 22:43:23,021 - lava_callback - DEBUG - Processing node 69c1c1fe2b2b51e9ad97b53a: baseline-arm-baylibre 2026-03-25 22:43:23,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c1fe2b2b51e9ad97b53a 2026-03-25 22:43:23,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:43:23,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c1fe2b2b51e9ad97b53a HTTP/1.1" 200 None 2026-03-25 22:43:23,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:43:23,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:43:23,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:43:23,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c1fe2b2b51e9ad97b53a HTTP/1.1" 200 None 2026-03-25 22:43:23,083 - lava_callback - ERROR - Error processing callback for node 69c1c1fe2b2b51e9ad97b53a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40936 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:44:03,115 - lava_callback - INFO - Received callback for node 69c1c22a2b2b51e9ad97b546 INFO: 172.21.0.1:41990 - "POST /node/69c1c22a2b2b51e9ad97b546 HTTP/1.0" 202 Accepted 2026-03-25 22:44:03,120 - lava_callback - INFO - Starting async job submit for node 69c1c22a2b2b51e9ad97b546 2026-03-25 22:44:03,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:44:03,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c22a2b2b51e9ad97b546 HTTP/1.1" 200 None 2026-03-25 22:44:03,139 - lava_callback - DEBUG - Processing node 69c1c22a2b2b51e9ad97b546: baseline-arm-baylibre 2026-03-25 22:44:03,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c22a2b2b51e9ad97b546 2026-03-25 22:44:03,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:44:03,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c22a2b2b51e9ad97b546 HTTP/1.1" 200 None 2026-03-25 22:44:03,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:44:03,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:44:03,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:44:03,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c22a2b2b51e9ad97b546 HTTP/1.1" 200 None 2026-03-25 22:44:03,232 - lava_callback - ERROR - Error processing callback for node 69c1c22a2b2b51e9ad97b546: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56328 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:44:43,069 - lava_callback - INFO - Received callback for node 69c1c2512b2b51e9ad97b550 INFO: 172.21.0.1:35150 - "POST /node/69c1c2512b2b51e9ad97b550 HTTP/1.0" 202 Accepted 2026-03-25 22:44:43,075 - lava_callback - INFO - Starting async job submit for node 69c1c2512b2b51e9ad97b550 2026-03-25 22:44:43,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:44:43,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c2512b2b51e9ad97b550 HTTP/1.1" 200 None 2026-03-25 22:44:43,091 - lava_callback - DEBUG - Processing node 69c1c2512b2b51e9ad97b550: baseline-arm-baylibre 2026-03-25 22:44:43,091 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c2512b2b51e9ad97b550 2026-03-25 22:44:43,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:44:43,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c2512b2b51e9ad97b550 HTTP/1.1" 200 None 2026-03-25 22:44:43,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:44:43,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:44:43,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:44:43,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c2512b2b51e9ad97b550 HTTP/1.1" 200 None 2026-03-25 22:44:43,144 - lava_callback - ERROR - Error processing callback for node 69c1c2512b2b51e9ad97b550: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40522 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:46:53,387 - lava_callback - INFO - Received callback for node 69c1c2ca2b2b51e9ad97b56f INFO: 172.21.0.1:40538 - "POST /node/69c1c2ca2b2b51e9ad97b56f HTTP/1.0" 202 Accepted 2026-03-25 22:46:53,393 - lava_callback - INFO - Starting async job submit for node 69c1c2ca2b2b51e9ad97b56f 2026-03-25 22:46:53,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:46:53,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c2ca2b2b51e9ad97b56f HTTP/1.1" 200 None 2026-03-25 22:46:53,413 - lava_callback - DEBUG - Processing node 69c1c2ca2b2b51e9ad97b56f: baseline-arm-clabbe 2026-03-25 22:46:53,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c2ca2b2b51e9ad97b56f 2026-03-25 22:46:53,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:46:53,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c2ca2b2b51e9ad97b56f HTTP/1.1" 200 None 2026-03-25 22:46:53,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:46:53,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:46:53,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:46:53,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c2ca2b2b51e9ad97b56f HTTP/1.1" 200 None 2026-03-25 22:46:53,468 - lava_callback - ERROR - Error processing callback for node 69c1c2ca2b2b51e9ad97b56f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49212 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:47:33,371 - lava_callback - INFO - Received callback for node 69c1c2f22b2b51e9ad97b578 INFO: 172.21.0.1:41496 - "POST /node/69c1c2f22b2b51e9ad97b578 HTTP/1.0" 202 Accepted 2026-03-25 22:47:33,377 - lava_callback - INFO - Starting async job submit for node 69c1c2f22b2b51e9ad97b578 2026-03-25 22:47:33,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:47:33,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c2f22b2b51e9ad97b578 HTTP/1.1" 200 None 2026-03-25 22:47:33,392 - lava_callback - DEBUG - Processing node 69c1c2f22b2b51e9ad97b578: baseline-arm-clabbe 2026-03-25 22:47:33,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c2f22b2b51e9ad97b578 2026-03-25 22:47:33,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:47:33,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c2f22b2b51e9ad97b578 HTTP/1.1" 200 None 2026-03-25 22:47:33,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:47:33,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:47:33,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:47:33,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c2f22b2b51e9ad97b578 HTTP/1.1" 200 None 2026-03-25 22:47:33,465 - lava_callback - ERROR - Error processing callback for node 69c1c2f22b2b51e9ad97b578: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:48:13,469 - lava_callback - INFO - Received callback for node 69c1c31a2b2b51e9ad97b584 INFO: 172.21.0.1:56590 - "POST /node/69c1c31a2b2b51e9ad97b584 HTTP/1.0" 202 Accepted 2026-03-25 22:48:13,474 - lava_callback - INFO - Starting async job submit for node 69c1c31a2b2b51e9ad97b584 2026-03-25 22:48:13,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:48:13,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c31a2b2b51e9ad97b584 HTTP/1.1" 200 None 2026-03-25 22:48:13,490 - lava_callback - DEBUG - Processing node 69c1c31a2b2b51e9ad97b584: baseline-arm-clabbe 2026-03-25 22:48:13,490 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c31a2b2b51e9ad97b584 2026-03-25 22:48:13,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:48:13,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c31a2b2b51e9ad97b584 HTTP/1.1" 200 None 2026-03-25 22:48:13,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:48:13,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:48:13,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:48:13,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c31a2b2b51e9ad97b584 HTTP/1.1" 200 None 2026-03-25 22:48:13,540 - lava_callback - ERROR - Error processing callback for node 69c1c31a2b2b51e9ad97b584: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39492 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:48:53,411 - lava_callback - INFO - Received callback for node 69c1c3432b2b51e9ad97b58b INFO: 172.21.0.1:39506 - "POST /node/69c1c3432b2b51e9ad97b58b HTTP/1.0" 202 Accepted 2026-03-25 22:48:53,417 - lava_callback - INFO - Starting async job submit for node 69c1c3432b2b51e9ad97b58b 2026-03-25 22:48:53,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:48:53,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c3432b2b51e9ad97b58b HTTP/1.1" 200 None 2026-03-25 22:48:53,433 - lava_callback - DEBUG - Processing node 69c1c3432b2b51e9ad97b58b: baseline-arm-clabbe 2026-03-25 22:48:53,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c3432b2b51e9ad97b58b 2026-03-25 22:48:53,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:48:53,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c3432b2b51e9ad97b58b HTTP/1.1" 200 None 2026-03-25 22:48:53,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:48:53,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:48:53,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:48:53,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c3432b2b51e9ad97b58b HTTP/1.1" 200 None 2026-03-25 22:48:53,499 - lava_callback - ERROR - Error processing callback for node 69c1c3432b2b51e9ad97b58b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51438 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:49:33,511 - lava_callback - INFO - Received callback for node 69c1c36a2b2b51e9ad97b597 INFO: 172.21.0.1:57782 - "POST /node/69c1c36a2b2b51e9ad97b597 HTTP/1.0" 202 Accepted 2026-03-25 22:49:33,517 - lava_callback - INFO - Starting async job submit for node 69c1c36a2b2b51e9ad97b597 2026-03-25 22:49:33,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:49:33,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c36a2b2b51e9ad97b597 HTTP/1.1" 200 None 2026-03-25 22:49:33,534 - lava_callback - DEBUG - Processing node 69c1c36a2b2b51e9ad97b597: baseline-arm-clabbe 2026-03-25 22:49:33,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c36a2b2b51e9ad97b597 2026-03-25 22:49:33,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:49:33,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c36a2b2b51e9ad97b597 HTTP/1.1" 200 None 2026-03-25 22:49:33,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:49:33,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-25 22:49:33,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:49:33,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c36a2b2b51e9ad97b597 HTTP/1.1" 200 None 2026-03-25 22:49:33,609 - lava_callback - ERROR - Error processing callback for node 69c1c36a2b2b51e9ad97b597: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK 2026-03-25 22:59:44,048 - lava_callback - INFO - Received callback for node 69c1c5dd2b2b51e9ad97b5b1 INFO: 172.21.0.1:60742 - "POST /node/69c1c5dd2b2b51e9ad97b5b1 HTTP/1.0" 202 Accepted 2026-03-25 22:59:44,054 - lava_callback - INFO - Starting async job submit for node 69c1c5dd2b2b51e9ad97b5b1 2026-03-25 22:59:44,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:59:44,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c5dd2b2b51e9ad97b5b1 HTTP/1.1" 200 None 2026-03-25 22:59:44,071 - lava_callback - DEBUG - Processing node 69c1c5dd2b2b51e9ad97b5b1: baseline-arm64-baylibre 2026-03-25 22:59:44,071 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c5dd2b2b51e9ad97b5b1 2026-03-25 22:59:44,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:59:44,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c5dd2b2b51e9ad97b5b1 HTTP/1.1" 200 None 2026-03-25 22:59:44,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:59:44,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 22:59:44,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 22:59:44,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c5dd2b2b51e9ad97b5b1 HTTP/1.1" 200 None 2026-03-25 22:59:44,131 - lava_callback - ERROR - Error processing callback for node 69c1c5dd2b2b51e9ad97b5b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41422 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:01:24,024 - lava_callback - INFO - Received callback for node 69c1c6352b2b51e9ad97b5c4 INFO: 172.21.0.1:34224 - "POST /node/69c1c6352b2b51e9ad97b5c4 HTTP/1.0" 202 Accepted 2026-03-25 23:01:24,029 - lava_callback - INFO - Starting async job submit for node 69c1c6352b2b51e9ad97b5c4 2026-03-25 23:01:24,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:01:24,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c6352b2b51e9ad97b5c4 HTTP/1.1" 200 None 2026-03-25 23:01:24,046 - lava_callback - DEBUG - Processing node 69c1c6352b2b51e9ad97b5c4: baseline-arm64-baylibre 2026-03-25 23:01:24,046 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c6352b2b51e9ad97b5c4 2026-03-25 23:01:24,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:01:24,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c6352b2b51e9ad97b5c4 HTTP/1.1" 200 None 2026-03-25 23:01:24,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:01:24,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:01:24,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:01:24,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c6352b2b51e9ad97b5c4 HTTP/1.1" 200 None 2026-03-25 23:01:24,115 - lava_callback - ERROR - Error processing callback for node 69c1c6352b2b51e9ad97b5c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:02:44,103 - lava_callback - INFO - Received callback for node 69c1c6882b2b51e9ad97b5da INFO: 172.21.0.1:57314 - "POST /node/69c1c6882b2b51e9ad97b5da HTTP/1.0" 202 Accepted 2026-03-25 23:02:44,109 - lava_callback - INFO - Starting async job submit for node 69c1c6882b2b51e9ad97b5da 2026-03-25 23:02:44,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:02:44,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c6882b2b51e9ad97b5da HTTP/1.1" 200 None 2026-03-25 23:02:44,126 - lava_callback - DEBUG - Processing node 69c1c6882b2b51e9ad97b5da: baseline-arm64-baylibre 2026-03-25 23:02:44,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c6882b2b51e9ad97b5da 2026-03-25 23:02:44,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:02:44,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c6882b2b51e9ad97b5da HTTP/1.1" 200 None 2026-03-25 23:02:44,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:02:44,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:02:44,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:02:44,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c6882b2b51e9ad97b5da HTTP/1.1" 200 None 2026-03-25 23:02:44,203 - lava_callback - ERROR - Error processing callback for node 69c1c6882b2b51e9ad97b5da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:04:04,285 - lava_callback - INFO - Received callback for node 69c1c6db2b2b51e9ad97b5ee INFO: 172.21.0.1:53524 - "POST /node/69c1c6db2b2b51e9ad97b5ee HTTP/1.0" 202 Accepted 2026-03-25 23:04:04,300 - lava_callback - INFO - Starting async job submit for node 69c1c6db2b2b51e9ad97b5ee 2026-03-25 23:04:04,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:04:04,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c6db2b2b51e9ad97b5ee HTTP/1.1" 200 None 2026-03-25 23:04:04,337 - lava_callback - DEBUG - Processing node 69c1c6db2b2b51e9ad97b5ee: baseline-arm64-baylibre 2026-03-25 23:04:04,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c6db2b2b51e9ad97b5ee 2026-03-25 23:04:04,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:04:04,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c6db2b2b51e9ad97b5ee HTTP/1.1" 200 None 2026-03-25 23:04:04,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:04:04,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:04:04,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:04:04,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c6db2b2b51e9ad97b5ee HTTP/1.1" 200 None 2026-03-25 23:04:04,427 - lava_callback - ERROR - Error processing callback for node 69c1c6db2b2b51e9ad97b5ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:05:24,358 - lava_callback - INFO - Received callback for node 69c1c72f2b2b51e9ad97b5ff INFO: 172.21.0.1:53966 - "POST /node/69c1c72f2b2b51e9ad97b5ff HTTP/1.0" 202 Accepted 2026-03-25 23:05:24,364 - lava_callback - INFO - Starting async job submit for node 69c1c72f2b2b51e9ad97b5ff 2026-03-25 23:05:24,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:05:24,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c72f2b2b51e9ad97b5ff HTTP/1.1" 200 None 2026-03-25 23:05:24,380 - lava_callback - DEBUG - Processing node 69c1c72f2b2b51e9ad97b5ff: baseline-arm64-baylibre 2026-03-25 23:05:24,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c72f2b2b51e9ad97b5ff 2026-03-25 23:05:24,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:05:24,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c72f2b2b51e9ad97b5ff HTTP/1.1" 200 None 2026-03-25 23:05:24,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:05:24,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:05:24,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:05:24,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c72f2b2b51e9ad97b5ff HTTP/1.1" 200 None 2026-03-25 23:05:24,455 - lava_callback - ERROR - Error processing callback for node 69c1c72f2b2b51e9ad97b5ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39220 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:07:04,319 - lava_callback - INFO - Received callback for node 69c1c7862b2b51e9ad97b611 INFO: 172.21.0.1:47196 - "POST /node/69c1c7862b2b51e9ad97b611 HTTP/1.0" 202 Accepted 2026-03-25 23:07:04,324 - lava_callback - INFO - Starting async job submit for node 69c1c7862b2b51e9ad97b611 2026-03-25 23:07:04,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:07:04,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c7862b2b51e9ad97b611 HTTP/1.1" 200 None 2026-03-25 23:07:04,341 - lava_callback - DEBUG - Processing node 69c1c7862b2b51e9ad97b611: baseline-arm64-baylibre 2026-03-25 23:07:04,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c7862b2b51e9ad97b611 2026-03-25 23:07:04,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:07:04,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c7862b2b51e9ad97b611 HTTP/1.1" 200 None 2026-03-25 23:07:04,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:07:04,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:07:04,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:07:04,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c7862b2b51e9ad97b611 HTTP/1.1" 200 None 2026-03-25 23:07:04,394 - lava_callback - ERROR - Error processing callback for node 69c1c7862b2b51e9ad97b611: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56786 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:08:24,404 - lava_callback - INFO - Received callback for node 69c1c7dc2b2b51e9ad97b62a INFO: 172.21.0.1:37912 - "POST /node/69c1c7dc2b2b51e9ad97b62a HTTP/1.0" 202 Accepted 2026-03-25 23:08:24,409 - lava_callback - INFO - Starting async job submit for node 69c1c7dc2b2b51e9ad97b62a 2026-03-25 23:08:24,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:08:24,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c7dc2b2b51e9ad97b62a HTTP/1.1" 200 None 2026-03-25 23:08:24,426 - lava_callback - DEBUG - Processing node 69c1c7dc2b2b51e9ad97b62a: baseline-arm64-baylibre 2026-03-25 23:08:24,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c7dc2b2b51e9ad97b62a 2026-03-25 23:08:24,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:08:24,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c7dc2b2b51e9ad97b62a HTTP/1.1" 200 None 2026-03-25 23:08:24,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:08:24,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:08:24,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:08:24,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c7dc2b2b51e9ad97b62a HTTP/1.1" 200 None 2026-03-25 23:08:24,484 - lava_callback - ERROR - Error processing callback for node 69c1c7dc2b2b51e9ad97b62a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41834 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:09:44,491 - lava_callback - INFO - Received callback for node 69c1c82e2b2b51e9ad97b63c INFO: 172.21.0.1:53248 - "POST /node/69c1c82e2b2b51e9ad97b63c HTTP/1.0" 202 Accepted 2026-03-25 23:09:44,497 - lava_callback - INFO - Starting async job submit for node 69c1c82e2b2b51e9ad97b63c 2026-03-25 23:09:44,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:09:44,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c82e2b2b51e9ad97b63c HTTP/1.1" 200 None 2026-03-25 23:09:44,513 - lava_callback - DEBUG - Processing node 69c1c82e2b2b51e9ad97b63c: baseline-arm64-baylibre 2026-03-25 23:09:44,514 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c82e2b2b51e9ad97b63c 2026-03-25 23:09:44,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:09:44,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c82e2b2b51e9ad97b63c HTTP/1.1" 200 None 2026-03-25 23:09:44,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:09:44,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:09:44,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:09:44,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c82e2b2b51e9ad97b63c HTTP/1.1" 200 None 2026-03-25 23:09:44,578 - lava_callback - ERROR - Error processing callback for node 69c1c82e2b2b51e9ad97b63c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36594 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:11:04,567 - lava_callback - INFO - Received callback for node 69c1c87f2b2b51e9ad97b651 INFO: 172.21.0.1:54578 - "POST /node/69c1c87f2b2b51e9ad97b651 HTTP/1.0" 202 Accepted 2026-03-25 23:11:04,573 - lava_callback - INFO - Starting async job submit for node 69c1c87f2b2b51e9ad97b651 2026-03-25 23:11:04,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:11:04,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c87f2b2b51e9ad97b651 HTTP/1.1" 200 None 2026-03-25 23:11:04,589 - lava_callback - DEBUG - Processing node 69c1c87f2b2b51e9ad97b651: baseline-arm64-baylibre 2026-03-25 23:11:04,589 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c87f2b2b51e9ad97b651 2026-03-25 23:11:04,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:11:04,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c87f2b2b51e9ad97b651 HTTP/1.1" 200 None 2026-03-25 23:11:04,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:11:04,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:11:04,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:11:04,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c87f2b2b51e9ad97b651 HTTP/1.1" 200 None 2026-03-25 23:11:04,640 - lava_callback - ERROR - Error processing callback for node 69c1c87f2b2b51e9ad97b651: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:12:44,664 - lava_callback - INFO - Received callback for node 69c1c8d82b2b51e9ad97b666 INFO: 172.21.0.1:50250 - "POST /node/69c1c8d82b2b51e9ad97b666 HTTP/1.0" 202 Accepted 2026-03-25 23:12:44,669 - lava_callback - INFO - Starting async job submit for node 69c1c8d82b2b51e9ad97b666 2026-03-25 23:12:44,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:12:44,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c8d82b2b51e9ad97b666 HTTP/1.1" 200 None 2026-03-25 23:12:44,693 - lava_callback - DEBUG - Processing node 69c1c8d82b2b51e9ad97b666: baseline-arm64-baylibre 2026-03-25 23:12:44,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c8d82b2b51e9ad97b666 2026-03-25 23:12:44,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:12:44,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c8d82b2b51e9ad97b666 HTTP/1.1" 200 None 2026-03-25 23:12:44,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:12:44,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:12:44,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:12:44,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c8d82b2b51e9ad97b666 HTTP/1.1" 200 None 2026-03-25 23:12:44,744 - lava_callback - ERROR - Error processing callback for node 69c1c8d82b2b51e9ad97b666: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52194 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:14:04,720 - lava_callback - INFO - Received callback for node 69c1c92f2b2b51e9ad97b677 INFO: 172.21.0.1:55554 - "POST /node/69c1c92f2b2b51e9ad97b677 HTTP/1.0" 202 Accepted 2026-03-25 23:14:04,726 - lava_callback - INFO - Starting async job submit for node 69c1c92f2b2b51e9ad97b677 2026-03-25 23:14:04,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:14:04,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c92f2b2b51e9ad97b677 HTTP/1.1" 200 None 2026-03-25 23:14:04,742 - lava_callback - DEBUG - Processing node 69c1c92f2b2b51e9ad97b677: baseline-arm64-baylibre 2026-03-25 23:14:04,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c92f2b2b51e9ad97b677 2026-03-25 23:14:04,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:14:04,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c92f2b2b51e9ad97b677 HTTP/1.1" 200 None 2026-03-25 23:14:04,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:14:04,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:14:04,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:14:04,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c92f2b2b51e9ad97b677 HTTP/1.1" 200 None 2026-03-25 23:14:04,814 - lava_callback - ERROR - Error processing callback for node 69c1c92f2b2b51e9ad97b677: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:15:24,788 - lava_callback - INFO - Received callback for node 69c1c9832b2b51e9ad97b681 INFO: 172.21.0.1:60404 - "POST /node/69c1c9832b2b51e9ad97b681 HTTP/1.0" 202 Accepted 2026-03-25 23:15:24,794 - lava_callback - INFO - Starting async job submit for node 69c1c9832b2b51e9ad97b681 2026-03-25 23:15:24,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:15:24,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c9832b2b51e9ad97b681 HTTP/1.1" 200 None 2026-03-25 23:15:24,810 - lava_callback - DEBUG - Processing node 69c1c9832b2b51e9ad97b681: baseline-arm64-baylibre 2026-03-25 23:15:24,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c9832b2b51e9ad97b681 2026-03-25 23:15:24,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:15:24,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c9832b2b51e9ad97b681 HTTP/1.1" 200 None 2026-03-25 23:15:24,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:15:24,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:15:24,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:15:24,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c9832b2b51e9ad97b681 HTTP/1.1" 200 None 2026-03-25 23:15:24,867 - lava_callback - ERROR - Error processing callback for node 69c1c9832b2b51e9ad97b681: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:16:54,711 - lava_callback - INFO - Received callback for node 69c1c9dc2b2b51e9ad97b695 INFO: 172.21.0.1:55748 - "POST /node/69c1c9dc2b2b51e9ad97b695 HTTP/1.0" 202 Accepted 2026-03-25 23:16:54,717 - lava_callback - INFO - Starting async job submit for node 69c1c9dc2b2b51e9ad97b695 2026-03-25 23:16:54,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:16:54,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c9dc2b2b51e9ad97b695 HTTP/1.1" 200 None 2026-03-25 23:16:54,739 - lava_callback - DEBUG - Processing node 69c1c9dc2b2b51e9ad97b695: baseline-arm64-clabbe 2026-03-25 23:16:54,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1c9dc2b2b51e9ad97b695 2026-03-25 23:16:54,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:16:54,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1c9dc2b2b51e9ad97b695 HTTP/1.1" 200 None 2026-03-25 23:16:54,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:16:54,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:16:54,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:16:54,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1c9dc2b2b51e9ad97b695 HTTP/1.1" 200 None 2026-03-25 23:16:54,812 - lava_callback - ERROR - Error processing callback for node 69c1c9dc2b2b51e9ad97b695: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47960 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:18:14,766 - lava_callback - INFO - Received callback for node 69c1ca312b2b51e9ad97b6af INFO: 172.21.0.1:45534 - "POST /node/69c1ca312b2b51e9ad97b6af HTTP/1.0" 202 Accepted 2026-03-25 23:18:14,772 - lava_callback - INFO - Starting async job submit for node 69c1ca312b2b51e9ad97b6af 2026-03-25 23:18:14,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:18:14,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ca312b2b51e9ad97b6af HTTP/1.1" 200 None 2026-03-25 23:18:14,789 - lava_callback - DEBUG - Processing node 69c1ca312b2b51e9ad97b6af: baseline-arm64-clabbe 2026-03-25 23:18:14,790 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ca312b2b51e9ad97b6af 2026-03-25 23:18:14,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:18:14,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ca312b2b51e9ad97b6af HTTP/1.1" 200 None 2026-03-25 23:18:14,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:18:14,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:18:14,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:18:14,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ca312b2b51e9ad97b6af HTTP/1.1" 200 None 2026-03-25 23:18:14,844 - lava_callback - ERROR - Error processing callback for node 69c1ca312b2b51e9ad97b6af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51378 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:19:54,794 - lava_callback - INFO - Received callback for node 69c1ca892b2b51e9ad97b6c6 INFO: 172.21.0.1:51386 - "POST /node/69c1ca892b2b51e9ad97b6c6 HTTP/1.0" 202 Accepted 2026-03-25 23:19:54,799 - lava_callback - INFO - Starting async job submit for node 69c1ca892b2b51e9ad97b6c6 2026-03-25 23:19:54,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:19:54,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ca892b2b51e9ad97b6c6 HTTP/1.1" 200 None 2026-03-25 23:19:54,815 - lava_callback - DEBUG - Processing node 69c1ca892b2b51e9ad97b6c6: baseline-arm64-clabbe 2026-03-25 23:19:54,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ca892b2b51e9ad97b6c6 2026-03-25 23:19:54,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:19:54,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ca892b2b51e9ad97b6c6 HTTP/1.1" 200 None 2026-03-25 23:19:54,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:19:54,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:19:54,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:19:54,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ca892b2b51e9ad97b6c6 HTTP/1.1" 200 None 2026-03-25 23:19:54,916 - lava_callback - ERROR - Error processing callback for node 69c1ca892b2b51e9ad97b6c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:21:14,831 - lava_callback - INFO - Received callback for node 69c1cadf2b2b51e9ad97b6e0 INFO: 172.21.0.1:50378 - "POST /node/69c1cadf2b2b51e9ad97b6e0 HTTP/1.0" 202 Accepted 2026-03-25 23:21:14,837 - lava_callback - INFO - Starting async job submit for node 69c1cadf2b2b51e9ad97b6e0 2026-03-25 23:21:14,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:21:14,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cadf2b2b51e9ad97b6e0 HTTP/1.1" 200 None 2026-03-25 23:21:14,853 - lava_callback - DEBUG - Processing node 69c1cadf2b2b51e9ad97b6e0: baseline-arm64-clabbe 2026-03-25 23:21:14,853 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cadf2b2b51e9ad97b6e0 2026-03-25 23:21:14,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:21:14,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cadf2b2b51e9ad97b6e0 HTTP/1.1" 200 None 2026-03-25 23:21:14,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:21:14,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:21:14,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:21:14,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cadf2b2b51e9ad97b6e0 HTTP/1.1" 200 None 2026-03-25 23:21:14,917 - lava_callback - ERROR - Error processing callback for node 69c1cadf2b2b51e9ad97b6e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:22:34,893 - lava_callback - INFO - Received callback for node 69c1cb322b2b51e9ad97b6fa INFO: 172.21.0.1:46118 - "POST /node/69c1cb322b2b51e9ad97b6fa HTTP/1.0" 202 Accepted 2026-03-25 23:22:34,898 - lava_callback - INFO - Starting async job submit for node 69c1cb322b2b51e9ad97b6fa 2026-03-25 23:22:34,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:22:34,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cb322b2b51e9ad97b6fa HTTP/1.1" 200 None 2026-03-25 23:22:34,914 - lava_callback - DEBUG - Processing node 69c1cb322b2b51e9ad97b6fa: baseline-arm64-clabbe 2026-03-25 23:22:34,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cb322b2b51e9ad97b6fa 2026-03-25 23:22:34,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:22:34,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cb322b2b51e9ad97b6fa HTTP/1.1" 200 None 2026-03-25 23:22:34,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:22:34,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:22:34,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:22:34,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cb322b2b51e9ad97b6fa HTTP/1.1" 200 None 2026-03-25 23:22:34,976 - lava_callback - ERROR - Error processing callback for node 69c1cb322b2b51e9ad97b6fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:23:54,939 - lava_callback - INFO - Received callback for node 69c1cb862b2b51e9ad97b70c INFO: 172.21.0.1:59016 - "POST /node/69c1cb862b2b51e9ad97b70c HTTP/1.0" 202 Accepted 2026-03-25 23:23:54,944 - lava_callback - INFO - Starting async job submit for node 69c1cb862b2b51e9ad97b70c 2026-03-25 23:23:54,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:23:54,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cb862b2b51e9ad97b70c HTTP/1.1" 200 None 2026-03-25 23:23:54,961 - lava_callback - DEBUG - Processing node 69c1cb862b2b51e9ad97b70c: baseline-arm64-clabbe 2026-03-25 23:23:54,962 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cb862b2b51e9ad97b70c 2026-03-25 23:23:54,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:23:54,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cb862b2b51e9ad97b70c HTTP/1.1" 200 None 2026-03-25 23:23:54,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:23:54,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:23:54,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:23:55,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cb862b2b51e9ad97b70c HTTP/1.1" 200 None 2026-03-25 23:23:55,044 - lava_callback - ERROR - Error processing callback for node 69c1cb862b2b51e9ad97b70c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:25:35,054 - lava_callback - INFO - Received callback for node 69c1cbdb2b2b51e9ad97b726 INFO: 172.21.0.1:54058 - "POST /node/69c1cbdb2b2b51e9ad97b726 HTTP/1.0" 202 Accepted 2026-03-25 23:25:35,061 - lava_callback - INFO - Starting async job submit for node 69c1cbdb2b2b51e9ad97b726 2026-03-25 23:25:35,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:25:35,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cbdb2b2b51e9ad97b726 HTTP/1.1" 200 None 2026-03-25 23:25:35,079 - lava_callback - DEBUG - Processing node 69c1cbdb2b2b51e9ad97b726: baseline-arm64-clabbe 2026-03-25 23:25:35,079 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cbdb2b2b51e9ad97b726 2026-03-25 23:25:35,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:25:35,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cbdb2b2b51e9ad97b726 HTTP/1.1" 200 None 2026-03-25 23:25:35,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:25:35,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:25:35,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:25:35,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cbdb2b2b51e9ad97b726 HTTP/1.1" 200 None 2026-03-25 23:25:35,149 - lava_callback - ERROR - Error processing callback for node 69c1cbdb2b2b51e9ad97b726: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35618 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:26:55,062 - lava_callback - INFO - Received callback for node 69c1cc302b2b51e9ad97b739 INFO: 172.21.0.1:35632 - "POST /node/69c1cc302b2b51e9ad97b739 HTTP/1.0" 202 Accepted 2026-03-25 23:26:55,067 - lava_callback - INFO - Starting async job submit for node 69c1cc302b2b51e9ad97b739 2026-03-25 23:26:55,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:26:55,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cc302b2b51e9ad97b739 HTTP/1.1" 200 None 2026-03-25 23:26:55,083 - lava_callback - DEBUG - Processing node 69c1cc302b2b51e9ad97b739: baseline-arm64-clabbe 2026-03-25 23:26:55,084 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cc302b2b51e9ad97b739 2026-03-25 23:26:55,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:26:55,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cc302b2b51e9ad97b739 HTTP/1.1" 200 None 2026-03-25 23:26:55,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:26:55,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:26:55,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:26:55,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cc302b2b51e9ad97b739 HTTP/1.1" 200 None 2026-03-25 23:26:55,155 - lava_callback - ERROR - Error processing callback for node 69c1cc302b2b51e9ad97b739: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60566 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 23:28:15,181 - lava_callback - INFO - Received callback for node 69c1cc832b2b51e9ad97b747 INFO: 172.21.0.1:60580 - "POST /node/69c1cc832b2b51e9ad97b747 HTTP/1.0" 202 Accepted 2026-03-25 23:28:15,186 - lava_callback - INFO - Starting async job submit for node 69c1cc832b2b51e9ad97b747 2026-03-25 23:28:15,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:28:15,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cc832b2b51e9ad97b747 HTTP/1.1" 200 None 2026-03-25 23:28:15,202 - lava_callback - DEBUG - Processing node 69c1cc832b2b51e9ad97b747: baseline-arm64-clabbe 2026-03-25 23:28:15,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cc832b2b51e9ad97b747 2026-03-25 23:28:15,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:28:15,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cc832b2b51e9ad97b747 HTTP/1.1" 200 None 2026-03-25 23:28:15,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:28:15,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:28:15,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:28:15,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cc832b2b51e9ad97b747 HTTP/1.1" 200 None 2026-03-25 23:28:15,260 - lava_callback - ERROR - Error processing callback for node 69c1cc832b2b51e9ad97b747: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60694 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:29:35,180 - lava_callback - INFO - Received callback for node 69c1ccd72b2b51e9ad97b757 INFO: 172.21.0.1:44156 - "POST /node/69c1ccd72b2b51e9ad97b757 HTTP/1.0" 202 Accepted 2026-03-25 23:29:35,186 - lava_callback - INFO - Starting async job submit for node 69c1ccd72b2b51e9ad97b757 2026-03-25 23:29:35,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:29:35,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ccd72b2b51e9ad97b757 HTTP/1.1" 200 None 2026-03-25 23:29:35,201 - lava_callback - DEBUG - Processing node 69c1ccd72b2b51e9ad97b757: baseline-arm64-clabbe 2026-03-25 23:29:35,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ccd72b2b51e9ad97b757 2026-03-25 23:29:35,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:29:35,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ccd72b2b51e9ad97b757 HTTP/1.1" 200 None 2026-03-25 23:29:35,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:29:35,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:29:35,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:29:35,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ccd72b2b51e9ad97b757 HTTP/1.1" 200 None 2026-03-25 23:29:35,252 - lava_callback - ERROR - Error processing callback for node 69c1ccd72b2b51e9ad97b757: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 23:31:15,261 - lava_callback - INFO - Received callback for node 69c1cd2e2b2b51e9ad97b769 INFO: 172.21.0.1:36558 - "POST /node/69c1cd2e2b2b51e9ad97b769 HTTP/1.0" 202 Accepted 2026-03-25 23:31:15,266 - lava_callback - INFO - Starting async job submit for node 69c1cd2e2b2b51e9ad97b769 2026-03-25 23:31:15,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:31:15,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cd2e2b2b51e9ad97b769 HTTP/1.1" 200 None 2026-03-25 23:31:15,282 - lava_callback - DEBUG - Processing node 69c1cd2e2b2b51e9ad97b769: baseline-arm64-clabbe 2026-03-25 23:31:15,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cd2e2b2b51e9ad97b769 2026-03-25 23:31:15,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:31:15,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cd2e2b2b51e9ad97b769 HTTP/1.1" 200 None 2026-03-25 23:31:15,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:31:15,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:31:15,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:31:15,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cd2e2b2b51e9ad97b769 HTTP/1.1" 200 None 2026-03-25 23:31:15,336 - lava_callback - ERROR - Error processing callback for node 69c1cd2e2b2b51e9ad97b769: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:32:05,791 - lava_callback - INFO - Received callback for node 69c1cd6f2b2b51e9ad97b778 INFO: 172.21.0.1:52180 - "POST /node/69c1cd6f2b2b51e9ad97b778 HTTP/1.0" 202 Accepted 2026-03-25 23:32:05,797 - lava_callback - INFO - Starting async job submit for node 69c1cd6f2b2b51e9ad97b778 2026-03-25 23:32:05,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:32:05,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cd6f2b2b51e9ad97b778 HTTP/1.1" 200 None 2026-03-25 23:32:05,813 - lava_callback - DEBUG - Processing node 69c1cd6f2b2b51e9ad97b778: baseline-arm-baylibre 2026-03-25 23:32:05,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cd6f2b2b51e9ad97b778 2026-03-25 23:32:05,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:32:05,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cd6f2b2b51e9ad97b778 HTTP/1.1" 200 None 2026-03-25 23:32:05,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:32:05,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:32:05,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:32:05,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cd6f2b2b51e9ad97b778 HTTP/1.1" 200 None 2026-03-25 23:32:05,863 - lava_callback - ERROR - Error processing callback for node 69c1cd6f2b2b51e9ad97b778: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53064 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:32:45,701 - lava_callback - INFO - Received callback for node 69c1cd962b2b51e9ad97b783 INFO: 172.21.0.1:41016 - "POST /node/69c1cd962b2b51e9ad97b783 HTTP/1.0" 202 Accepted 2026-03-25 23:32:45,706 - lava_callback - INFO - Starting async job submit for node 69c1cd962b2b51e9ad97b783 2026-03-25 23:32:45,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:32:45,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cd962b2b51e9ad97b783 HTTP/1.1" 200 None 2026-03-25 23:32:45,722 - lava_callback - DEBUG - Processing node 69c1cd962b2b51e9ad97b783: baseline-arm-baylibre 2026-03-25 23:32:45,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cd962b2b51e9ad97b783 2026-03-25 23:32:45,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:32:45,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cd962b2b51e9ad97b783 HTTP/1.1" 200 None 2026-03-25 23:32:45,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:32:45,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:32:45,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:32:45,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cd962b2b51e9ad97b783 HTTP/1.1" 200 None 2026-03-25 23:32:45,793 - lava_callback - ERROR - Error processing callback for node 69c1cd962b2b51e9ad97b783: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:33:25,746 - lava_callback - INFO - Received callback for node 69c1cdbe2b2b51e9ad97b78c INFO: 172.21.0.1:57966 - "POST /node/69c1cdbe2b2b51e9ad97b78c HTTP/1.0" 202 Accepted 2026-03-25 23:33:25,751 - lava_callback - INFO - Starting async job submit for node 69c1cdbe2b2b51e9ad97b78c 2026-03-25 23:33:25,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:33:25,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cdbe2b2b51e9ad97b78c HTTP/1.1" 200 None 2026-03-25 23:33:25,768 - lava_callback - DEBUG - Processing node 69c1cdbe2b2b51e9ad97b78c: baseline-arm-baylibre 2026-03-25 23:33:25,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cdbe2b2b51e9ad97b78c 2026-03-25 23:33:25,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:33:25,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cdbe2b2b51e9ad97b78c HTTP/1.1" 200 None 2026-03-25 23:33:25,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:33:25,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:33:25,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:33:25,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cdbe2b2b51e9ad97b78c HTTP/1.1" 200 None 2026-03-25 23:33:25,836 - lava_callback - ERROR - Error processing callback for node 69c1cdbe2b2b51e9ad97b78c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50216 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:34:35,385 - lava_callback - INFO - Received callback for node 69c1cdf92b2b51e9ad97b798 INFO: 172.21.0.1:40470 - "POST /node/69c1cdf92b2b51e9ad97b798 HTTP/1.0" 202 Accepted 2026-03-25 23:34:35,391 - lava_callback - INFO - Starting async job submit for node 69c1cdf92b2b51e9ad97b798 2026-03-25 23:34:35,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:34:35,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cdf92b2b51e9ad97b798 HTTP/1.1" 200 None 2026-03-25 23:34:35,407 - lava_callback - DEBUG - Processing node 69c1cdf92b2b51e9ad97b798: baseline-arm64-clabbe 2026-03-25 23:34:35,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cdf92b2b51e9ad97b798 2026-03-25 23:34:35,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:34:35,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cdf92b2b51e9ad97b798 HTTP/1.1" 200 None 2026-03-25 23:34:35,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:34:35,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-25 23:34:35,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:34:35,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cdf92b2b51e9ad97b798 HTTP/1.1" 200 None 2026-03-25 23:34:35,465 - lava_callback - ERROR - Error processing callback for node 69c1cdf92b2b51e9ad97b798: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54016 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:35:25,885 - lava_callback - INFO - Received callback for node 69c1ce3a2b2b51e9ad97b7b2 INFO: 172.21.0.1:39620 - "POST /node/69c1ce3a2b2b51e9ad97b7b2 HTTP/1.0" 202 Accepted 2026-03-25 23:35:25,890 - lava_callback - INFO - Starting async job submit for node 69c1ce3a2b2b51e9ad97b7b2 2026-03-25 23:35:25,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:35:25,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ce3a2b2b51e9ad97b7b2 HTTP/1.1" 200 None 2026-03-25 23:35:25,907 - lava_callback - DEBUG - Processing node 69c1ce3a2b2b51e9ad97b7b2: baseline-arm-baylibre 2026-03-25 23:35:25,908 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ce3a2b2b51e9ad97b7b2 2026-03-25 23:35:25,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:35:25,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ce3a2b2b51e9ad97b7b2 HTTP/1.1" 200 None 2026-03-25 23:35:25,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:35:25,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:35:25,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:35:25,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ce3a2b2b51e9ad97b7b2 HTTP/1.1" 200 None 2026-03-25 23:35:25,983 - lava_callback - ERROR - Error processing callback for node 69c1ce3a2b2b51e9ad97b7b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33646 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:36:05,908 - lava_callback - INFO - Received callback for node 69c1ce632b2b51e9ad97b7bc INFO: 172.21.0.1:38718 - "POST /node/69c1ce632b2b51e9ad97b7bc HTTP/1.0" 202 Accepted 2026-03-25 23:36:05,913 - lava_callback - INFO - Starting async job submit for node 69c1ce632b2b51e9ad97b7bc 2026-03-25 23:36:05,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:36:05,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ce632b2b51e9ad97b7bc HTTP/1.1" 200 None 2026-03-25 23:36:05,931 - lava_callback - DEBUG - Processing node 69c1ce632b2b51e9ad97b7bc: baseline-arm-baylibre 2026-03-25 23:36:05,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ce632b2b51e9ad97b7bc 2026-03-25 23:36:05,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:36:05,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ce632b2b51e9ad97b7bc HTTP/1.1" 200 None 2026-03-25 23:36:05,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:36:05,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:36:05,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:36:06,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ce632b2b51e9ad97b7bc HTTP/1.1" 200 None 2026-03-25 23:36:06,014 - lava_callback - ERROR - Error processing callback for node 69c1ce632b2b51e9ad97b7bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60110 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:36:45,932 - lava_callback - INFO - Received callback for node 69c1ce892b2b51e9ad97b7c7 INFO: 172.21.0.1:38288 - "POST /node/69c1ce892b2b51e9ad97b7c7 HTTP/1.0" 202 Accepted 2026-03-25 23:36:45,941 - lava_callback - INFO - Starting async job submit for node 69c1ce892b2b51e9ad97b7c7 2026-03-25 23:36:45,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:36:45,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ce892b2b51e9ad97b7c7 HTTP/1.1" 200 None 2026-03-25 23:36:45,962 - lava_callback - DEBUG - Processing node 69c1ce892b2b51e9ad97b7c7: baseline-arm-baylibre 2026-03-25 23:36:45,963 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ce892b2b51e9ad97b7c7 2026-03-25 23:36:45,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:36:45,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ce892b2b51e9ad97b7c7 HTTP/1.1" 200 None 2026-03-25 23:36:45,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:36:45,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:36:45,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:36:46,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ce892b2b51e9ad97b7c7 HTTP/1.1" 200 None 2026-03-25 23:36:46,020 - lava_callback - ERROR - Error processing callback for node 69c1ce892b2b51e9ad97b7c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49120 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:37:35,513 - lava_callback - INFO - Received callback for node 69c1ceb42b2b51e9ad97b7d4 INFO: 172.21.0.1:39284 - "POST /node/69c1ceb42b2b51e9ad97b7d4 HTTP/1.0" 202 Accepted 2026-03-25 23:37:35,518 - lava_callback - INFO - Starting async job submit for node 69c1ceb42b2b51e9ad97b7d4 2026-03-25 23:37:35,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:37:35,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ceb42b2b51e9ad97b7d4 HTTP/1.1" 200 None 2026-03-25 23:37:35,539 - lava_callback - DEBUG - Processing node 69c1ceb42b2b51e9ad97b7d4: baseline-arm-clabbe 2026-03-25 23:37:35,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ceb42b2b51e9ad97b7d4 2026-03-25 23:37:35,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:37:35,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ceb42b2b51e9ad97b7d4 HTTP/1.1" 200 None 2026-03-25 23:37:35,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:37:35,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:37:35,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:37:35,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ceb42b2b51e9ad97b7d4 HTTP/1.1" 200 None 2026-03-25 23:37:35,591 - lava_callback - ERROR - Error processing callback for node 69c1ceb42b2b51e9ad97b7d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44388 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:38:06,050 - lava_callback - INFO - Received callback for node 69c1ced72b2b51e9ad97b7dc INFO: 172.21.0.1:50740 - "POST /node/69c1ced72b2b51e9ad97b7dc HTTP/1.0" 202 Accepted 2026-03-25 23:38:06,056 - lava_callback - INFO - Starting async job submit for node 69c1ced72b2b51e9ad97b7dc 2026-03-25 23:38:06,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:38:06,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ced72b2b51e9ad97b7dc HTTP/1.1" 200 None 2026-03-25 23:38:06,073 - lava_callback - DEBUG - Processing node 69c1ced72b2b51e9ad97b7dc: baseline-arm-baylibre 2026-03-25 23:38:06,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1ced72b2b51e9ad97b7dc 2026-03-25 23:38:06,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:38:06,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1ced72b2b51e9ad97b7dc HTTP/1.1" 200 None 2026-03-25 23:38:06,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:38:06,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:38:06,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:38:06,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1ced72b2b51e9ad97b7dc HTTP/1.1" 200 None 2026-03-25 23:38:06,132 - lava_callback - ERROR - Error processing callback for node 69c1ced72b2b51e9ad97b7dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33530 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:38:55,579 - lava_callback - INFO - Received callback for node 69c1cf012b2b51e9ad97b7e5 INFO: 172.21.0.1:33534 - "POST /node/69c1cf012b2b51e9ad97b7e5 HTTP/1.0" 202 Accepted 2026-03-25 23:38:55,585 - lava_callback - INFO - Starting async job submit for node 69c1cf012b2b51e9ad97b7e5 2026-03-25 23:38:55,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:38:55,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf012b2b51e9ad97b7e5 HTTP/1.1" 200 None 2026-03-25 23:38:55,604 - lava_callback - DEBUG - Processing node 69c1cf012b2b51e9ad97b7e5: baseline-arm-clabbe 2026-03-25 23:38:55,604 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cf012b2b51e9ad97b7e5 2026-03-25 23:38:55,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:38:55,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf012b2b51e9ad97b7e5 HTTP/1.1" 200 None 2026-03-25 23:38:55,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:38:55,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:38:55,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:38:55,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cf012b2b51e9ad97b7e5 HTTP/1.1" 200 None 2026-03-25 23:38:55,670 - lava_callback - ERROR - Error processing callback for node 69c1cf012b2b51e9ad97b7e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40040 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:39:26,308 - lava_callback - INFO - Received callback for node 69c1cf252b2b51e9ad97b7ef INFO: 172.21.0.1:44582 - "POST /node/69c1cf252b2b51e9ad97b7ef HTTP/1.0" 202 Accepted 2026-03-25 23:39:26,313 - lava_callback - INFO - Starting async job submit for node 69c1cf252b2b51e9ad97b7ef 2026-03-25 23:39:26,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:39:26,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf252b2b51e9ad97b7ef HTTP/1.1" 200 None 2026-03-25 23:39:26,330 - lava_callback - DEBUG - Processing node 69c1cf252b2b51e9ad97b7ef: baseline-arm-baylibre 2026-03-25 23:39:26,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cf252b2b51e9ad97b7ef 2026-03-25 23:39:26,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:39:26,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf252b2b51e9ad97b7ef HTTP/1.1" 200 None 2026-03-25 23:39:26,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:39:26,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:39:26,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:39:26,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cf252b2b51e9ad97b7ef HTTP/1.1" 200 None 2026-03-25 23:39:26,398 - lava_callback - ERROR - Error processing callback for node 69c1cf252b2b51e9ad97b7ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54204 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:40:06,138 - lava_callback - INFO - Received callback for node 69c1cf4c2b2b51e9ad97b7f9 INFO: 172.21.0.1:48698 - "POST /node/69c1cf4c2b2b51e9ad97b7f9 HTTP/1.0" 202 Accepted 2026-03-25 23:40:06,143 - lava_callback - INFO - Starting async job submit for node 69c1cf4c2b2b51e9ad97b7f9 2026-03-25 23:40:06,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:40:06,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf4c2b2b51e9ad97b7f9 HTTP/1.1" 200 None 2026-03-25 23:40:06,159 - lava_callback - DEBUG - Processing node 69c1cf4c2b2b51e9ad97b7f9: baseline-arm-baylibre 2026-03-25 23:40:06,160 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cf4c2b2b51e9ad97b7f9 2026-03-25 23:40:06,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:40:06,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf4c2b2b51e9ad97b7f9 HTTP/1.1" 200 None 2026-03-25 23:40:06,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:40:06,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:40:06,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:40:06,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cf4c2b2b51e9ad97b7f9 HTTP/1.1" 200 None 2026-03-25 23:40:06,218 - lava_callback - ERROR - Error processing callback for node 69c1cf4c2b2b51e9ad97b7f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56256 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:40:55,681 - lava_callback - INFO - Received callback for node 69c1cf742b2b51e9ad97b802 INFO: 172.21.0.1:56260 - "POST /node/69c1cf742b2b51e9ad97b802 HTTP/1.0" 202 Accepted 2026-03-25 23:40:55,686 - lava_callback - INFO - Starting async job submit for node 69c1cf742b2b51e9ad97b802 2026-03-25 23:40:55,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:40:55,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf742b2b51e9ad97b802 HTTP/1.1" 200 None 2026-03-25 23:40:55,702 - lava_callback - DEBUG - Processing node 69c1cf742b2b51e9ad97b802: baseline-arm-clabbe 2026-03-25 23:40:55,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cf742b2b51e9ad97b802 2026-03-25 23:40:55,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:40:55,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf742b2b51e9ad97b802 HTTP/1.1" 200 None 2026-03-25 23:40:55,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:40:55,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:40:55,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:40:55,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cf742b2b51e9ad97b802 HTTP/1.1" 200 None 2026-03-25 23:40:55,766 - lava_callback - ERROR - Error processing callback for node 69c1cf742b2b51e9ad97b802: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38904 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:41:35,711 - lava_callback - INFO - Received callback for node 69c1cf9d2b2b51e9ad97b80c INFO: 172.21.0.1:34616 - "POST /node/69c1cf9d2b2b51e9ad97b80c HTTP/1.0" 202 Accepted 2026-03-25 23:41:35,716 - lava_callback - INFO - Starting async job submit for node 69c1cf9d2b2b51e9ad97b80c 2026-03-25 23:41:35,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:41:35,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf9d2b2b51e9ad97b80c HTTP/1.1" 200 None 2026-03-25 23:41:35,733 - lava_callback - DEBUG - Processing node 69c1cf9d2b2b51e9ad97b80c: baseline-arm-clabbe 2026-03-25 23:41:35,733 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cf9d2b2b51e9ad97b80c 2026-03-25 23:41:35,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:41:35,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cf9d2b2b51e9ad97b80c HTTP/1.1" 200 None 2026-03-25 23:41:35,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:41:35,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:41:35,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:41:35,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cf9d2b2b51e9ad97b80c HTTP/1.1" 200 None 2026-03-25 23:41:35,794 - lava_callback - ERROR - Error processing callback for node 69c1cf9d2b2b51e9ad97b80c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44042 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 23:42:15,762 - lava_callback - INFO - Received callback for node 69c1cfc32b2b51e9ad97b817 INFO: 172.21.0.1:44046 - "POST /node/69c1cfc32b2b51e9ad97b817 HTTP/1.0" 202 Accepted 2026-03-25 23:42:15,768 - lava_callback - INFO - Starting async job submit for node 69c1cfc32b2b51e9ad97b817 2026-03-25 23:42:15,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:42:15,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cfc32b2b51e9ad97b817 HTTP/1.1" 200 None 2026-03-25 23:42:15,796 - lava_callback - DEBUG - Processing node 69c1cfc32b2b51e9ad97b817: baseline-arm-clabbe 2026-03-25 23:42:15,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cfc32b2b51e9ad97b817 2026-03-25 23:42:15,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:42:15,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cfc32b2b51e9ad97b817 HTTP/1.1" 200 None 2026-03-25 23:42:15,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:42:15,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:42:15,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:42:15,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cfc32b2b51e9ad97b817 HTTP/1.1" 200 None 2026-03-25 23:42:15,856 - lava_callback - ERROR - Error processing callback for node 69c1cfc32b2b51e9ad97b817: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49436 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:42:55,742 - lava_callback - INFO - Received callback for node 69c1cfeb2b2b51e9ad97b81f INFO: 172.21.0.1:49448 - "POST /node/69c1cfeb2b2b51e9ad97b81f HTTP/1.0" 202 Accepted 2026-03-25 23:42:55,747 - lava_callback - INFO - Starting async job submit for node 69c1cfeb2b2b51e9ad97b81f 2026-03-25 23:42:55,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:42:55,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cfeb2b2b51e9ad97b81f HTTP/1.1" 200 None 2026-03-25 23:42:55,763 - lava_callback - DEBUG - Processing node 69c1cfeb2b2b51e9ad97b81f: baseline-arm-clabbe 2026-03-25 23:42:55,764 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1cfeb2b2b51e9ad97b81f 2026-03-25 23:42:55,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:42:55,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1cfeb2b2b51e9ad97b81f HTTP/1.1" 200 None 2026-03-25 23:42:55,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:42:55,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:42:55,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:42:55,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1cfeb2b2b51e9ad97b81f HTTP/1.1" 200 None 2026-03-25 23:42:55,817 - lava_callback - ERROR - Error processing callback for node 69c1cfeb2b2b51e9ad97b81f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:43:35,792 - lava_callback - INFO - Received callback for node 69c1d0132b2b51e9ad97b828 INFO: 172.21.0.1:44448 - "POST /node/69c1d0132b2b51e9ad97b828 HTTP/1.0" 202 Accepted 2026-03-25 23:43:35,797 - lava_callback - INFO - Starting async job submit for node 69c1d0132b2b51e9ad97b828 2026-03-25 23:43:35,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:43:35,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d0132b2b51e9ad97b828 HTTP/1.1" 200 None 2026-03-25 23:43:35,814 - lava_callback - DEBUG - Processing node 69c1d0132b2b51e9ad97b828: baseline-arm-clabbe 2026-03-25 23:43:35,814 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d0132b2b51e9ad97b828 2026-03-25 23:43:35,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:43:35,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d0132b2b51e9ad97b828 HTTP/1.1" 200 None 2026-03-25 23:43:35,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:43:35,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:43:35,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:43:35,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d0132b2b51e9ad97b828 HTTP/1.1" 200 None 2026-03-25 23:43:35,877 - lava_callback - ERROR - Error processing callback for node 69c1d0132b2b51e9ad97b828: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 23:44:15,803 - lava_callback - INFO - Received callback for node 69c1d03b2b2b51e9ad97b834 INFO: 172.21.0.1:39268 - "POST /node/69c1d03b2b2b51e9ad97b834 HTTP/1.0" 202 Accepted 2026-03-25 23:44:15,809 - lava_callback - INFO - Starting async job submit for node 69c1d03b2b2b51e9ad97b834 2026-03-25 23:44:15,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:44:15,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d03b2b2b51e9ad97b834 HTTP/1.1" 200 None 2026-03-25 23:44:15,833 - lava_callback - DEBUG - Processing node 69c1d03b2b2b51e9ad97b834: baseline-arm-clabbe 2026-03-25 23:44:15,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d03b2b2b51e9ad97b834 2026-03-25 23:44:15,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:44:15,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d03b2b2b51e9ad97b834 HTTP/1.1" 200 None 2026-03-25 23:44:15,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:44:15,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:44:15,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:44:15,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d03b2b2b51e9ad97b834 HTTP/1.1" 200 None 2026-03-25 23:44:15,895 - lava_callback - ERROR - Error processing callback for node 69c1d03b2b2b51e9ad97b834: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43446 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:44:35,864 - lava_callback - INFO - Received callback for node 69c1d0612b2b51e9ad97b83b INFO: 172.21.0.1:41048 - "POST /node/69c1d0612b2b51e9ad97b83b HTTP/1.0" 202 Accepted 2026-03-25 23:44:35,870 - lava_callback - INFO - Starting async job submit for node 69c1d0612b2b51e9ad97b83b 2026-03-25 23:44:35,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:44:35,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d0612b2b51e9ad97b83b HTTP/1.1" 200 None 2026-03-25 23:44:35,885 - lava_callback - DEBUG - Processing node 69c1d0612b2b51e9ad97b83b: baseline-arm-clabbe 2026-03-25 23:44:35,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d0612b2b51e9ad97b83b 2026-03-25 23:44:35,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:44:35,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d0612b2b51e9ad97b83b HTTP/1.1" 200 None 2026-03-25 23:44:35,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:44:35,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:44:35,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:44:35,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d0612b2b51e9ad97b83b HTTP/1.1" 200 None 2026-03-25 23:44:35,952 - lava_callback - ERROR - Error processing callback for node 69c1d0612b2b51e9ad97b83b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45732 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 23:45:15,824 - lava_callback - INFO - Received callback for node 69c1d0862b2b51e9ad97b845 INFO: 172.21.0.1:45742 - "POST /node/69c1d0862b2b51e9ad97b845 HTTP/1.0" 202 Accepted 2026-03-25 23:45:15,829 - lava_callback - INFO - Starting async job submit for node 69c1d0862b2b51e9ad97b845 2026-03-25 23:45:15,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:45:15,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d0862b2b51e9ad97b845 HTTP/1.1" 200 None 2026-03-25 23:45:15,851 - lava_callback - DEBUG - Processing node 69c1d0862b2b51e9ad97b845: baseline-arm-clabbe 2026-03-25 23:45:15,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d0862b2b51e9ad97b845 2026-03-25 23:45:15,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:45:15,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d0862b2b51e9ad97b845 HTTP/1.1" 200 None 2026-03-25 23:45:15,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:45:15,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-25 23:45:15,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:45:15,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d0862b2b51e9ad97b845 HTTP/1.1" 200 None 2026-03-25 23:45:15,916 - lava_callback - ERROR - Error processing callback for node 69c1d0862b2b51e9ad97b845: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52904 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:48:06,514 - lava_callback - INFO - Received callback for node 69c1d12d2b2b51e9ad97b852 INFO: 172.21.0.1:52920 - "POST /node/69c1d12d2b2b51e9ad97b852 HTTP/1.0" 202 Accepted 2026-03-25 23:48:06,519 - lava_callback - INFO - Starting async job submit for node 69c1d12d2b2b51e9ad97b852 2026-03-25 23:48:06,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:48:06,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d12d2b2b51e9ad97b852 HTTP/1.1" 200 None 2026-03-25 23:48:06,538 - lava_callback - DEBUG - Processing node 69c1d12d2b2b51e9ad97b852: baseline-arm-baylibre 2026-03-25 23:48:06,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d12d2b2b51e9ad97b852 2026-03-25 23:48:06,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:48:06,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d12d2b2b51e9ad97b852 HTTP/1.1" 200 None 2026-03-25 23:48:06,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:48:06,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:48:06,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:48:06,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d12d2b2b51e9ad97b852 HTTP/1.1" 200 None 2026-03-25 23:48:06,593 - lava_callback - ERROR - Error processing callback for node 69c1d12d2b2b51e9ad97b852: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49326 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:49:06,599 - lava_callback - INFO - Received callback for node 69c1d16a2b2b51e9ad97b85f INFO: 172.21.0.1:49342 - "POST /node/69c1d16a2b2b51e9ad97b85f HTTP/1.0" 202 Accepted 2026-03-25 23:49:06,605 - lava_callback - INFO - Starting async job submit for node 69c1d16a2b2b51e9ad97b85f 2026-03-25 23:49:06,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:49:06,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d16a2b2b51e9ad97b85f HTTP/1.1" 200 None 2026-03-25 23:49:06,622 - lava_callback - DEBUG - Processing node 69c1d16a2b2b51e9ad97b85f: baseline-arm-baylibre 2026-03-25 23:49:06,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d16a2b2b51e9ad97b85f 2026-03-25 23:49:06,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:49:06,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d16a2b2b51e9ad97b85f HTTP/1.1" 200 None 2026-03-25 23:49:06,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:49:06,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:49:06,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:49:06,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d16a2b2b51e9ad97b85f HTTP/1.1" 200 None 2026-03-25 23:49:06,681 - lava_callback - ERROR - Error processing callback for node 69c1d16a2b2b51e9ad97b85f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52818 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:50:06,901 - lava_callback - INFO - Received callback for node 69c1d1a62b2b51e9ad97b86c INFO: 172.21.0.1:52834 - "POST /node/69c1d1a62b2b51e9ad97b86c HTTP/1.0" 202 Accepted 2026-03-25 23:50:06,910 - lava_callback - INFO - Starting async job submit for node 69c1d1a62b2b51e9ad97b86c 2026-03-25 23:50:06,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:50:06,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d1a62b2b51e9ad97b86c HTTP/1.1" 200 None 2026-03-25 23:50:06,932 - lava_callback - DEBUG - Processing node 69c1d1a62b2b51e9ad97b86c: baseline-arm-baylibre 2026-03-25 23:50:06,932 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d1a62b2b51e9ad97b86c 2026-03-25 23:50:06,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:50:06,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d1a62b2b51e9ad97b86c HTTP/1.1" 200 None 2026-03-25 23:50:06,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:50:06,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:50:06,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:50:07,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d1a62b2b51e9ad97b86c HTTP/1.1" 200 None 2026-03-25 23:50:07,008 - lava_callback - ERROR - Error processing callback for node 69c1d1a62b2b51e9ad97b86c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:51:06,684 - lava_callback - INFO - Received callback for node 69c1d1e32b2b51e9ad97b87a INFO: 172.21.0.1:56280 - "POST /node/69c1d1e32b2b51e9ad97b87a HTTP/1.0" 202 Accepted 2026-03-25 23:51:06,689 - lava_callback - INFO - Starting async job submit for node 69c1d1e32b2b51e9ad97b87a 2026-03-25 23:51:06,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:51:06,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d1e32b2b51e9ad97b87a HTTP/1.1" 200 None 2026-03-25 23:51:06,707 - lava_callback - DEBUG - Processing node 69c1d1e32b2b51e9ad97b87a: baseline-arm-baylibre 2026-03-25 23:51:06,707 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d1e32b2b51e9ad97b87a 2026-03-25 23:51:06,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:51:06,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d1e32b2b51e9ad97b87a HTTP/1.1" 200 None 2026-03-25 23:51:06,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:51:06,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:51:06,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:51:06,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d1e32b2b51e9ad97b87a HTTP/1.1" 200 None 2026-03-25 23:51:06,762 - lava_callback - ERROR - Error processing callback for node 69c1d1e32b2b51e9ad97b87a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50596 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:51:56,169 - lava_callback - INFO - Received callback for node 69c1d20d2b2b51e9ad97b886 INFO: 172.21.0.1:50600 - "POST /node/69c1d20d2b2b51e9ad97b886 HTTP/1.0" 202 Accepted 2026-03-25 23:51:56,174 - lava_callback - INFO - Starting async job submit for node 69c1d20d2b2b51e9ad97b886 2026-03-25 23:51:56,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:51:56,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d20d2b2b51e9ad97b886 HTTP/1.1" 200 None 2026-03-25 23:51:56,191 - lava_callback - DEBUG - Processing node 69c1d20d2b2b51e9ad97b886: baseline-arm-clabbe 2026-03-25 23:51:56,191 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d20d2b2b51e9ad97b886 2026-03-25 23:51:56,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:51:56,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d20d2b2b51e9ad97b886 HTTP/1.1" 200 None 2026-03-25 23:51:56,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:51:56,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:51:56,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:51:56,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d20d2b2b51e9ad97b886 HTTP/1.1" 200 None 2026-03-25 23:51:56,246 - lava_callback - ERROR - Error processing callback for node 69c1d20d2b2b51e9ad97b886: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33768 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:52:26,862 - lava_callback - INFO - Received callback for node 69c1d2322b2b51e9ad97b894 INFO: 172.21.0.1:33770 - "POST /node/69c1d2322b2b51e9ad97b894 HTTP/1.0" 202 Accepted 2026-03-25 23:52:26,868 - lava_callback - INFO - Starting async job submit for node 69c1d2322b2b51e9ad97b894 2026-03-25 23:52:26,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:52:26,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2322b2b51e9ad97b894 HTTP/1.1" 200 None 2026-03-25 23:52:26,885 - lava_callback - DEBUG - Processing node 69c1d2322b2b51e9ad97b894: baseline-arm-baylibre 2026-03-25 23:52:26,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d2322b2b51e9ad97b894 2026-03-25 23:52:26,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:52:26,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2322b2b51e9ad97b894 HTTP/1.1" 200 None 2026-03-25 23:52:26,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:52:26,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:52:26,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:52:26,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d2322b2b51e9ad97b894 HTTP/1.1" 200 None 2026-03-25 23:52:26,936 - lava_callback - ERROR - Error processing callback for node 69c1d2322b2b51e9ad97b894: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:53:06,818 - lava_callback - INFO - Received callback for node 69c1d2562b2b51e9ad97b89d INFO: 172.21.0.1:53162 - "POST /node/69c1d2562b2b51e9ad97b89d HTTP/1.0" 202 Accepted 2026-03-25 23:53:06,824 - lava_callback - INFO - Starting async job submit for node 69c1d2562b2b51e9ad97b89d 2026-03-25 23:53:06,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:53:06,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2562b2b51e9ad97b89d HTTP/1.1" 200 None 2026-03-25 23:53:06,840 - lava_callback - DEBUG - Processing node 69c1d2562b2b51e9ad97b89d: baseline-arm-baylibre 2026-03-25 23:53:06,840 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d2562b2b51e9ad97b89d 2026-03-25 23:53:06,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:53:06,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2562b2b51e9ad97b89d HTTP/1.1" 200 None 2026-03-25 23:53:06,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:53:06,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:53:06,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:53:06,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d2562b2b51e9ad97b89d HTTP/1.1" 200 None 2026-03-25 23:53:06,895 - lava_callback - ERROR - Error processing callback for node 69c1d2562b2b51e9ad97b89d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47950 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:53:56,179 - lava_callback - INFO - Received callback for node 69c1d2812b2b51e9ad97b8ac INFO: 172.21.0.1:47956 - "POST /node/69c1d2812b2b51e9ad97b8ac HTTP/1.0" 202 Accepted 2026-03-25 23:53:56,185 - lava_callback - INFO - Starting async job submit for node 69c1d2812b2b51e9ad97b8ac 2026-03-25 23:53:56,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:53:56,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2812b2b51e9ad97b8ac HTTP/1.1" 200 None 2026-03-25 23:53:56,201 - lava_callback - DEBUG - Processing node 69c1d2812b2b51e9ad97b8ac: baseline-arm-clabbe 2026-03-25 23:53:56,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d2812b2b51e9ad97b8ac 2026-03-25 23:53:56,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:53:56,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2812b2b51e9ad97b8ac HTTP/1.1" 200 None 2026-03-25 23:53:56,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:53:56,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:53:56,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:53:56,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d2812b2b51e9ad97b8ac HTTP/1.1" 200 None 2026-03-25 23:53:56,268 - lava_callback - ERROR - Error processing callback for node 69c1d2812b2b51e9ad97b8ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36752 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:54:26,966 - lava_callback - INFO - Received callback for node 69c1d2a62b2b51e9ad97b8b8 INFO: 172.21.0.1:36764 - "POST /node/69c1d2a62b2b51e9ad97b8b8 HTTP/1.0" 202 Accepted 2026-03-25 23:54:26,972 - lava_callback - INFO - Starting async job submit for node 69c1d2a62b2b51e9ad97b8b8 2026-03-25 23:54:26,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:54:26,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2a62b2b51e9ad97b8b8 HTTP/1.1" 200 None 2026-03-25 23:54:26,987 - lava_callback - DEBUG - Processing node 69c1d2a62b2b51e9ad97b8b8: baseline-arm-baylibre 2026-03-25 23:54:26,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d2a62b2b51e9ad97b8b8 2026-03-25 23:54:26,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:54:27,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2a62b2b51e9ad97b8b8 HTTP/1.1" 200 None 2026-03-25 23:54:27,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:54:27,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:54:27,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:54:27,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d2a62b2b51e9ad97b8b8 HTTP/1.1" 200 None 2026-03-25 23:54:27,055 - lava_callback - ERROR - Error processing callback for node 69c1d2a62b2b51e9ad97b8b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33146 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 23:55:16,229 - lava_callback - INFO - Received callback for node 69c1d2ce2b2b51e9ad97b8c5 INFO: 172.21.0.1:33152 - "POST /node/69c1d2ce2b2b51e9ad97b8c5 HTTP/1.0" 202 Accepted 2026-03-25 23:55:16,234 - lava_callback - INFO - Starting async job submit for node 69c1d2ce2b2b51e9ad97b8c5 2026-03-25 23:55:16,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:55:16,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2ce2b2b51e9ad97b8c5 HTTP/1.1" 200 None 2026-03-25 23:55:16,250 - lava_callback - DEBUG - Processing node 69c1d2ce2b2b51e9ad97b8c5: baseline-arm-clabbe 2026-03-25 23:55:16,251 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d2ce2b2b51e9ad97b8c5 2026-03-25 23:55:16,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:55:16,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2ce2b2b51e9ad97b8c5 HTTP/1.1" 200 None 2026-03-25 23:55:16,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:55:16,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:55:16,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:55:16,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d2ce2b2b51e9ad97b8c5 HTTP/1.1" 200 None 2026-03-25 23:55:16,305 - lava_callback - ERROR - Error processing callback for node 69c1d2ce2b2b51e9ad97b8c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:55:36,225 - lava_callback - INFO - Received callback for node 69c1d2f42b2b51e9ad97b8cf INFO: 172.21.0.1:35124 - "POST /node/69c1d2f42b2b51e9ad97b8cf HTTP/1.0" 202 Accepted 2026-03-25 23:55:36,231 - lava_callback - INFO - Starting async job submit for node 69c1d2f42b2b51e9ad97b8cf 2026-03-25 23:55:36,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:55:36,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2f42b2b51e9ad97b8cf HTTP/1.1" 200 None 2026-03-25 23:55:36,247 - lava_callback - DEBUG - Processing node 69c1d2f42b2b51e9ad97b8cf: baseline-arm-clabbe 2026-03-25 23:55:36,247 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d2f42b2b51e9ad97b8cf 2026-03-25 23:55:36,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:55:36,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d2f42b2b51e9ad97b8cf HTTP/1.1" 200 None 2026-03-25 23:55:36,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:55:36,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:55:36,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:55:36,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d2f42b2b51e9ad97b8cf HTTP/1.1" 200 None 2026-03-25 23:55:36,311 - lava_callback - ERROR - Error processing callback for node 69c1d2f42b2b51e9ad97b8cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58862 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-25 23:56:16,286 - lava_callback - INFO - Received callback for node 69c1d31b2b2b51e9ad97b8ec INFO: 172.21.0.1:58866 - "POST /node/69c1d31b2b2b51e9ad97b8ec HTTP/1.0" 202 Accepted 2026-03-25 23:56:16,291 - lava_callback - INFO - Starting async job submit for node 69c1d31b2b2b51e9ad97b8ec 2026-03-25 23:56:16,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:56:16,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d31b2b2b51e9ad97b8ec HTTP/1.1" 200 None 2026-03-25 23:56:16,320 - lava_callback - DEBUG - Processing node 69c1d31b2b2b51e9ad97b8ec: baseline-arm-clabbe 2026-03-25 23:56:16,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d31b2b2b51e9ad97b8ec 2026-03-25 23:56:16,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:56:16,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d31b2b2b51e9ad97b8ec HTTP/1.1" 200 None 2026-03-25 23:56:16,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:56:16,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:56:16,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:56:16,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d31b2b2b51e9ad97b8ec HTTP/1.1" 200 None 2026-03-25 23:56:16,389 - lava_callback - ERROR - Error processing callback for node 69c1d31b2b2b51e9ad97b8ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41534 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:56:56,321 - lava_callback - INFO - Received callback for node 69c1d3422b2b51e9ad97b8f5 INFO: 172.21.0.1:41536 - "POST /node/69c1d3422b2b51e9ad97b8f5 HTTP/1.0" 202 Accepted 2026-03-25 23:56:56,327 - lava_callback - INFO - Starting async job submit for node 69c1d3422b2b51e9ad97b8f5 2026-03-25 23:56:56,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:56:56,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d3422b2b51e9ad97b8f5 HTTP/1.1" 200 None 2026-03-25 23:56:56,342 - lava_callback - DEBUG - Processing node 69c1d3422b2b51e9ad97b8f5: baseline-arm-clabbe 2026-03-25 23:56:56,343 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d3422b2b51e9ad97b8f5 2026-03-25 23:56:56,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:56:56,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d3422b2b51e9ad97b8f5 HTTP/1.1" 200 None 2026-03-25 23:56:56,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:56:56,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:56:56,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:56:56,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d3422b2b51e9ad97b8f5 HTTP/1.1" 200 None 2026-03-25 23:56:56,431 - lava_callback - ERROR - Error processing callback for node 69c1d3422b2b51e9ad97b8f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK 2026-03-25 23:57:36,401 - lava_callback - INFO - Received callback for node 69c1d3692b2b51e9ad97b931 INFO: 172.21.0.1:48564 - "POST /node/69c1d3692b2b51e9ad97b931 HTTP/1.0" 202 Accepted 2026-03-25 23:57:36,407 - lava_callback - INFO - Starting async job submit for node 69c1d3692b2b51e9ad97b931 2026-03-25 23:57:36,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:57:36,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d3692b2b51e9ad97b931 HTTP/1.1" 200 None 2026-03-25 23:57:36,433 - lava_callback - DEBUG - Processing node 69c1d3692b2b51e9ad97b931: baseline-arm-clabbe 2026-03-25 23:57:36,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d3692b2b51e9ad97b931 2026-03-25 23:57:36,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:57:36,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d3692b2b51e9ad97b931 HTTP/1.1" 200 None 2026-03-25 23:57:36,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:57:36,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-25 23:57:36,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-25 23:57:36,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d3692b2b51e9ad97b931 HTTP/1.1" 200 None 2026-03-25 23:57:36,496 - lava_callback - ERROR - Error processing callback for node 69c1d3692b2b51e9ad97b931: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37520 - "GET / HTTP/1.0" 200 OK 2026-03-26 00:05:36,801 - lava_callback - INFO - Received callback for node 69c1d53c2b2b51e9ad97b99a INFO: 172.21.0.1:37534 - "POST /node/69c1d53c2b2b51e9ad97b99a HTTP/1.0" 202 Accepted 2026-03-26 00:05:36,806 - lava_callback - INFO - Starting async job submit for node 69c1d53c2b2b51e9ad97b99a 2026-03-26 00:05:36,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:05:36,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d53c2b2b51e9ad97b99a HTTP/1.1" 200 None 2026-03-26 00:05:36,823 - lava_callback - DEBUG - Processing node 69c1d53c2b2b51e9ad97b99a: baseline-arm-clabbe 2026-03-26 00:05:36,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d53c2b2b51e9ad97b99a 2026-03-26 00:05:36,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:05:36,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d53c2b2b51e9ad97b99a HTTP/1.1" 200 None 2026-03-26 00:05:36,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:05:36,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-26 00:05:36,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:05:36,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d53c2b2b51e9ad97b99a HTTP/1.1" 200 None 2026-03-26 00:05:36,886 - lava_callback - ERROR - Error processing callback for node 69c1d53c2b2b51e9ad97b99a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38494 - "GET / HTTP/1.0" 200 OK 2026-03-26 00:06:08,161 - lava_callback - INFO - Received callback for node 69c1d5682b2b51e9ad97b9a8 INFO: 172.21.0.1:38498 - "POST /node/69c1d5682b2b51e9ad97b9a8 HTTP/1.0" 202 Accepted 2026-03-26 00:06:08,168 - lava_callback - INFO - Starting async job submit for node 69c1d5682b2b51e9ad97b9a8 2026-03-26 00:06:08,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:06:08,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d5682b2b51e9ad97b9a8 HTTP/1.1" 200 None 2026-03-26 00:06:08,183 - lava_callback - DEBUG - Processing node 69c1d5682b2b51e9ad97b9a8: baseline-arm64-baylibre 2026-03-26 00:06:08,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d5682b2b51e9ad97b9a8 2026-03-26 00:06:08,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:06:08,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d5682b2b51e9ad97b9a8 HTTP/1.1" 200 None 2026-03-26 00:06:08,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:06:08,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-26 00:06:08,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:06:08,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d5682b2b51e9ad97b9a8 HTTP/1.1" 200 None 2026-03-26 00:06:08,242 - lava_callback - ERROR - Error processing callback for node 69c1d5682b2b51e9ad97b9a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET / HTTP/1.0" 200 OK 2026-03-26 00:07:47,649 - lava_callback - INFO - Received callback for node 69c1d5be2b2b51e9ad97b9b7 INFO: 172.21.0.1:41236 - "POST /node/69c1d5be2b2b51e9ad97b9b7 HTTP/1.0" 202 Accepted 2026-03-26 00:07:47,655 - lava_callback - INFO - Starting async job submit for node 69c1d5be2b2b51e9ad97b9b7 2026-03-26 00:07:47,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:07:47,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d5be2b2b51e9ad97b9b7 HTTP/1.1" 200 None 2026-03-26 00:07:47,708 - lava_callback - DEBUG - Processing node 69c1d5be2b2b51e9ad97b9b7: baseline-arm64-baylibre 2026-03-26 00:07:47,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d5be2b2b51e9ad97b9b7 2026-03-26 00:07:47,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:07:47,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d5be2b2b51e9ad97b9b7 HTTP/1.1" 200 None 2026-03-26 00:07:47,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:07:47,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-26 00:07:47,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:07:47,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d5be2b2b51e9ad97b9b7 HTTP/1.1" 200 None 2026-03-26 00:07:47,772 - lava_callback - ERROR - Error processing callback for node 69c1d5be2b2b51e9ad97b9b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK 2026-03-26 00:09:08,063 - lava_callback - INFO - Received callback for node 69c1d6142b2b51e9ad97b9c2 INFO: 172.21.0.1:39300 - "POST /node/69c1d6142b2b51e9ad97b9c2 HTTP/1.0" 202 Accepted 2026-03-26 00:09:08,068 - lava_callback - INFO - Starting async job submit for node 69c1d6142b2b51e9ad97b9c2 2026-03-26 00:09:08,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:09:08,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d6142b2b51e9ad97b9c2 HTTP/1.1" 200 None 2026-03-26 00:09:08,085 - lava_callback - DEBUG - Processing node 69c1d6142b2b51e9ad97b9c2: baseline-arm64-baylibre 2026-03-26 00:09:08,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d6142b2b51e9ad97b9c2 2026-03-26 00:09:08,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:09:08,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d6142b2b51e9ad97b9c2 HTTP/1.1" 200 None 2026-03-26 00:09:08,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:09:08,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-26 00:09:08,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:09:08,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d6142b2b51e9ad97b9c2 HTTP/1.1" 200 None 2026-03-26 00:09:08,142 - lava_callback - ERROR - Error processing callback for node 69c1d6142b2b51e9ad97b9c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40170 - "GET / HTTP/1.0" 200 OK 2026-03-26 00:10:27,831 - lava_callback - INFO - Received callback for node 69c1d66a2b2b51e9ad97b9d2 INFO: 172.21.0.1:40178 - "POST /node/69c1d66a2b2b51e9ad97b9d2 HTTP/1.0" 202 Accepted 2026-03-26 00:10:27,837 - lava_callback - INFO - Starting async job submit for node 69c1d66a2b2b51e9ad97b9d2 2026-03-26 00:10:27,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:10:27,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d66a2b2b51e9ad97b9d2 HTTP/1.1" 200 None 2026-03-26 00:10:27,854 - lava_callback - DEBUG - Processing node 69c1d66a2b2b51e9ad97b9d2: baseline-arm64-baylibre 2026-03-26 00:10:27,854 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d66a2b2b51e9ad97b9d2 2026-03-26 00:10:27,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:10:27,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d66a2b2b51e9ad97b9d2 HTTP/1.1" 200 None 2026-03-26 00:10:27,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:10:27,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-26 00:10:27,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:10:27,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d66a2b2b51e9ad97b9d2 HTTP/1.1" 200 None 2026-03-26 00:10:27,924 - lava_callback - ERROR - Error processing callback for node 69c1d66a2b2b51e9ad97b9d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37878 - "GET / HTTP/1.0" 200 OK 2026-03-26 00:11:48,009 - lava_callback - INFO - Received callback for node 69c1d6bf2b2b51e9ad97b9e2 INFO: 172.21.0.1:37886 - "POST /node/69c1d6bf2b2b51e9ad97b9e2 HTTP/1.0" 202 Accepted 2026-03-26 00:11:48,014 - lava_callback - INFO - Starting async job submit for node 69c1d6bf2b2b51e9ad97b9e2 2026-03-26 00:11:48,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:11:48,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d6bf2b2b51e9ad97b9e2 HTTP/1.1" 200 None 2026-03-26 00:11:48,030 - lava_callback - DEBUG - Processing node 69c1d6bf2b2b51e9ad97b9e2: baseline-arm64-baylibre 2026-03-26 00:11:48,030 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d6bf2b2b51e9ad97b9e2 2026-03-26 00:11:48,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:11:48,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d6bf2b2b51e9ad97b9e2 HTTP/1.1" 200 None 2026-03-26 00:11:48,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:11:48,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-26 00:11:48,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:11:48,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d6bf2b2b51e9ad97b9e2 HTTP/1.1" 200 None 2026-03-26 00:11:48,099 - lava_callback - ERROR - Error processing callback for node 69c1d6bf2b2b51e9ad97b9e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48238 - "GET / HTTP/1.0" 200 OK 2026-03-26 00:13:28,220 - lava_callback - INFO - Received callback for node 69c1d7132b2b51e9ad97b9f2 INFO: 172.21.0.1:48240 - "POST /node/69c1d7132b2b51e9ad97b9f2 HTTP/1.0" 202 Accepted 2026-03-26 00:13:28,228 - lava_callback - INFO - Starting async job submit for node 69c1d7132b2b51e9ad97b9f2 2026-03-26 00:13:28,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:13:28,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d7132b2b51e9ad97b9f2 HTTP/1.1" 200 None 2026-03-26 00:13:28,253 - lava_callback - DEBUG - Processing node 69c1d7132b2b51e9ad97b9f2: baseline-arm64-baylibre 2026-03-26 00:13:28,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c1d7132b2b51e9ad97b9f2 2026-03-26 00:13:28,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:13:28,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1d7132b2b51e9ad97b9f2 HTTP/1.1" 200 None 2026-03-26 00:13:28,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:13:28,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-26 00:13:28,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-26 00:13:28,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1d7132b2b51e9ad97b9f2 HTTP/1.1" 200 None 2026-03-26 00:13:28,334 - lava_callback - ERROR - Error processing callback for node 69c1d7132b2b51e9ad97b9f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39908 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]