INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:58254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34912 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:42:09,204 - lava_callback - INFO - Received callback for node 69caa7d34b5e3e0ab6a60bcf 2026-04-01 16:42:09,211 - lava_callback - INFO - Starting async job submit for node 69caa7d34b5e3e0ab6a60bcf INFO: 172.21.0.1:34922 - "POST /node/69caa7d34b5e3e0ab6a60bcf HTTP/1.0" 202 Accepted 2026-04-01 16:42:09,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:42:09,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa7d34b5e3e0ab6a60bcf HTTP/1.1" 200 None 2026-04-01 16:42:09,234 - lava_callback - DEBUG - Processing node 69caa7d34b5e3e0ab6a60bcf: baseline-arm-clabbe 2026-04-01 16:42:09,235 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caa7d34b5e3e0ab6a60bcf 2026-04-01 16:42:09,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:42:09,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa7d34b5e3e0ab6a60bcf HTTP/1.1" 200 None 2026-04-01 16:42:09,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:42:09,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-04-01 16:42:09,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:42:09,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caa7d34b5e3e0ab6a60bcf HTTP/1.1" 200 None 2026-04-01 16:42:09,307 - lava_callback - ERROR - Error processing callback for node 69caa7d34b5e3e0ab6a60bcf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42768 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:42:49,134 - lava_callback - INFO - Received callback for node 69caa7fb4b5e3e0ab6a60bdb INFO: 172.21.0.1:42778 - "POST /node/69caa7fb4b5e3e0ab6a60bdb HTTP/1.0" 202 Accepted 2026-04-01 16:42:49,140 - lava_callback - INFO - Starting async job submit for node 69caa7fb4b5e3e0ab6a60bdb 2026-04-01 16:42:49,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:42:49,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa7fb4b5e3e0ab6a60bdb HTTP/1.1" 200 None 2026-04-01 16:42:49,156 - lava_callback - DEBUG - Processing node 69caa7fb4b5e3e0ab6a60bdb: baseline-arm-clabbe 2026-04-01 16:42:49,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caa7fb4b5e3e0ab6a60bdb 2026-04-01 16:42:49,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:42:49,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa7fb4b5e3e0ab6a60bdb HTTP/1.1" 200 None 2026-04-01 16:42:49,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:42:49,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-04-01 16:42:49,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:42:49,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caa7fb4b5e3e0ab6a60bdb HTTP/1.1" 200 None 2026-04-01 16:42:49,212 - lava_callback - ERROR - Error processing callback for node 69caa7fb4b5e3e0ab6a60bdb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38438 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:43:29,213 - lava_callback - INFO - Received callback for node 69caa8234b5e3e0ab6a60be8 INFO: 172.21.0.1:38440 - "POST /node/69caa8234b5e3e0ab6a60be8 HTTP/1.0" 202 Accepted 2026-04-01 16:43:29,219 - lava_callback - INFO - Starting async job submit for node 69caa8234b5e3e0ab6a60be8 2026-04-01 16:43:29,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:43:29,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa8234b5e3e0ab6a60be8 HTTP/1.1" 200 None 2026-04-01 16:43:29,234 - lava_callback - DEBUG - Processing node 69caa8234b5e3e0ab6a60be8: baseline-arm-clabbe 2026-04-01 16:43:29,235 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caa8234b5e3e0ab6a60be8 2026-04-01 16:43:29,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:43:29,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa8234b5e3e0ab6a60be8 HTTP/1.1" 200 None 2026-04-01 16:43:29,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:43:29,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-04-01 16:43:29,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:43:29,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caa8234b5e3e0ab6a60be8 HTTP/1.1" 200 None 2026-04-01 16:43:29,295 - lava_callback - ERROR - Error processing callback for node 69caa8234b5e3e0ab6a60be8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52370 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:44:09,180 - lava_callback - INFO - Received callback for node 69caa84b4b5e3e0ab6a60bf1 INFO: 172.21.0.1:52384 - "POST /node/69caa84b4b5e3e0ab6a60bf1 HTTP/1.0" 202 Accepted 2026-04-01 16:44:09,186 - lava_callback - INFO - Starting async job submit for node 69caa84b4b5e3e0ab6a60bf1 2026-04-01 16:44:09,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:44:09,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa84b4b5e3e0ab6a60bf1 HTTP/1.1" 200 None 2026-04-01 16:44:09,209 - lava_callback - DEBUG - Processing node 69caa84b4b5e3e0ab6a60bf1: baseline-arm-clabbe 2026-04-01 16:44:09,209 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caa84b4b5e3e0ab6a60bf1 2026-04-01 16:44:09,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:44:09,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa84b4b5e3e0ab6a60bf1 HTTP/1.1" 200 None 2026-04-01 16:44:09,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:44:09,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-04-01 16:44:09,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:44:09,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caa84b4b5e3e0ab6a60bf1 HTTP/1.1" 200 None 2026-04-01 16:44:09,267 - lava_callback - ERROR - Error processing callback for node 69caa84b4b5e3e0ab6a60bf1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:44:49,214 - lava_callback - INFO - Received callback for node 69caa8734b5e3e0ab6a60bfe INFO: 172.21.0.1:44006 - "POST /node/69caa8734b5e3e0ab6a60bfe HTTP/1.0" 202 Accepted 2026-04-01 16:44:49,220 - lava_callback - INFO - Starting async job submit for node 69caa8734b5e3e0ab6a60bfe 2026-04-01 16:44:49,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:44:49,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa8734b5e3e0ab6a60bfe HTTP/1.1" 200 None 2026-04-01 16:44:49,237 - lava_callback - DEBUG - Processing node 69caa8734b5e3e0ab6a60bfe: baseline-arm-clabbe 2026-04-01 16:44:49,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caa8734b5e3e0ab6a60bfe 2026-04-01 16:44:49,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:44:49,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa8734b5e3e0ab6a60bfe HTTP/1.1" 200 None 2026-04-01 16:44:49,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:44:49,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-04-01 16:44:49,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:44:49,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caa8734b5e3e0ab6a60bfe HTTP/1.1" 200 None 2026-04-01 16:44:49,288 - lava_callback - ERROR - Error processing callback for node 69caa8734b5e3e0ab6a60bfe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59836 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:47:30,851 - lava_callback - INFO - Received callback for node 69caa9164b5e3e0ab6a60c0e INFO: 172.21.0.1:40544 - "POST /node/69caa9164b5e3e0ab6a60c0e HTTP/1.0" 202 Accepted 2026-04-01 16:47:30,857 - lava_callback - INFO - Starting async job submit for node 69caa9164b5e3e0ab6a60c0e 2026-04-01 16:47:30,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:47:30,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa9164b5e3e0ab6a60c0e HTTP/1.1" 200 None 2026-04-01 16:47:30,873 - lava_callback - DEBUG - Processing node 69caa9164b5e3e0ab6a60c0e: baseline-arm-baylibre 2026-04-01 16:47:30,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caa9164b5e3e0ab6a60c0e 2026-04-01 16:47:30,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:47:30,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa9164b5e3e0ab6a60c0e HTTP/1.1" 200 None 2026-04-01 16:47:30,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:47:30,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-04-01 16:47:30,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:47:30,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caa9164b5e3e0ab6a60c0e HTTP/1.1" 200 None 2026-04-01 16:47:30,924 - lava_callback - ERROR - Error processing callback for node 69caa9164b5e3e0ab6a60c0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47420 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:48:50,763 - lava_callback - INFO - Received callback for node 69caa9674b5e3e0ab6a60c19 INFO: 172.21.0.1:54620 - "POST /node/69caa9674b5e3e0ab6a60c19 HTTP/1.0" 202 Accepted 2026-04-01 16:48:50,771 - lava_callback - INFO - Starting async job submit for node 69caa9674b5e3e0ab6a60c19 2026-04-01 16:48:50,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:48:50,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa9674b5e3e0ab6a60c19 HTTP/1.1" 200 None 2026-04-01 16:48:50,800 - lava_callback - DEBUG - Processing node 69caa9674b5e3e0ab6a60c19: baseline-arm-baylibre 2026-04-01 16:48:50,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caa9674b5e3e0ab6a60c19 2026-04-01 16:48:50,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:48:50,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa9674b5e3e0ab6a60c19 HTTP/1.1" 200 None 2026-04-01 16:48:50,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:48:50,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-04-01 16:48:50,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:48:50,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caa9674b5e3e0ab6a60c19 HTTP/1.1" 200 None 2026-04-01 16:48:50,893 - lava_callback - ERROR - Error processing callback for node 69caa9674b5e3e0ab6a60c19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42446 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:49:30,769 - lava_callback - INFO - Received callback for node 69caa98e4b5e3e0ab6a60c25 INFO: 172.21.0.1:35310 - "POST /node/69caa98e4b5e3e0ab6a60c25 HTTP/1.0" 202 Accepted 2026-04-01 16:49:30,778 - lava_callback - INFO - Starting async job submit for node 69caa98e4b5e3e0ab6a60c25 2026-04-01 16:49:30,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:49:30,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa98e4b5e3e0ab6a60c25 HTTP/1.1" 200 None 2026-04-01 16:49:30,807 - lava_callback - DEBUG - Processing node 69caa98e4b5e3e0ab6a60c25: baseline-arm-baylibre 2026-04-01 16:49:30,807 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caa98e4b5e3e0ab6a60c25 2026-04-01 16:49:30,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:49:30,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa98e4b5e3e0ab6a60c25 HTTP/1.1" 200 None 2026-04-01 16:49:30,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:49:30,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-04-01 16:49:30,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:49:30,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caa98e4b5e3e0ab6a60c25 HTTP/1.1" 200 None 2026-04-01 16:49:30,949 - lava_callback - ERROR - Error processing callback for node 69caa98e4b5e3e0ab6a60c25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56446 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:50:50,821 - lava_callback - INFO - Received callback for node 69caa9df4b5e3e0ab6a60c34 INFO: 172.21.0.1:57218 - "POST /node/69caa9df4b5e3e0ab6a60c34 HTTP/1.0" 202 Accepted 2026-04-01 16:50:50,826 - lava_callback - INFO - Starting async job submit for node 69caa9df4b5e3e0ab6a60c34 2026-04-01 16:50:50,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:50:50,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa9df4b5e3e0ab6a60c34 HTTP/1.1" 200 None 2026-04-01 16:50:50,870 - lava_callback - DEBUG - Processing node 69caa9df4b5e3e0ab6a60c34: baseline-arm-baylibre 2026-04-01 16:50:50,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caa9df4b5e3e0ab6a60c34 2026-04-01 16:50:50,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:50:50,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa9df4b5e3e0ab6a60c34 HTTP/1.1" 200 None 2026-04-01 16:50:50,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:50:50,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-04-01 16:50:50,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:50:50,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caa9df4b5e3e0ab6a60c34 HTTP/1.1" 200 None 2026-04-01 16:50:50,926 - lava_callback - ERROR - Error processing callback for node 69caa9df4b5e3e0ab6a60c34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32898 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:52:10,992 - lava_callback - INFO - Received callback for node 69caaa304b5e3e0ab6a60c43 INFO: 172.21.0.1:45676 - "POST /node/69caaa304b5e3e0ab6a60c43 HTTP/1.0" 202 Accepted 2026-04-01 16:52:11,000 - lava_callback - INFO - Starting async job submit for node 69caaa304b5e3e0ab6a60c43 2026-04-01 16:52:11,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:52:11,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caaa304b5e3e0ab6a60c43 HTTP/1.1" 200 None 2026-04-01 16:52:11,017 - lava_callback - DEBUG - Processing node 69caaa304b5e3e0ab6a60c43: baseline-arm-baylibre 2026-04-01 16:52:11,017 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caaa304b5e3e0ab6a60c43 2026-04-01 16:52:11,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:52:11,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caaa304b5e3e0ab6a60c43 HTTP/1.1" 200 None 2026-04-01 16:52:11,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:52:11,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-04-01 16:52:11,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:52:11,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caaa304b5e3e0ab6a60c43 HTTP/1.1" 200 None 2026-04-01 16:52:11,112 - lava_callback - ERROR - Error processing callback for node 69caaa304b5e3e0ab6a60c43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60702 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:53:31,044 - lava_callback - INFO - Received callback for node 69caaa814b5e3e0ab6a63324 INFO: 172.21.0.1:41292 - "POST /node/69caaa814b5e3e0ab6a63324 HTTP/1.0" 202 Accepted 2026-04-01 16:53:31,050 - lava_callback - INFO - Starting async job submit for node 69caaa814b5e3e0ab6a63324 2026-04-01 16:53:31,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:53:31,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caaa814b5e3e0ab6a63324 HTTP/1.1" 200 None 2026-04-01 16:53:31,068 - lava_callback - DEBUG - Processing node 69caaa814b5e3e0ab6a63324: baseline-arm-baylibre 2026-04-01 16:53:31,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caaa814b5e3e0ab6a63324 2026-04-01 16:53:31,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:53:31,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caaa814b5e3e0ab6a63324 HTTP/1.1" 200 None 2026-04-01 16:53:31,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:53:31,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-04-01 16:53:31,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:53:31,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caaa814b5e3e0ab6a63324 HTTP/1.1" 200 None 2026-04-01 16:53:31,129 - lava_callback - ERROR - Error processing callback for node 69caaa814b5e3e0ab6a63324: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34384 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:54:31,057 - lava_callback - INFO - Received callback for node 69caaab64b5e3e0ab6a63340 INFO: 172.21.0.1:48242 - "POST /node/69caaab64b5e3e0ab6a63340 HTTP/1.0" 202 Accepted 2026-04-01 16:54:31,063 - lava_callback - INFO - Starting async job submit for node 69caaab64b5e3e0ab6a63340 2026-04-01 16:54:31,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:54:31,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caaab64b5e3e0ab6a63340 HTTP/1.1" 200 None 2026-04-01 16:54:31,094 - lava_callback - DEBUG - Processing node 69caaab64b5e3e0ab6a63340: baseline-arm64-baylibre 2026-04-01 16:54:31,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caaab64b5e3e0ab6a63340 2026-04-01 16:54:31,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:54:31,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caaab64b5e3e0ab6a63340 HTTP/1.1" 200 None 2026-04-01 16:54:31,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:54:31,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 16:54:31,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:54:31,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caaab64b5e3e0ab6a63340 HTTP/1.1" 200 None 2026-04-01 16:54:31,148 - lava_callback - ERROR - Error processing callback for node 69caaab64b5e3e0ab6a63340: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:55:51,150 - lava_callback - INFO - Received callback for node 69caab024b5e3e0ab6a63350 INFO: 172.21.0.1:52318 - "POST /node/69caab024b5e3e0ab6a63350 HTTP/1.0" 202 Accepted 2026-04-01 16:55:51,156 - lava_callback - INFO - Starting async job submit for node 69caab024b5e3e0ab6a63350 2026-04-01 16:55:51,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:55:51,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab024b5e3e0ab6a63350 HTTP/1.1" 200 None 2026-04-01 16:55:51,171 - lava_callback - DEBUG - Processing node 69caab024b5e3e0ab6a63350: baseline-arm64-baylibre 2026-04-01 16:55:51,171 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caab024b5e3e0ab6a63350 2026-04-01 16:55:51,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:55:51,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab024b5e3e0ab6a63350 HTTP/1.1" 200 None 2026-04-01 16:55:51,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:55:51,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 16:55:51,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:55:51,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab024b5e3e0ab6a63350 HTTP/1.1" 200 None 2026-04-01 16:55:51,231 - lava_callback - ERROR - Error processing callback for node 69caab024b5e3e0ab6a63350: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38766 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:56:51,182 - lava_callback - INFO - Received callback for node 69caab4a4b5e3e0ab6a63397 INFO: 172.21.0.1:56922 - "POST /node/69caab4a4b5e3e0ab6a63397 HTTP/1.0" 202 Accepted 2026-04-01 16:56:51,188 - lava_callback - INFO - Starting async job submit for node 69caab4a4b5e3e0ab6a63397 2026-04-01 16:56:51,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:51,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab4a4b5e3e0ab6a63397 HTTP/1.1" 200 None 2026-04-01 16:56:51,204 - lava_callback - DEBUG - Processing node 69caab4a4b5e3e0ab6a63397: baseline-arm-baylibre 2026-04-01 16:56:51,204 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caab4a4b5e3e0ab6a63397 2026-04-01 16:56:51,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:51,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab4a4b5e3e0ab6a63397 HTTP/1.1" 200 None 2026-04-01 16:56:51,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:51,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 16:56:51,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:51,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab4a4b5e3e0ab6a63397 HTTP/1.1" 200 None 2026-04-01 16:56:51,279 - lava_callback - ERROR - Error processing callback for node 69caab4a4b5e3e0ab6a63397: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 16:56:51,885 - lava_callback - INFO - Received callback for node 69caab4f4b5e3e0ab6a633a7 INFO: 172.21.0.1:56930 - "POST /node/69caab4f4b5e3e0ab6a633a7 HTTP/1.0" 202 Accepted 2026-04-01 16:56:51,890 - lava_callback - INFO - Starting async job submit for node 69caab4f4b5e3e0ab6a633a7 2026-04-01 16:56:51,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:51,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab4f4b5e3e0ab6a633a7 HTTP/1.1" 200 None 2026-04-01 16:56:51,906 - lava_callback - DEBUG - Processing node 69caab4f4b5e3e0ab6a633a7: baseline-arm-baylibre 2026-04-01 16:56:51,906 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caab4f4b5e3e0ab6a633a7 2026-04-01 16:56:51,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:51,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab4f4b5e3e0ab6a633a7 HTTP/1.1" 200 None 2026-04-01 16:56:51,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:51,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 16:56:51,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:51,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab4f4b5e3e0ab6a633a7 HTTP/1.1" 200 None 2026-04-01 16:56:51,961 - lava_callback - ERROR - Error processing callback for node 69caab4f4b5e3e0ab6a633a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 16:56:52,570 - lava_callback - INFO - Received callback for node 69caab484b5e3e0ab6a63384 INFO: 172.21.0.1:56936 - "POST /node/69caab484b5e3e0ab6a63384 HTTP/1.0" 202 Accepted 2026-04-01 16:56:52,576 - lava_callback - INFO - Starting async job submit for node 69caab484b5e3e0ab6a63384 2026-04-01 16:56:52,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:52,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab484b5e3e0ab6a63384 HTTP/1.1" 200 None 2026-04-01 16:56:52,592 - lava_callback - DEBUG - Processing node 69caab484b5e3e0ab6a63384: baseline-arm-baylibre 2026-04-01 16:56:52,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caab484b5e3e0ab6a63384 2026-04-01 16:56:52,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:52,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab484b5e3e0ab6a63384 HTTP/1.1" 200 None 2026-04-01 16:56:52,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:52,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 16:56:52,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:52,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab484b5e3e0ab6a63384 HTTP/1.1" 200 None 2026-04-01 16:56:52,656 - lava_callback - ERROR - Error processing callback for node 69caab484b5e3e0ab6a63384: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 16:56:53,261 - lava_callback - INFO - Received callback for node 69caab494b5e3e0ab6a63387 INFO: 172.21.0.1:56946 - "POST /node/69caab494b5e3e0ab6a63387 HTTP/1.0" 202 Accepted 2026-04-01 16:56:53,267 - lava_callback - INFO - Starting async job submit for node 69caab494b5e3e0ab6a63387 2026-04-01 16:56:53,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:53,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab494b5e3e0ab6a63387 HTTP/1.1" 200 None 2026-04-01 16:56:53,288 - lava_callback - DEBUG - Processing node 69caab494b5e3e0ab6a63387: baseline-arm-baylibre 2026-04-01 16:56:53,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caab494b5e3e0ab6a63387 2026-04-01 16:56:53,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:53,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab494b5e3e0ab6a63387 HTTP/1.1" 200 None 2026-04-01 16:56:53,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:53,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 16:56:53,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:53,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab494b5e3e0ab6a63387 HTTP/1.1" 200 None 2026-04-01 16:56:53,345 - lava_callback - ERROR - Error processing callback for node 69caab494b5e3e0ab6a63387: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 16:56:53,935 - lava_callback - INFO - Received callback for node 69caab4c4b5e3e0ab6a6339a INFO: 172.21.0.1:56952 - "POST /node/69caab4c4b5e3e0ab6a6339a HTTP/1.0" 202 Accepted 2026-04-01 16:56:53,940 - lava_callback - INFO - Starting async job submit for node 69caab4c4b5e3e0ab6a6339a 2026-04-01 16:56:53,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:53,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab4c4b5e3e0ab6a6339a HTTP/1.1" 200 None 2026-04-01 16:56:53,962 - lava_callback - DEBUG - Processing node 69caab4c4b5e3e0ab6a6339a: baseline-arm-baylibre 2026-04-01 16:56:53,962 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caab4c4b5e3e0ab6a6339a 2026-04-01 16:56:53,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:53,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab4c4b5e3e0ab6a6339a HTTP/1.1" 200 None 2026-04-01 16:56:53,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:53,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 16:56:53,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:54,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab4c4b5e3e0ab6a6339a HTTP/1.1" 200 None 2026-04-01 16:56:54,016 - lava_callback - ERROR - Error processing callback for node 69caab4c4b5e3e0ab6a6339a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 16:56:54,599 - lava_callback - INFO - Received callback for node 69caab504b5e3e0ab6a633aa INFO: 172.21.0.1:56962 - "POST /node/69caab504b5e3e0ab6a633aa HTTP/1.0" 202 Accepted 2026-04-01 16:56:54,604 - lava_callback - INFO - Starting async job submit for node 69caab504b5e3e0ab6a633aa 2026-04-01 16:56:54,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:54,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab504b5e3e0ab6a633aa HTTP/1.1" 200 None 2026-04-01 16:56:54,619 - lava_callback - DEBUG - Processing node 69caab504b5e3e0ab6a633aa: baseline-arm-baylibre 2026-04-01 16:56:54,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caab504b5e3e0ab6a633aa 2026-04-01 16:56:54,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:54,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab504b5e3e0ab6a633aa HTTP/1.1" 200 None 2026-04-01 16:56:54,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:54,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 16:56:54,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:56:54,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab504b5e3e0ab6a633aa HTTP/1.1" 200 None 2026-04-01 16:56:54,678 - lava_callback - ERROR - Error processing callback for node 69caab504b5e3e0ab6a633aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38276 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:57:10,050 - lava_callback - INFO - Received callback for node 69caab5a4b5e3e0ab6a633c4 INFO: 172.21.0.1:41348 - "POST /node/69caab5a4b5e3e0ab6a633c4 HTTP/1.0" 202 Accepted 2026-04-01 16:57:10,057 - lava_callback - INFO - Starting async job submit for node 69caab5a4b5e3e0ab6a633c4 2026-04-01 16:57:10,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:10,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab5a4b5e3e0ab6a633c4 HTTP/1.1" 200 None 2026-04-01 16:57:10,073 - lava_callback - DEBUG - Processing node 69caab5a4b5e3e0ab6a633c4: baseline-arm-clabbe 2026-04-01 16:57:10,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caab5a4b5e3e0ab6a633c4 2026-04-01 16:57:10,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:10,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab5a4b5e3e0ab6a633c4 HTTP/1.1" 200 None 2026-04-01 16:57:10,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:10,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 16:57:10,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:10,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab5a4b5e3e0ab6a633c4 HTTP/1.1" 200 None 2026-04-01 16:57:10,125 - lava_callback - ERROR - Error processing callback for node 69caab5a4b5e3e0ab6a633c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 16:57:10,731 - lava_callback - INFO - Received callback for node 69caab604b5e3e0ab6a633d1 INFO: 172.21.0.1:41358 - "POST /node/69caab604b5e3e0ab6a633d1 HTTP/1.0" 202 Accepted 2026-04-01 16:57:10,736 - lava_callback - INFO - Starting async job submit for node 69caab604b5e3e0ab6a633d1 2026-04-01 16:57:10,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:10,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab604b5e3e0ab6a633d1 HTTP/1.1" 200 None 2026-04-01 16:57:10,753 - lava_callback - DEBUG - Processing node 69caab604b5e3e0ab6a633d1: baseline-arm-clabbe 2026-04-01 16:57:10,753 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caab604b5e3e0ab6a633d1 2026-04-01 16:57:10,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:10,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab604b5e3e0ab6a633d1 HTTP/1.1" 200 None 2026-04-01 16:57:10,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:10,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 16:57:10,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:10,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab604b5e3e0ab6a633d1 HTTP/1.1" 200 None 2026-04-01 16:57:10,806 - lava_callback - ERROR - Error processing callback for node 69caab604b5e3e0ab6a633d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 16:57:11,185 - lava_callback - INFO - Received callback for node 69caab554b5e3e0ab6a633b3 INFO: 172.21.0.1:41372 - "POST /node/69caab554b5e3e0ab6a633b3 HTTP/1.0" 202 Accepted 2026-04-01 16:57:11,194 - lava_callback - INFO - Starting async job submit for node 69caab554b5e3e0ab6a633b3 2026-04-01 16:57:11,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:11,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab554b5e3e0ab6a633b3 HTTP/1.1" 200 None 2026-04-01 16:57:11,211 - lava_callback - DEBUG - Processing node 69caab554b5e3e0ab6a633b3: baseline-arm64-baylibre 2026-04-01 16:57:11,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caab554b5e3e0ab6a633b3 2026-04-01 16:57:11,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:11,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab554b5e3e0ab6a633b3 HTTP/1.1" 200 None 2026-04-01 16:57:11,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:11,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 16:57:11,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:11,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab554b5e3e0ab6a633b3 HTTP/1.1" 200 None 2026-04-01 16:57:11,278 - lava_callback - ERROR - Error processing callback for node 69caab554b5e3e0ab6a633b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 16:57:11,404 - lava_callback - INFO - Received callback for node 69caab614b5e3e0ab6a633d5 INFO: 172.21.0.1:41380 - "POST /node/69caab614b5e3e0ab6a633d5 HTTP/1.0" 202 Accepted 2026-04-01 16:57:11,413 - lava_callback - INFO - Starting async job submit for node 69caab614b5e3e0ab6a633d5 2026-04-01 16:57:11,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:11,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab614b5e3e0ab6a633d5 HTTP/1.1" 200 None 2026-04-01 16:57:11,431 - lava_callback - DEBUG - Processing node 69caab614b5e3e0ab6a633d5: baseline-arm-clabbe 2026-04-01 16:57:11,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caab614b5e3e0ab6a633d5 2026-04-01 16:57:11,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:11,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab614b5e3e0ab6a633d5 HTTP/1.1" 200 None 2026-04-01 16:57:11,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:11,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 16:57:11,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:11,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab614b5e3e0ab6a633d5 HTTP/1.1" 200 None 2026-04-01 16:57:11,484 - lava_callback - ERROR - Error processing callback for node 69caab614b5e3e0ab6a633d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 16:57:12,084 - lava_callback - INFO - Received callback for node 69caab624b5e3e0ab6a633d8 INFO: 172.21.0.1:41382 - "POST /node/69caab624b5e3e0ab6a633d8 HTTP/1.0" 202 Accepted 2026-04-01 16:57:12,090 - lava_callback - INFO - Starting async job submit for node 69caab624b5e3e0ab6a633d8 2026-04-01 16:57:12,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:12,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab624b5e3e0ab6a633d8 HTTP/1.1" 200 None 2026-04-01 16:57:12,106 - lava_callback - DEBUG - Processing node 69caab624b5e3e0ab6a633d8: baseline-arm-clabbe 2026-04-01 16:57:12,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caab624b5e3e0ab6a633d8 2026-04-01 16:57:12,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:12,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab624b5e3e0ab6a633d8 HTTP/1.1" 200 None 2026-04-01 16:57:12,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:12,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 16:57:12,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:12,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab624b5e3e0ab6a633d8 HTTP/1.1" 200 None 2026-04-01 16:57:12,170 - lava_callback - ERROR - Error processing callback for node 69caab624b5e3e0ab6a633d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51804 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:57:29,772 - lava_callback - INFO - Received callback for node 69caab664b5e3e0ab6a633e1 INFO: 172.21.0.1:56054 - "POST /node/69caab664b5e3e0ab6a633e1 HTTP/1.0" 202 Accepted 2026-04-01 16:57:29,778 - lava_callback - INFO - Starting async job submit for node 69caab664b5e3e0ab6a633e1 2026-04-01 16:57:29,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:29,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab664b5e3e0ab6a633e1 HTTP/1.1" 200 None 2026-04-01 16:57:29,793 - lava_callback - DEBUG - Processing node 69caab664b5e3e0ab6a633e1: baseline-arm-clabbe 2026-04-01 16:57:29,793 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caab664b5e3e0ab6a633e1 2026-04-01 16:57:29,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:29,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab664b5e3e0ab6a633e1 HTTP/1.1" 200 None 2026-04-01 16:57:29,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:29,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 16:57:29,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:57:29,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab664b5e3e0ab6a633e1 HTTP/1.1" 200 None 2026-04-01 16:57:29,855 - lava_callback - ERROR - Error processing callback for node 69caab664b5e3e0ab6a633e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43854 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:58:29,864 - lava_callback - INFO - Received callback for node 69caabac4b5e3e0ab6a6348a INFO: 172.21.0.1:51726 - "POST /node/69caabac4b5e3e0ab6a6348a HTTP/1.0" 202 Accepted 2026-04-01 16:58:29,873 - lava_callback - INFO - Starting async job submit for node 69caabac4b5e3e0ab6a6348a 2026-04-01 16:58:29,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:58:29,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caabac4b5e3e0ab6a6348a HTTP/1.1" 200 None 2026-04-01 16:58:29,894 - lava_callback - DEBUG - Processing node 69caabac4b5e3e0ab6a6348a: baseline-arm64-clabbe 2026-04-01 16:58:29,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caabac4b5e3e0ab6a6348a 2026-04-01 16:58:29,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:58:29,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caabac4b5e3e0ab6a6348a HTTP/1.1" 200 None 2026-04-01 16:58:29,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:58:29,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 16:58:29,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:58:29,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caabac4b5e3e0ab6a6348a HTTP/1.1" 200 None 2026-04-01 16:58:29,951 - lava_callback - ERROR - Error processing callback for node 69caabac4b5e3e0ab6a6348a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39772 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:59:49,875 - lava_callback - INFO - Received callback for node 69caabfa4b5e3e0ab6a634cf INFO: 172.21.0.1:49894 - "POST /node/69caabfa4b5e3e0ab6a634cf HTTP/1.0" 202 Accepted 2026-04-01 16:59:49,881 - lava_callback - INFO - Starting async job submit for node 69caabfa4b5e3e0ab6a634cf 2026-04-01 16:59:49,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:59:49,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caabfa4b5e3e0ab6a634cf HTTP/1.1" 200 None 2026-04-01 16:59:49,897 - lava_callback - DEBUG - Processing node 69caabfa4b5e3e0ab6a634cf: baseline-arm64-clabbe 2026-04-01 16:59:49,898 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caabfa4b5e3e0ab6a634cf 2026-04-01 16:59:49,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:59:49,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caabfa4b5e3e0ab6a634cf HTTP/1.1" 200 None 2026-04-01 16:59:49,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:59:49,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 16:59:49,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:59:49,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caabfa4b5e3e0ab6a634cf HTTP/1.1" 200 None 2026-04-01 16:59:49,949 - lava_callback - ERROR - Error processing callback for node 69caabfa4b5e3e0ab6a634cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49898 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:00:05,107 - lava_callback - INFO - Received callback for node 69ccdb6874bda3ec93a4177f INFO: 172.21.0.1:36692 - "POST /node/69ccdb6874bda3ec93a4177f HTTP/1.0" 202 Accepted 2026-04-01 17:00:05,113 - lava_callback - INFO - Starting async job submit for node 69ccdb6874bda3ec93a4177f 2026-04-01 17:00:05,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:00:05,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdb6874bda3ec93a4177f HTTP/1.1" 200 None 2026-04-01 17:00:05,146 - lava_callback - DEBUG - Processing node 69ccdb6874bda3ec93a4177f: baseline-x86 2026-04-01 17:00:05,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 17:00:05,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 17:00:05,544 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ccdb6874bda3ec93a4177f/log.txt.gz 2026-04-01 17:00:05,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 17:00:05,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 17:00:05,907 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ccdb6874bda3ec93a4177f/lava-logs.yaml 2026-04-01 17:00:05,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 17:00:06,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 17:00:06,057 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ccdb6874bda3ec93a4177f/lava_callback.json.gz 2026-04-01 17:00:06,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:00:06,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdb6874bda3ec93a4177f HTTP/1.1" 200 None 2026-04-01 17:00:06,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:00:06,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd4a474bda3ec93a41299 HTTP/1.1" 200 None 2026-04-01 17:00:06,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:00:06,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdb6874bda3ec93a4177f HTTP/1.1" 200 None 2026-04-01 17:00:06,138 - lava_callback - INFO - Completed processing callback for node 69ccdb6874bda3ec93a4177f INFO: 172.21.0.1:36694 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:00:09,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:00:09,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51722 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:01:10,147 - lava_callback - INFO - Received callback for node 69caac474b5e3e0ab6a634f1 INFO: 172.21.0.1:35892 - "POST /node/69caac474b5e3e0ab6a634f1 HTTP/1.0" 202 Accepted 2026-04-01 17:01:10,153 - lava_callback - INFO - Starting async job submit for node 69caac474b5e3e0ab6a634f1 2026-04-01 17:01:10,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:01:10,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caac474b5e3e0ab6a634f1 HTTP/1.1" 200 None 2026-04-01 17:01:10,169 - lava_callback - DEBUG - Processing node 69caac474b5e3e0ab6a634f1: baseline-arm64-clabbe 2026-04-01 17:01:10,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caac474b5e3e0ab6a634f1 2026-04-01 17:01:10,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:01:10,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caac474b5e3e0ab6a634f1 HTTP/1.1" 200 None 2026-04-01 17:01:10,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:01:10,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 17:01:10,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:01:10,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caac474b5e3e0ab6a634f1 HTTP/1.1" 200 None 2026-04-01 17:01:10,221 - lava_callback - ERROR - Error processing callback for node 69caac474b5e3e0ab6a634f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57688 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:02:30,026 - lava_callback - INFO - Received callback for node 69caac944b5e3e0ab6a63512 INFO: 172.21.0.1:47712 - "POST /node/69caac944b5e3e0ab6a63512 HTTP/1.0" 202 Accepted 2026-04-01 17:02:30,032 - lava_callback - INFO - Starting async job submit for node 69caac944b5e3e0ab6a63512 2026-04-01 17:02:30,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:02:30,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caac944b5e3e0ab6a63512 HTTP/1.1" 200 None 2026-04-01 17:02:30,049 - lava_callback - DEBUG - Processing node 69caac944b5e3e0ab6a63512: baseline-arm64-clabbe 2026-04-01 17:02:30,049 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caac944b5e3e0ab6a63512 2026-04-01 17:02:30,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:02:30,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caac944b5e3e0ab6a63512 HTTP/1.1" 200 None 2026-04-01 17:02:30,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:02:30,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 17:02:30,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:02:30,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caac944b5e3e0ab6a63512 HTTP/1.1" 200 None 2026-04-01 17:02:30,110 - lava_callback - ERROR - Error processing callback for node 69caac944b5e3e0ab6a63512: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58924 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:03:50,060 - lava_callback - INFO - Received callback for node 69caace04b5e3e0ab6a6351f INFO: 172.21.0.1:53632 - "POST /node/69caace04b5e3e0ab6a6351f HTTP/1.0" 202 Accepted 2026-04-01 17:03:50,066 - lava_callback - INFO - Starting async job submit for node 69caace04b5e3e0ab6a6351f 2026-04-01 17:03:50,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:03:50,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caace04b5e3e0ab6a6351f HTTP/1.1" 200 None 2026-04-01 17:03:50,082 - lava_callback - DEBUG - Processing node 69caace04b5e3e0ab6a6351f: baseline-arm64-clabbe 2026-04-01 17:03:50,082 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caace04b5e3e0ab6a6351f 2026-04-01 17:03:50,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:03:50,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caace04b5e3e0ab6a6351f HTTP/1.1" 200 None 2026-04-01 17:03:50,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:03:50,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 17:03:50,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:03:50,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caace04b5e3e0ab6a6351f HTTP/1.1" 200 None 2026-04-01 17:03:50,157 - lava_callback - ERROR - Error processing callback for node 69caace04b5e3e0ab6a6351f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42968 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:04:50,145 - lava_callback - INFO - Received callback for node 69caad2e4b5e3e0ab6a63541 INFO: 172.21.0.1:33030 - "POST /node/69caad2e4b5e3e0ab6a63541 HTTP/1.0" 202 Accepted 2026-04-01 17:04:50,154 - lava_callback - INFO - Starting async job submit for node 69caad2e4b5e3e0ab6a63541 2026-04-01 17:04:50,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:04:50,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad2e4b5e3e0ab6a63541 HTTP/1.1" 200 None 2026-04-01 17:04:50,196 - lava_callback - DEBUG - Processing node 69caad2e4b5e3e0ab6a63541: baseline-arm64-clabbe 2026-04-01 17:04:50,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caad2e4b5e3e0ab6a63541 2026-04-01 17:04:50,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:04:50,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad2e4b5e3e0ab6a63541 HTTP/1.1" 200 None 2026-04-01 17:04:50,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:04:50,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 17:04:50,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:04:50,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad2e4b5e3e0ab6a63541 HTTP/1.1" 200 None 2026-04-01 17:04:50,284 - lava_callback - ERROR - Error processing callback for node 69caad2e4b5e3e0ab6a63541: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:06:10,223 - lava_callback - INFO - Received callback for node 69caad6e4b5e3e0ab6a63592 INFO: 172.21.0.1:44494 - "POST /node/69caad6e4b5e3e0ab6a63592 HTTP/1.0" 202 Accepted 2026-04-01 17:06:10,231 - lava_callback - INFO - Starting async job submit for node 69caad6e4b5e3e0ab6a63592 2026-04-01 17:06:10,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:10,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad6e4b5e3e0ab6a63592 HTTP/1.1" 200 None 2026-04-01 17:06:10,255 - lava_callback - DEBUG - Processing node 69caad6e4b5e3e0ab6a63592: baseline-arm-clabbe 2026-04-01 17:06:10,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caad6e4b5e3e0ab6a63592 2026-04-01 17:06:10,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:10,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad6e4b5e3e0ab6a63592 HTTP/1.1" 200 None 2026-04-01 17:06:10,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:10,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-04-01 17:06:10,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:10,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad6e4b5e3e0ab6a63592 HTTP/1.1" 200 None 2026-04-01 17:06:10,324 - lava_callback - ERROR - Error processing callback for node 69caad6e4b5e3e0ab6a63592: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52212 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:06:31,736 - lava_callback - INFO - Received callback for node 69caad8a4b5e3e0ab6a635f6 INFO: 172.21.0.1:49770 - "POST /node/69caad8a4b5e3e0ab6a635f6 HTTP/1.0" 202 Accepted 2026-04-01 17:06:31,742 - lava_callback - INFO - Starting async job submit for node 69caad8a4b5e3e0ab6a635f6 2026-04-01 17:06:31,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:31,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad8a4b5e3e0ab6a635f6 HTTP/1.1" 200 None 2026-04-01 17:06:31,759 - lava_callback - DEBUG - Processing node 69caad8a4b5e3e0ab6a635f6: baseline-arm64-baylibre 2026-04-01 17:06:31,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caad8a4b5e3e0ab6a635f6 2026-04-01 17:06:31,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:31,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad8a4b5e3e0ab6a635f6 HTTP/1.1" 200 None 2026-04-01 17:06:31,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:31,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 17:06:31,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:31,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad8a4b5e3e0ab6a635f6 HTTP/1.1" 200 None 2026-04-01 17:06:31,830 - lava_callback - ERROR - Error processing callback for node 69caad8a4b5e3e0ab6a635f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 17:06:32,404 - lava_callback - INFO - Received callback for node 69caad8e4b5e3e0ab6a63600 INFO: 172.21.0.1:49774 - "POST /node/69caad8e4b5e3e0ab6a63600 HTTP/1.0" 202 Accepted 2026-04-01 17:06:32,410 - lava_callback - INFO - Starting async job submit for node 69caad8e4b5e3e0ab6a63600 2026-04-01 17:06:32,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:32,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad8e4b5e3e0ab6a63600 HTTP/1.1" 200 None 2026-04-01 17:06:32,426 - lava_callback - DEBUG - Processing node 69caad8e4b5e3e0ab6a63600: baseline-arm64-baylibre 2026-04-01 17:06:32,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caad8e4b5e3e0ab6a63600 2026-04-01 17:06:32,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:32,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad8e4b5e3e0ab6a63600 HTTP/1.1" 200 None 2026-04-01 17:06:32,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:32,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 17:06:32,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:32,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad8e4b5e3e0ab6a63600 HTTP/1.1" 200 None 2026-04-01 17:06:32,491 - lava_callback - ERROR - Error processing callback for node 69caad8e4b5e3e0ab6a63600: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 17:06:33,073 - lava_callback - INFO - Received callback for node 69caad8f4b5e3e0ab6a63604 INFO: 172.21.0.1:49786 - "POST /node/69caad8f4b5e3e0ab6a63604 HTTP/1.0" 202 Accepted 2026-04-01 17:06:33,079 - lava_callback - INFO - Starting async job submit for node 69caad8f4b5e3e0ab6a63604 2026-04-01 17:06:33,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:33,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad8f4b5e3e0ab6a63604 HTTP/1.1" 200 None 2026-04-01 17:06:33,094 - lava_callback - DEBUG - Processing node 69caad8f4b5e3e0ab6a63604: baseline-arm64-baylibre 2026-04-01 17:06:33,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caad8f4b5e3e0ab6a63604 2026-04-01 17:06:33,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:33,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad8f4b5e3e0ab6a63604 HTTP/1.1" 200 None 2026-04-01 17:06:33,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:33,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 17:06:33,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:33,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad8f4b5e3e0ab6a63604 HTTP/1.1" 200 None 2026-04-01 17:06:33,145 - lava_callback - ERROR - Error processing callback for node 69caad8f4b5e3e0ab6a63604: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49798 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:06:40,837 - lava_callback - INFO - Received callback for node 69cd311e74bda3ec93a42f70 INFO: 172.21.0.1:34552 - "POST /node/69cd311e74bda3ec93a42f70 HTTP/1.0" 202 Accepted 2026-04-01 17:06:40,842 - lava_callback - INFO - Starting async job submit for node 69cd311e74bda3ec93a42f70 2026-04-01 17:06:40,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:40,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cd311e74bda3ec93a42f70 HTTP/1.1" 200 None 2026-04-01 17:06:40,878 - lava_callback - DEBUG - Processing node 69cd311e74bda3ec93a42f70: baseline-x86 2026-04-01 17:06:41,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 17:06:41,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 17:06:41,285 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69cd311e74bda3ec93a42f70/log.txt.gz 2026-04-01 17:06:41,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 17:06:41,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 17:06:41,675 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69cd311e74bda3ec93a42f70/lava-logs.yaml 2026-04-01 17:06:41,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 17:06:42,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 17:06:42,221 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69cd311e74bda3ec93a42f70/lava_callback.json.gz 2026-04-01 17:06:42,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:42,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cd311e74bda3ec93a42f70 HTTP/1.1" 200 None 2026-04-01 17:06:42,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:42,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd4a474bda3ec93a41299 HTTP/1.1" 200 None 2026-04-01 17:06:42,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:42,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cd311e74bda3ec93a42f70 HTTP/1.1" 200 None 2026-04-01 17:06:42,306 - lava_callback - INFO - Completed processing callback for node 69cd311e74bda3ec93a42f70 INFO: 172.21.0.1:34564 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:06:50,217 - lava_callback - INFO - Received callback for node 69caad9e4b5e3e0ab6a6362a INFO: 172.21.0.1:44768 - "POST /node/69caad9e4b5e3e0ab6a6362a HTTP/1.0" 202 Accepted 2026-04-01 17:06:50,226 - lava_callback - INFO - Starting async job submit for node 69caad9e4b5e3e0ab6a6362a 2026-04-01 17:06:50,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:50,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad9e4b5e3e0ab6a6362a HTTP/1.1" 200 None 2026-04-01 17:06:50,272 - lava_callback - DEBUG - Processing node 69caad9e4b5e3e0ab6a6362a: baseline-arm64-clabbe 2026-04-01 17:06:50,272 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caad9e4b5e3e0ab6a6362a 2026-04-01 17:06:50,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:50,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad9e4b5e3e0ab6a6362a HTTP/1.1" 200 None 2026-04-01 17:06:50,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:50,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 17:06:50,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:50,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad9e4b5e3e0ab6a6362a HTTP/1.1" 200 None 2026-04-01 17:06:50,361 - lava_callback - ERROR - Error processing callback for node 69caad9e4b5e3e0ab6a6362a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 17:06:50,913 - lava_callback - INFO - Received callback for node 69caad9f4b5e3e0ab6a6362d INFO: 172.21.0.1:44780 - "POST /node/69caad9f4b5e3e0ab6a6362d HTTP/1.0" 202 Accepted 2026-04-01 17:06:50,919 - lava_callback - INFO - Starting async job submit for node 69caad9f4b5e3e0ab6a6362d 2026-04-01 17:06:50,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:50,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad9f4b5e3e0ab6a6362d HTTP/1.1" 200 None 2026-04-01 17:06:50,939 - lava_callback - DEBUG - Processing node 69caad9f4b5e3e0ab6a6362d: baseline-arm64-clabbe 2026-04-01 17:06:50,939 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caad9f4b5e3e0ab6a6362d 2026-04-01 17:06:50,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:50,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad9f4b5e3e0ab6a6362d HTTP/1.1" 200 None 2026-04-01 17:06:50,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:50,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 17:06:50,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:50,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad9f4b5e3e0ab6a6362d HTTP/1.1" 200 None 2026-04-01 17:06:50,992 - lava_callback - ERROR - Error processing callback for node 69caad9f4b5e3e0ab6a6362d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 17:06:51,594 - lava_callback - INFO - Received callback for node 69caada04b5e3e0ab6a63631 INFO: 172.21.0.1:44782 - "POST /node/69caada04b5e3e0ab6a63631 HTTP/1.0" 202 Accepted 2026-04-01 17:06:51,600 - lava_callback - INFO - Starting async job submit for node 69caada04b5e3e0ab6a63631 2026-04-01 17:06:51,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:51,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caada04b5e3e0ab6a63631 HTTP/1.1" 200 None 2026-04-01 17:06:51,616 - lava_callback - DEBUG - Processing node 69caada04b5e3e0ab6a63631: baseline-arm64-clabbe 2026-04-01 17:06:51,616 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caada04b5e3e0ab6a63631 2026-04-01 17:06:51,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:51,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caada04b5e3e0ab6a63631 HTTP/1.1" 200 None 2026-04-01 17:06:51,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:51,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 17:06:51,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:51,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caada04b5e3e0ab6a63631 HTTP/1.1" 200 None 2026-04-01 17:06:51,678 - lava_callback - ERROR - Error processing callback for node 69caada04b5e3e0ab6a63631: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 17:06:52,279 - lava_callback - INFO - Received callback for node 69caada14b5e3e0ab6a63634 INFO: 172.21.0.1:44798 - "POST /node/69caada14b5e3e0ab6a63634 HTTP/1.0" 202 Accepted 2026-04-01 17:06:52,286 - lava_callback - INFO - Starting async job submit for node 69caada14b5e3e0ab6a63634 2026-04-01 17:06:52,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:52,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caada14b5e3e0ab6a63634 HTTP/1.1" 200 None 2026-04-01 17:06:52,300 - lava_callback - DEBUG - Processing node 69caada14b5e3e0ab6a63634: baseline-arm64-clabbe 2026-04-01 17:06:52,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caada14b5e3e0ab6a63634 2026-04-01 17:06:52,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:52,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caada14b5e3e0ab6a63634 HTTP/1.1" 200 None 2026-04-01 17:06:52,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:52,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 17:06:52,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:52,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caada14b5e3e0ab6a63634 HTTP/1.1" 200 None 2026-04-01 17:06:52,356 - lava_callback - ERROR - Error processing callback for node 69caada14b5e3e0ab6a63634: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 17:06:52,975 - lava_callback - INFO - Received callback for node 69caada44b5e3e0ab6a6365d INFO: 172.21.0.1:44808 - "POST /node/69caada44b5e3e0ab6a6365d HTTP/1.0" 202 Accepted 2026-04-01 17:06:52,984 - lava_callback - INFO - Starting async job submit for node 69caada44b5e3e0ab6a6365d 2026-04-01 17:06:52,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:52,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caada44b5e3e0ab6a6365d HTTP/1.1" 200 None 2026-04-01 17:06:52,999 - lava_callback - DEBUG - Processing node 69caada44b5e3e0ab6a6365d: baseline-arm64-clabbe 2026-04-01 17:06:52,999 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caada44b5e3e0ab6a6365d 2026-04-01 17:06:53,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:53,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caada44b5e3e0ab6a6365d HTTP/1.1" 200 None 2026-04-01 17:06:53,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:53,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 17:06:53,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:53,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caada44b5e3e0ab6a6365d HTTP/1.1" 200 None 2026-04-01 17:06:53,081 - lava_callback - ERROR - Error processing callback for node 69caada44b5e3e0ab6a6365d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 17:06:53,677 - lava_callback - INFO - Received callback for node 69caada34b5e3e0ab6a6365a INFO: 172.21.0.1:44816 - "POST /node/69caada34b5e3e0ab6a6365a HTTP/1.0" 202 Accepted 2026-04-01 17:06:53,685 - lava_callback - INFO - Starting async job submit for node 69caada34b5e3e0ab6a6365a 2026-04-01 17:06:53,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:53,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caada34b5e3e0ab6a6365a HTTP/1.1" 200 None 2026-04-01 17:06:53,716 - lava_callback - DEBUG - Processing node 69caada34b5e3e0ab6a6365a: baseline-arm64-clabbe 2026-04-01 17:06:53,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caada34b5e3e0ab6a6365a 2026-04-01 17:06:53,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:53,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caada34b5e3e0ab6a6365a HTTP/1.1" 200 None 2026-04-01 17:06:53,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:53,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 17:06:53,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:53,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caada34b5e3e0ab6a6365a HTTP/1.1" 200 None 2026-04-01 17:06:53,774 - lava_callback - ERROR - Error processing callback for node 69caada34b5e3e0ab6a6365a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 17:06:54,361 - lava_callback - INFO - Received callback for node 69caad974b5e3e0ab6a63615 INFO: 172.21.0.1:44832 - "POST /node/69caad974b5e3e0ab6a63615 HTTP/1.0" 202 Accepted 2026-04-01 17:06:54,371 - lava_callback - INFO - Starting async job submit for node 69caad974b5e3e0ab6a63615 2026-04-01 17:06:54,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:54,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad974b5e3e0ab6a63615 HTTP/1.1" 200 None 2026-04-01 17:06:54,390 - lava_callback - DEBUG - Processing node 69caad974b5e3e0ab6a63615: baseline-arm-clabbe 2026-04-01 17:06:54,390 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caad974b5e3e0ab6a63615 2026-04-01 17:06:54,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:54,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad974b5e3e0ab6a63615 HTTP/1.1" 200 None 2026-04-01 17:06:54,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:54,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-04-01 17:06:54,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:06:54,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad974b5e3e0ab6a63615 HTTP/1.1" 200 None 2026-04-01 17:06:54,474 - lava_callback - ERROR - Error processing callback for node 69caad974b5e3e0ab6a63615: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45388 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:07:09,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:07:09,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52026 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:09:51,961 - lava_callback - INFO - Received callback for node 69caae4b4b5e3e0ab6a637a1 INFO: 172.21.0.1:32958 - "POST /node/69caae4b4b5e3e0ab6a637a1 HTTP/1.0" 202 Accepted 2026-04-01 17:09:51,968 - lava_callback - INFO - Starting async job submit for node 69caae4b4b5e3e0ab6a637a1 2026-04-01 17:09:51,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:09:51,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caae4b4b5e3e0ab6a637a1 HTTP/1.1" 200 None 2026-04-01 17:09:51,986 - lava_callback - DEBUG - Processing node 69caae4b4b5e3e0ab6a637a1: baseline-arm-baylibre 2026-04-01 17:09:51,986 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caae4b4b5e3e0ab6a637a1 2026-04-01 17:09:51,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:09:52,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caae4b4b5e3e0ab6a637a1 HTTP/1.1" 200 None 2026-04-01 17:09:52,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:09:52,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 17:09:52,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:09:52,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caae4b4b5e3e0ab6a637a1 HTTP/1.1" 200 None 2026-04-01 17:09:52,053 - lava_callback - ERROR - Error processing callback for node 69caae4b4b5e3e0ab6a637a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:12:52,087 - lava_callback - INFO - Received callback for node 69caaf064b5e3e0ab6a6381b INFO: 172.21.0.1:43062 - "POST /node/69caaf064b5e3e0ab6a6381b HTTP/1.0" 202 Accepted 2026-04-01 17:12:52,092 - lava_callback - INFO - Starting async job submit for node 69caaf064b5e3e0ab6a6381b 2026-04-01 17:12:52,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:12:52,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caaf064b5e3e0ab6a6381b HTTP/1.1" 200 None 2026-04-01 17:12:52,116 - lava_callback - DEBUG - Processing node 69caaf064b5e3e0ab6a6381b: baseline-arm-baylibre 2026-04-01 17:12:52,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caaf064b5e3e0ab6a6381b 2026-04-01 17:12:52,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:12:52,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caaf064b5e3e0ab6a6381b HTTP/1.1" 200 None 2026-04-01 17:12:52,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:12:52,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 17:12:52,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:12:52,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caaf064b5e3e0ab6a6381b HTTP/1.1" 200 None 2026-04-01 17:12:52,211 - lava_callback - ERROR - Error processing callback for node 69caaf064b5e3e0ab6a6381b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:13:32,018 - lava_callback - INFO - Received callback for node 69caaf2d4b5e3e0ab6a63827 INFO: 172.21.0.1:53154 - "POST /node/69caaf2d4b5e3e0ab6a63827 HTTP/1.0" 202 Accepted 2026-04-01 17:13:32,023 - lava_callback - INFO - Starting async job submit for node 69caaf2d4b5e3e0ab6a63827 2026-04-01 17:13:32,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:13:32,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caaf2d4b5e3e0ab6a63827 HTTP/1.1" 200 None 2026-04-01 17:13:32,039 - lava_callback - DEBUG - Processing node 69caaf2d4b5e3e0ab6a63827: baseline-arm-baylibre 2026-04-01 17:13:32,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caaf2d4b5e3e0ab6a63827 2026-04-01 17:13:32,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:13:32,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caaf2d4b5e3e0ab6a63827 HTTP/1.1" 200 None 2026-04-01 17:13:32,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:13:32,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 17:13:32,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:13:32,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caaf2d4b5e3e0ab6a63827 HTTP/1.1" 200 None 2026-04-01 17:13:32,091 - lava_callback - ERROR - Error processing callback for node 69caaf2d4b5e3e0ab6a63827: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47230 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:14:12,090 - lava_callback - INFO - Received callback for node 69caaf534b5e3e0ab6a63838 INFO: 172.21.0.1:35334 - "POST /node/69caaf534b5e3e0ab6a63838 HTTP/1.0" 202 Accepted 2026-04-01 17:14:12,096 - lava_callback - INFO - Starting async job submit for node 69caaf534b5e3e0ab6a63838 2026-04-01 17:14:12,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:14:12,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caaf534b5e3e0ab6a63838 HTTP/1.1" 200 None 2026-04-01 17:14:12,112 - lava_callback - DEBUG - Processing node 69caaf534b5e3e0ab6a63838: baseline-arm-baylibre 2026-04-01 17:14:12,112 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caaf534b5e3e0ab6a63838 2026-04-01 17:14:12,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:14:12,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caaf534b5e3e0ab6a63838 HTTP/1.1" 200 None 2026-04-01 17:14:12,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:14:12,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 17:14:12,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:14:12,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caaf534b5e3e0ab6a63838 HTTP/1.1" 200 None 2026-04-01 17:14:12,176 - lava_callback - ERROR - Error processing callback for node 69caaf534b5e3e0ab6a63838: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54350 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:14:52,086 - lava_callback - INFO - Received callback for node 69caaf794b5e3e0ab6a63858 INFO: 172.21.0.1:47646 - "POST /node/69caaf794b5e3e0ab6a63858 HTTP/1.0" 202 Accepted 2026-04-01 17:14:52,091 - lava_callback - INFO - Starting async job submit for node 69caaf794b5e3e0ab6a63858 2026-04-01 17:14:52,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:14:52,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caaf794b5e3e0ab6a63858 HTTP/1.1" 200 None 2026-04-01 17:14:52,139 - lava_callback - DEBUG - Processing node 69caaf794b5e3e0ab6a63858: baseline-arm-baylibre 2026-04-01 17:14:52,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caaf794b5e3e0ab6a63858 2026-04-01 17:14:52,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:14:52,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caaf794b5e3e0ab6a63858 HTTP/1.1" 200 None 2026-04-01 17:14:52,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:14:52,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 17:14:52,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:14:52,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caaf794b5e3e0ab6a63858 HTTP/1.1" 200 None 2026-04-01 17:14:52,204 - lava_callback - ERROR - Error processing callback for node 69caaf794b5e3e0ab6a63858: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34394 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:15:30,663 - lava_callback - INFO - Received callback for node 69caafa04b5e3e0ab6a6386d INFO: 172.21.0.1:39350 - "POST /node/69caafa04b5e3e0ab6a6386d HTTP/1.0" 202 Accepted 2026-04-01 17:15:30,669 - lava_callback - INFO - Starting async job submit for node 69caafa04b5e3e0ab6a6386d 2026-04-01 17:15:30,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:15:30,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caafa04b5e3e0ab6a6386d HTTP/1.1" 200 None 2026-04-01 17:15:30,685 - lava_callback - DEBUG - Processing node 69caafa04b5e3e0ab6a6386d: baseline-arm-clabbe 2026-04-01 17:15:30,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caafa04b5e3e0ab6a6386d 2026-04-01 17:15:30,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:15:30,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caafa04b5e3e0ab6a6386d HTTP/1.1" 200 None 2026-04-01 17:15:30,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:15:30,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 17:15:30,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:15:30,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caafa04b5e3e0ab6a6386d HTTP/1.1" 200 None 2026-04-01 17:15:30,745 - lava_callback - ERROR - Error processing callback for node 69caafa04b5e3e0ab6a6386d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47338 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:16:10,591 - lava_callback - INFO - Received callback for node 69caafc54b5e3e0ab6a6387b INFO: 172.21.0.1:45488 - "POST /node/69caafc54b5e3e0ab6a6387b HTTP/1.0" 202 Accepted 2026-04-01 17:16:10,600 - lava_callback - INFO - Starting async job submit for node 69caafc54b5e3e0ab6a6387b 2026-04-01 17:16:10,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:16:10,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caafc54b5e3e0ab6a6387b HTTP/1.1" 200 None 2026-04-01 17:16:10,615 - lava_callback - DEBUG - Processing node 69caafc54b5e3e0ab6a6387b: baseline-arm-clabbe 2026-04-01 17:16:10,616 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caafc54b5e3e0ab6a6387b 2026-04-01 17:16:10,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:16:10,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caafc54b5e3e0ab6a6387b HTTP/1.1" 200 None 2026-04-01 17:16:10,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:16:10,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 17:16:10,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:16:10,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caafc54b5e3e0ab6a6387b HTTP/1.1" 200 None 2026-04-01 17:16:10,671 - lava_callback - ERROR - Error processing callback for node 69caafc54b5e3e0ab6a6387b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45500 - "GET /node/69831249409235c29c0de8b7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45510 - "GET /node/698a83bcd9a1cfa777a23ac2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38524 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:16:30,664 - lava_callback - INFO - Received callback for node 69caafea4b5e3e0ab6a6388e INFO: 172.21.0.1:52200 - "POST /node/69caafea4b5e3e0ab6a6388e HTTP/1.0" 202 Accepted 2026-04-01 17:16:30,669 - lava_callback - INFO - Starting async job submit for node 69caafea4b5e3e0ab6a6388e 2026-04-01 17:16:30,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:16:30,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caafea4b5e3e0ab6a6388e HTTP/1.1" 200 None 2026-04-01 17:16:30,685 - lava_callback - DEBUG - Processing node 69caafea4b5e3e0ab6a6388e: baseline-arm-clabbe 2026-04-01 17:16:30,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caafea4b5e3e0ab6a6388e 2026-04-01 17:16:30,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:16:30,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caafea4b5e3e0ab6a6388e HTTP/1.1" 200 None 2026-04-01 17:16:30,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:16:30,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 17:16:30,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:16:30,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caafea4b5e3e0ab6a6388e HTTP/1.1" 200 None 2026-04-01 17:16:30,755 - lava_callback - ERROR - Error processing callback for node 69caafea4b5e3e0ab6a6388e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:17:10,636 - lava_callback - INFO - Received callback for node 69cab00f4b5e3e0ab6a638a1 INFO: 172.21.0.1:60844 - "POST /node/69cab00f4b5e3e0ab6a638a1 HTTP/1.0" 202 Accepted 2026-04-01 17:17:10,641 - lava_callback - INFO - Starting async job submit for node 69cab00f4b5e3e0ab6a638a1 2026-04-01 17:17:10,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:17:10,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab00f4b5e3e0ab6a638a1 HTTP/1.1" 200 None 2026-04-01 17:17:10,681 - lava_callback - DEBUG - Processing node 69cab00f4b5e3e0ab6a638a1: baseline-arm-clabbe 2026-04-01 17:17:10,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cab00f4b5e3e0ab6a638a1 2026-04-01 17:17:10,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:17:10,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab00f4b5e3e0ab6a638a1 HTTP/1.1" 200 None 2026-04-01 17:17:10,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:17:10,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 17:17:10,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:17:10,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab00f4b5e3e0ab6a638a1 HTTP/1.1" 200 None 2026-04-01 17:17:10,740 - lava_callback - ERROR - Error processing callback for node 69cab00f4b5e3e0ab6a638a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60856 - "GET /node/69846a673a8748f282086ce2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60872 - "GET /node/693b19ca15f407b7629df79a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:17:50,731 - lava_callback - INFO - Received callback for node 69cab0344b5e3e0ab6a638b8 INFO: 172.21.0.1:43842 - "POST /node/69cab0344b5e3e0ab6a638b8 HTTP/1.0" 202 Accepted 2026-04-01 17:17:50,738 - lava_callback - INFO - Starting async job submit for node 69cab0344b5e3e0ab6a638b8 2026-04-01 17:17:50,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:17:50,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab0344b5e3e0ab6a638b8 HTTP/1.1" 200 None 2026-04-01 17:17:50,753 - lava_callback - DEBUG - Processing node 69cab0344b5e3e0ab6a638b8: baseline-arm-clabbe 2026-04-01 17:17:50,753 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cab0344b5e3e0ab6a638b8 2026-04-01 17:17:50,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:17:50,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab0344b5e3e0ab6a638b8 HTTP/1.1" 200 None 2026-04-01 17:17:50,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:17:50,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 17:17:50,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:17:50,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab0344b5e3e0ab6a638b8 HTTP/1.1" 200 None 2026-04-01 17:17:50,824 - lava_callback - ERROR - Error processing callback for node 69cab0344b5e3e0ab6a638b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44678 - "GET /node/698fcb2d76d4b6342e9d74eb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:18:30,686 - lava_callback - INFO - Received callback for node 69cab0584b5e3e0ab6a638c7 INFO: 172.21.0.1:44986 - "POST /node/69cab0584b5e3e0ab6a638c7 HTTP/1.0" 202 Accepted 2026-04-01 17:18:30,691 - lava_callback - INFO - Starting async job submit for node 69cab0584b5e3e0ab6a638c7 2026-04-01 17:18:30,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:18:30,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab0584b5e3e0ab6a638c7 HTTP/1.1" 200 None 2026-04-01 17:18:30,710 - lava_callback - DEBUG - Processing node 69cab0584b5e3e0ab6a638c7: baseline-arm-clabbe 2026-04-01 17:18:30,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cab0584b5e3e0ab6a638c7 2026-04-01 17:18:30,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:18:30,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab0584b5e3e0ab6a638c7 HTTP/1.1" 200 None 2026-04-01 17:18:30,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:18:30,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-04-01 17:18:30,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:18:30,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab0584b5e3e0ab6a638c7 HTTP/1.1" 200 None 2026-04-01 17:18:30,783 - lava_callback - ERROR - Error processing callback for node 69cab0584b5e3e0ab6a638c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58292 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:19:10,729 - lava_callback - INFO - Received callback for node 69cab07d4b5e3e0ab6a638d0 INFO: 172.21.0.1:57286 - "POST /node/69cab07d4b5e3e0ab6a638d0 HTTP/1.0" 202 Accepted 2026-04-01 17:19:10,735 - lava_callback - INFO - Starting async job submit for node 69cab07d4b5e3e0ab6a638d0 2026-04-01 17:19:10,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:19:10,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab07d4b5e3e0ab6a638d0 HTTP/1.1" 200 None 2026-04-01 17:19:10,751 - lava_callback - DEBUG - Processing node 69cab07d4b5e3e0ab6a638d0: baseline-arm-clabbe 2026-04-01 17:19:10,752 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cab07d4b5e3e0ab6a638d0 2026-04-01 17:19:10,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:19:10,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab07d4b5e3e0ab6a638d0 HTTP/1.1" 200 None 2026-04-01 17:19:10,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:19:10,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-04-01 17:19:10,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:19:10,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab07d4b5e3e0ab6a638d0 HTTP/1.1" 200 None 2026-04-01 17:19:10,807 - lava_callback - ERROR - Error processing callback for node 69cab07d4b5e3e0ab6a638d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:19:50,755 - lava_callback - INFO - Received callback for node 69cab0a14b5e3e0ab6a638dd INFO: 172.21.0.1:38866 - "POST /node/69cab0a14b5e3e0ab6a638dd HTTP/1.0" 202 Accepted 2026-04-01 17:19:50,760 - lava_callback - INFO - Starting async job submit for node 69cab0a14b5e3e0ab6a638dd 2026-04-01 17:19:50,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:19:50,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab0a14b5e3e0ab6a638dd HTTP/1.1" 200 None 2026-04-01 17:19:50,776 - lava_callback - DEBUG - Processing node 69cab0a14b5e3e0ab6a638dd: baseline-arm-clabbe 2026-04-01 17:19:50,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cab0a14b5e3e0ab6a638dd 2026-04-01 17:19:50,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:19:50,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab0a14b5e3e0ab6a638dd HTTP/1.1" 200 None 2026-04-01 17:19:50,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:19:50,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-04-01 17:19:50,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:19:50,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab0a14b5e3e0ab6a638dd HTTP/1.1" 200 None 2026-04-01 17:19:50,831 - lava_callback - ERROR - Error processing callback for node 69cab0a14b5e3e0ab6a638dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET /node/698403f4969566dcb0d2b8d1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37792 - "GET /node/698b77630a16aea5a0dc830a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37800 - "GET /node/698313fa409235c29c0defa1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET /node/69191df5ef36f328cfd41325%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37838 - "GET /node/6986fc696e077e4126a7d554%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54606 - "GET /node/693b0946fee8383e92b715eb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54612 - "GET /node/698af5e63b3beb19e7616eea%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37284 - "GET /node/69497654d45a0a86fbe24c19%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37288 - "GET /node/69c24ed04a2c5046eb88002a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49028 - "GET /node/6986fafa6e077e4126a7d3a3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49032 - "GET /node/6910c2ff699dbc4cda8e19b4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50192 - "GET /node/6986fa866e077e4126a7d32d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50210 - "GET /node/694c15622f7ca341fdeb0df2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET /node/6938c134e767fbc36e03e0fc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39258 - "GET /node/69876e6be31b58f834f1a12f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60912 - "GET /node/6985e3a871989fb14149baeb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60928 - "GET /node/698b67d70a16aea5a0dc7605%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET /node/694cd288cb0ae69445cb1875%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49190 - "GET /node/698620cf177ca0f097bd18c9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44628 - "GET /node/69c18e762b2b51e9ad97aee7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET /node/693b36154b47c3f87266ce2a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36172 - "GET /node/6981c880f633e773758fb9e1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45402 - "GET /node/69865d30177ca0f097bd45d9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45412 - "GET /node/6984585b3a8748f282084e25%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54960 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:45:33,972 - lava_callback - INFO - Received callback for node 69cab6a84b5e3e0ab6a63a3d INFO: 172.21.0.1:39904 - "POST /node/69cab6a84b5e3e0ab6a63a3d HTTP/1.0" 202 Accepted 2026-04-01 17:45:33,977 - lava_callback - INFO - Starting async job submit for node 69cab6a84b5e3e0ab6a63a3d 2026-04-01 17:45:33,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:45:33,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab6a84b5e3e0ab6a63a3d HTTP/1.1" 200 None 2026-04-01 17:45:33,994 - lava_callback - DEBUG - Processing node 69cab6a84b5e3e0ab6a63a3d: baseline-arm64-baylibre 2026-04-01 17:45:33,994 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cab6a84b5e3e0ab6a63a3d 2026-04-01 17:45:33,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:45:34,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab6a84b5e3e0ab6a63a3d HTTP/1.1" 200 None 2026-04-01 17:45:34,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:45:34,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-04-01 17:45:34,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:45:34,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab6a84b5e3e0ab6a63a3d HTTP/1.1" 200 None 2026-04-01 17:45:34,057 - lava_callback - ERROR - Error processing callback for node 69cab6a84b5e3e0ab6a63a3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49202 - "GET /node/6992d9f631166481c8dd4231%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45890 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:48:33,983 - lava_callback - INFO - Received callback for node 69cab7674b5e3e0ab6a63a65 INFO: 172.21.0.1:47548 - "POST /node/69cab7674b5e3e0ab6a63a65 HTTP/1.0" 202 Accepted 2026-04-01 17:48:33,988 - lava_callback - INFO - Starting async job submit for node 69cab7674b5e3e0ab6a63a65 2026-04-01 17:48:33,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:48:34,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab7674b5e3e0ab6a63a65 HTTP/1.1" 200 None 2026-04-01 17:48:34,005 - lava_callback - DEBUG - Processing node 69cab7674b5e3e0ab6a63a65: baseline-arm64-baylibre 2026-04-01 17:48:34,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cab7674b5e3e0ab6a63a65 2026-04-01 17:48:34,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:48:34,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab7674b5e3e0ab6a63a65 HTTP/1.1" 200 None 2026-04-01 17:48:34,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:48:34,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-04-01 17:48:34,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:48:34,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab7674b5e3e0ab6a63a65 HTTP/1.1" 200 None 2026-04-01 17:48:34,066 - lava_callback - ERROR - Error processing callback for node 69cab7674b5e3e0ab6a63a65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44758 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:51:14,218 - lava_callback - INFO - Received callback for node 69cab8004b5e3e0ab6a63a8a INFO: 172.21.0.1:50460 - "POST /node/69cab8004b5e3e0ab6a63a8a HTTP/1.0" 202 Accepted 2026-04-01 17:51:14,224 - lava_callback - INFO - Starting async job submit for node 69cab8004b5e3e0ab6a63a8a 2026-04-01 17:51:14,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:51:14,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab8004b5e3e0ab6a63a8a HTTP/1.1" 200 None 2026-04-01 17:51:14,240 - lava_callback - DEBUG - Processing node 69cab8004b5e3e0ab6a63a8a: baseline-arm64-baylibre 2026-04-01 17:51:14,240 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cab8004b5e3e0ab6a63a8a 2026-04-01 17:51:14,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:51:14,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab8004b5e3e0ab6a63a8a HTTP/1.1" 200 None 2026-04-01 17:51:14,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:51:14,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-04-01 17:51:14,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:51:14,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab8004b5e3e0ab6a63a8a HTTP/1.1" 200 None 2026-04-01 17:51:14,302 - lava_callback - ERROR - Error processing callback for node 69cab8004b5e3e0ab6a63a8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET / HTTP/1.0" 200 OK 2026-04-01 17:53:34,345 - lava_callback - INFO - Received callback for node 69cab89a4b5e3e0ab6a63aa3 INFO: 172.21.0.1:32928 - "POST /node/69cab89a4b5e3e0ab6a63aa3 HTTP/1.0" 202 Accepted 2026-04-01 17:53:34,351 - lava_callback - INFO - Starting async job submit for node 69cab89a4b5e3e0ab6a63aa3 2026-04-01 17:53:34,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:53:34,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab89a4b5e3e0ab6a63aa3 HTTP/1.1" 200 None 2026-04-01 17:53:34,371 - lava_callback - DEBUG - Processing node 69cab89a4b5e3e0ab6a63aa3: baseline-arm64-baylibre 2026-04-01 17:53:34,371 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cab89a4b5e3e0ab6a63aa3 2026-04-01 17:53:34,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:53:34,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab89a4b5e3e0ab6a63aa3 HTTP/1.1" 200 None 2026-04-01 17:53:34,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:53:34,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-04-01 17:53:34,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:53:34,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab89a4b5e3e0ab6a63aa3 HTTP/1.1" 200 None 2026-04-01 17:53:34,439 - lava_callback - ERROR - Error processing callback for node 69cab89a4b5e3e0ab6a63aa3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49372 - "GET /node/69938a74cebe99dd8e0719d8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39328 - "GET /node/6986fe386e077e4126a7db2a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39330 - "GET /node/69c189d92b2b51e9ad97ada8%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-01 17:57:34,436 - lava_callback - INFO - Received callback for node 69cab9814b5e3e0ab6a63acf INFO: 172.21.0.1:50820 - "POST /node/69cab9814b5e3e0ab6a63acf HTTP/1.0" 202 Accepted 2026-04-01 17:57:34,442 - lava_callback - INFO - Starting async job submit for node 69cab9814b5e3e0ab6a63acf 2026-04-01 17:57:34,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:57:34,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab9814b5e3e0ab6a63acf HTTP/1.1" 200 None 2026-04-01 17:57:34,458 - lava_callback - DEBUG - Processing node 69cab9814b5e3e0ab6a63acf: baseline-arm64-baylibre 2026-04-01 17:57:34,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cab9814b5e3e0ab6a63acf 2026-04-01 17:57:34,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:57:34,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab9814b5e3e0ab6a63acf HTTP/1.1" 200 None 2026-04-01 17:57:34,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:57:34,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-04-01 17:57:34,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 17:57:34,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab9814b5e3e0ab6a63acf HTTP/1.1" 200 None 2026-04-01 17:57:34,520 - lava_callback - ERROR - Error processing callback for node 69cab9814b5e3e0ab6a63acf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52130 - "GET / HTTP/1.0" 200 OK 2026-04-01 18:00:14,612 - lava_callback - INFO - Received callback for node 69caba1b4b5e3e0ab6a63aea INFO: 172.21.0.1:36144 - "POST /node/69caba1b4b5e3e0ab6a63aea HTTP/1.0" 202 Accepted 2026-04-01 18:00:14,618 - lava_callback - INFO - Starting async job submit for node 69caba1b4b5e3e0ab6a63aea 2026-04-01 18:00:14,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:00:14,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caba1b4b5e3e0ab6a63aea HTTP/1.1" 200 None 2026-04-01 18:00:14,640 - lava_callback - DEBUG - Processing node 69caba1b4b5e3e0ab6a63aea: baseline-arm64-baylibre 2026-04-01 18:00:14,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caba1b4b5e3e0ab6a63aea 2026-04-01 18:00:14,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:00:14,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caba1b4b5e3e0ab6a63aea HTTP/1.1" 200 None 2026-04-01 18:00:14,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:00:14,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-04-01 18:00:14,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:00:14,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caba1b4b5e3e0ab6a63aea HTTP/1.1" 200 None 2026-04-01 18:00:14,703 - lava_callback - ERROR - Error processing callback for node 69caba1b4b5e3e0ab6a63aea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42826 - "GET /node/69926a0698a8bdb31c3924d5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43770 - "GET /node/698456f23a8748f282084938%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59010 - "GET / HTTP/1.0" 200 OK 2026-04-01 18:03:52,842 - lava_callback - INFO - Received callback for node 69cabb054b5e3e0ab6a63b1b INFO: 172.21.0.1:32948 - "POST /node/69cabb054b5e3e0ab6a63b1b HTTP/1.0" 202 Accepted 2026-04-01 18:03:52,847 - lava_callback - INFO - Starting async job submit for node 69cabb054b5e3e0ab6a63b1b 2026-04-01 18:03:52,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:03:52,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabb054b5e3e0ab6a63b1b HTTP/1.1" 200 None 2026-04-01 18:03:52,863 - lava_callback - DEBUG - Processing node 69cabb054b5e3e0ab6a63b1b: baseline-arm64-clabbe 2026-04-01 18:03:52,863 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cabb054b5e3e0ab6a63b1b 2026-04-01 18:03:52,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:03:52,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabb054b5e3e0ab6a63b1b HTTP/1.1" 200 None 2026-04-01 18:03:52,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:03:52,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-04-01 18:03:52,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:03:52,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cabb054b5e3e0ab6a63b1b HTTP/1.1" 200 None 2026-04-01 18:03:52,937 - lava_callback - ERROR - Error processing callback for node 69cabb054b5e3e0ab6a63b1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52952 - "GET / HTTP/1.0" 200 OK 2026-04-01 18:05:13,039 - lava_callback - INFO - Received callback for node 69cabb534b5e3e0ab6a63b23 INFO: 172.21.0.1:43208 - "POST /node/69cabb534b5e3e0ab6a63b23 HTTP/1.0" 202 Accepted 2026-04-01 18:05:13,066 - lava_callback - INFO - Starting async job submit for node 69cabb534b5e3e0ab6a63b23 2026-04-01 18:05:13,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:05:13,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabb534b5e3e0ab6a63b23 HTTP/1.1" 200 None 2026-04-01 18:05:13,105 - lava_callback - DEBUG - Processing node 69cabb534b5e3e0ab6a63b23: baseline-arm64-clabbe 2026-04-01 18:05:13,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cabb534b5e3e0ab6a63b23 2026-04-01 18:05:13,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:05:13,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabb534b5e3e0ab6a63b23 HTTP/1.1" 200 None 2026-04-01 18:05:13,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:05:13,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-04-01 18:05:13,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:05:13,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cabb534b5e3e0ab6a63b23 HTTP/1.1" 200 None 2026-04-01 18:05:13,186 - lava_callback - ERROR - Error processing callback for node 69cabb534b5e3e0ab6a63b23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52424 - "GET /node/69885bdce408e9ea60faee40%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52430 - "GET /node/6993792bcebe99dd8e06b43f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51994 - "GET / HTTP/1.0" 200 OK 2026-04-01 18:06:32,904 - lava_callback - INFO - Received callback for node 69cabba34b5e3e0ab6a63b33 INFO: 172.21.0.1:47122 - "POST /node/69cabba34b5e3e0ab6a63b33 HTTP/1.0" 202 Accepted 2026-04-01 18:06:32,910 - lava_callback - INFO - Starting async job submit for node 69cabba34b5e3e0ab6a63b33 2026-04-01 18:06:32,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:06:32,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabba34b5e3e0ab6a63b33 HTTP/1.1" 200 None 2026-04-01 18:06:32,926 - lava_callback - DEBUG - Processing node 69cabba34b5e3e0ab6a63b33: baseline-arm64-clabbe 2026-04-01 18:06:32,926 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cabba34b5e3e0ab6a63b33 2026-04-01 18:06:32,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:06:32,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabba34b5e3e0ab6a63b33 HTTP/1.1" 200 None 2026-04-01 18:06:32,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:06:32,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-04-01 18:06:32,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:06:32,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cabba34b5e3e0ab6a63b33 HTTP/1.1" 200 None 2026-04-01 18:06:32,989 - lava_callback - ERROR - Error processing callback for node 69cabba34b5e3e0ab6a63b33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50286 - "GET / HTTP/1.0" 200 OK 2026-04-01 18:07:52,931 - lava_callback - INFO - Received callback for node 69cabbf04b5e3e0ab6a63b3b INFO: 172.21.0.1:49634 - "POST /node/69cabbf04b5e3e0ab6a63b3b HTTP/1.0" 202 Accepted 2026-04-01 18:07:52,937 - lava_callback - INFO - Starting async job submit for node 69cabbf04b5e3e0ab6a63b3b 2026-04-01 18:07:52,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:07:52,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabbf04b5e3e0ab6a63b3b HTTP/1.1" 200 None 2026-04-01 18:07:52,953 - lava_callback - DEBUG - Processing node 69cabbf04b5e3e0ab6a63b3b: baseline-arm64-clabbe 2026-04-01 18:07:52,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cabbf04b5e3e0ab6a63b3b 2026-04-01 18:07:52,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:07:52,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabbf04b5e3e0ab6a63b3b HTTP/1.1" 200 None 2026-04-01 18:07:52,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:07:52,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-04-01 18:07:52,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:07:53,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cabbf04b5e3e0ab6a63b3b HTTP/1.1" 200 None 2026-04-01 18:07:53,027 - lava_callback - ERROR - Error processing callback for node 69cabbf04b5e3e0ab6a63b3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45040 - "GET / HTTP/1.0" 200 OK 2026-04-01 18:09:53,055 - lava_callback - INFO - Received callback for node 69cabc624b5e3e0ab6a63b4e INFO: 172.21.0.1:60368 - "POST /node/69cabc624b5e3e0ab6a63b4e HTTP/1.0" 202 Accepted 2026-04-01 18:09:53,061 - lava_callback - INFO - Starting async job submit for node 69cabc624b5e3e0ab6a63b4e 2026-04-01 18:09:53,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:09:53,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabc624b5e3e0ab6a63b4e HTTP/1.1" 200 None 2026-04-01 18:09:53,077 - lava_callback - DEBUG - Processing node 69cabc624b5e3e0ab6a63b4e: baseline-arm64-clabbe 2026-04-01 18:09:53,077 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cabc624b5e3e0ab6a63b4e 2026-04-01 18:09:53,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:09:53,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabc624b5e3e0ab6a63b4e HTTP/1.1" 200 None 2026-04-01 18:09:53,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:09:53,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-04-01 18:09:53,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:09:53,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cabc624b5e3e0ab6a63b4e HTTP/1.1" 200 None 2026-04-01 18:09:53,128 - lava_callback - ERROR - Error processing callback for node 69cabc624b5e3e0ab6a63b4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57644 - "GET / HTTP/1.0" 200 OK 2026-04-01 18:11:13,082 - lava_callback - INFO - Received callback for node 69cabcb04b5e3e0ab6a63b62 INFO: 172.21.0.1:36512 - "POST /node/69cabcb04b5e3e0ab6a63b62 HTTP/1.0" 202 Accepted 2026-04-01 18:11:13,095 - lava_callback - INFO - Starting async job submit for node 69cabcb04b5e3e0ab6a63b62 2026-04-01 18:11:13,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:11:13,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabcb04b5e3e0ab6a63b62 HTTP/1.1" 200 None 2026-04-01 18:11:13,119 - lava_callback - DEBUG - Processing node 69cabcb04b5e3e0ab6a63b62: baseline-arm64-clabbe 2026-04-01 18:11:13,120 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cabcb04b5e3e0ab6a63b62 2026-04-01 18:11:13,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:11:13,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabcb04b5e3e0ab6a63b62 HTTP/1.1" 200 None 2026-04-01 18:11:13,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:11:13,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-04-01 18:11:13,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:11:13,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cabcb04b5e3e0ab6a63b62 HTTP/1.1" 200 None 2026-04-01 18:11:13,171 - lava_callback - ERROR - Error processing callback for node 69cabcb04b5e3e0ab6a63b62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET /node/691b8996ac5847a394498eb0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49766 - "GET /node/693f5b5f0d8ce4018da8c7c1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET /node/69c1e1bd0efaf21d93105f2e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39692 - "GET /node/6991f7fe01ff1e8e0859d4a6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39698 - "GET /node/69a23a5a90d011217c9f7f9e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET /node/693fc92c575bc060ce1499cc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55830 - "GET /node/698b6b750a16aea5a0dc7b97%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54866 - "GET /node/698de8f8594ec372d0698c94%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54876 - "GET /node/69b7e1b000b80c8ffdcb8efc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59030 - "GET /node/698b8f200a16aea5a0dc8ec9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59036 - "GET /node/698464613a8748f282086998%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35816 - "GET /node/698fc91376d4b6342e9d73a0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35830 - "GET /node/693b042afee8383e92b6f75d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET /node/69903576985e4efca431c65b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52100 - "GET /node/69198ceb40db568ee36c3ea6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET /node/69afe50aae557f2600f0fec5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET /node/6993840fcebe99dd8e06f7ba%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40824 - "GET /node/698694e62de8e2dea3666265%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37752 - "GET /node/693e7da93c8f1be6d3cf1624%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35076 - "GET /node/691b51dfac5847a3944960fa%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35080 - "GET /node/6985d08371989fb141499b7d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50702 - "GET /node/69876d79e31b58f834f19d10%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50714 - "GET /node/6990a6b5c45febfe44520a35%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43032 - "GET /node/6940bd461e3c24e95681be67%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43278 - "GET / HTTP/1.0" 200 OK 2026-04-01 18:46:37,282 - lava_callback - INFO - Received callback for node 69cac5094b5e3e0ab6a63c49 INFO: 172.21.0.1:43290 - "POST /node/69cac5094b5e3e0ab6a63c49 HTTP/1.0" 202 Accepted 2026-04-01 18:46:37,288 - lava_callback - INFO - Starting async job submit for node 69cac5094b5e3e0ab6a63c49 2026-04-01 18:46:37,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:46:37,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac5094b5e3e0ab6a63c49 HTTP/1.1" 200 None 2026-04-01 18:46:37,305 - lava_callback - DEBUG - Processing node 69cac5094b5e3e0ab6a63c49: baseline-arm-baylibre 2026-04-01 18:46:37,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cac5094b5e3e0ab6a63c49 2026-04-01 18:46:37,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:46:37,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac5094b5e3e0ab6a63c49 HTTP/1.1" 200 None 2026-04-01 18:46:37,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:46:37,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-01 18:46:37,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:46:37,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cac5094b5e3e0ab6a63c49 HTTP/1.1" 200 None 2026-04-01 18:46:37,360 - lava_callback - ERROR - Error processing callback for node 69cac5094b5e3e0ab6a63c49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55048 - "GET /node/693777950c55536e7dddafc2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40842 - "GET /node/693ff109575bc060ce14ea36%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET /node/69b7d39400b80c8ffdcb8b7d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39992 - "GET / HTTP/1.0" 200 OK 2026-04-01 18:49:14,730 - lava_callback - INFO - Received callback for node 69cac5a74b5e3e0ab6a63c6e INFO: 172.21.0.1:51960 - "POST /node/69cac5a74b5e3e0ab6a63c6e HTTP/1.0" 202 Accepted 2026-04-01 18:49:14,736 - lava_callback - INFO - Starting async job submit for node 69cac5a74b5e3e0ab6a63c6e 2026-04-01 18:49:14,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:49:14,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac5a74b5e3e0ab6a63c6e HTTP/1.1" 200 None 2026-04-01 18:49:14,753 - lava_callback - DEBUG - Processing node 69cac5a74b5e3e0ab6a63c6e: baseline-arm-clabbe 2026-04-01 18:49:14,753 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cac5a74b5e3e0ab6a63c6e 2026-04-01 18:49:14,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:49:14,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac5a74b5e3e0ab6a63c6e HTTP/1.1" 200 None 2026-04-01 18:49:14,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:49:14,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-01 18:49:14,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:49:14,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cac5a74b5e3e0ab6a63c6e HTTP/1.1" 200 None 2026-04-01 18:49:14,813 - lava_callback - ERROR - Error processing callback for node 69cac5a74b5e3e0ab6a63c6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54968 - "GET / HTTP/1.0" 200 OK 2026-04-01 18:49:54,655 - lava_callback - INFO - Received callback for node 69cac5cc4b5e3e0ab6a63c7c INFO: 172.21.0.1:41950 - "POST /node/69cac5cc4b5e3e0ab6a63c7c HTTP/1.0" 202 Accepted 2026-04-01 18:49:54,660 - lava_callback - INFO - Starting async job submit for node 69cac5cc4b5e3e0ab6a63c7c 2026-04-01 18:49:54,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:49:54,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac5cc4b5e3e0ab6a63c7c HTTP/1.1" 200 None 2026-04-01 18:49:54,677 - lava_callback - DEBUG - Processing node 69cac5cc4b5e3e0ab6a63c7c: baseline-arm-clabbe 2026-04-01 18:49:54,677 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cac5cc4b5e3e0ab6a63c7c 2026-04-01 18:49:54,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:49:54,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac5cc4b5e3e0ab6a63c7c HTTP/1.1" 200 None 2026-04-01 18:49:54,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:49:54,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-01 18:49:54,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:49:54,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cac5cc4b5e3e0ab6a63c7c HTTP/1.1" 200 None 2026-04-01 18:49:54,774 - lava_callback - ERROR - Error processing callback for node 69cac5cc4b5e3e0ab6a63c7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41962 - "GET /node/693afa96fee8383e92b6d20b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41978 - "GET /node/694aae6983c67c43d1ede745%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40680 - "GET / HTTP/1.0" 200 OK 2026-04-01 18:50:54,714 - lava_callback - INFO - Received callback for node 69cac5fc4b5e3e0ab6a63c87 INFO: 172.21.0.1:45162 - "POST /node/69cac5fc4b5e3e0ab6a63c87 HTTP/1.0" 202 Accepted 2026-04-01 18:50:54,720 - lava_callback - INFO - Starting async job submit for node 69cac5fc4b5e3e0ab6a63c87 2026-04-01 18:50:54,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:50:54,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac5fc4b5e3e0ab6a63c87 HTTP/1.1" 200 None 2026-04-01 18:50:54,735 - lava_callback - DEBUG - Processing node 69cac5fc4b5e3e0ab6a63c87: baseline-arm-clabbe 2026-04-01 18:50:54,735 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cac5fc4b5e3e0ab6a63c87 2026-04-01 18:50:54,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:50:54,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac5fc4b5e3e0ab6a63c87 HTTP/1.1" 200 None 2026-04-01 18:50:54,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:50:54,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-01 18:50:54,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:50:54,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cac5fc4b5e3e0ab6a63c87 HTTP/1.1" 200 None 2026-04-01 18:50:54,792 - lava_callback - ERROR - Error processing callback for node 69cac5fc4b5e3e0ab6a63c87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET /node/69927edd98a8bdb31c394f04%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43008 - "GET /node/69bd7b090e93e2314723e7b6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38730 - "GET / HTTP/1.0" 200 OK 2026-04-01 18:51:34,698 - lava_callback - INFO - Received callback for node 69cac6214b5e3e0ab6a63c92 INFO: 172.21.0.1:38454 - "POST /node/69cac6214b5e3e0ab6a63c92 HTTP/1.0" 202 Accepted 2026-04-01 18:51:34,703 - lava_callback - INFO - Starting async job submit for node 69cac6214b5e3e0ab6a63c92 2026-04-01 18:51:34,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:51:34,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac6214b5e3e0ab6a63c92 HTTP/1.1" 200 None 2026-04-01 18:51:34,719 - lava_callback - DEBUG - Processing node 69cac6214b5e3e0ab6a63c92: baseline-arm-clabbe 2026-04-01 18:51:34,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cac6214b5e3e0ab6a63c92 2026-04-01 18:51:34,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:51:34,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac6214b5e3e0ab6a63c92 HTTP/1.1" 200 None 2026-04-01 18:51:34,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:51:34,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-01 18:51:34,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:51:34,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cac6214b5e3e0ab6a63c92 HTTP/1.1" 200 None 2026-04-01 18:51:34,803 - lava_callback - ERROR - Error processing callback for node 69cac6214b5e3e0ab6a63c92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54254 - "GET / HTTP/1.0" 200 OK 2026-04-01 18:51:54,736 - lava_callback - INFO - Received callback for node 69cac6454b5e3e0ab6a63ca3 INFO: 172.21.0.1:47714 - "POST /node/69cac6454b5e3e0ab6a63ca3 HTTP/1.0" 202 Accepted 2026-04-01 18:51:54,741 - lava_callback - INFO - Starting async job submit for node 69cac6454b5e3e0ab6a63ca3 2026-04-01 18:51:54,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:51:54,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac6454b5e3e0ab6a63ca3 HTTP/1.1" 200 None 2026-04-01 18:51:54,774 - lava_callback - DEBUG - Processing node 69cac6454b5e3e0ab6a63ca3: baseline-arm-clabbe 2026-04-01 18:51:54,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cac6454b5e3e0ab6a63ca3 2026-04-01 18:51:54,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:51:54,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac6454b5e3e0ab6a63ca3 HTTP/1.1" 200 None 2026-04-01 18:51:54,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:51:54,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-01 18:51:54,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 18:51:54,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cac6454b5e3e0ab6a63ca3 HTTP/1.1" 200 None 2026-04-01 18:51:54,832 - lava_callback - ERROR - Error processing callback for node 69cac6454b5e3e0ab6a63ca3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47730 - "GET /node/69c1817e2b2b51e9ad97ab6e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET /node/69c1fdab0efaf21d93106fe0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50636 - "GET /node/69305c40bbee432adda3b555%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50648 - "GET /node/69840cd7969566dcb0d2bcf4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33276 - "GET /node/693f77f60d8ce4018da94845%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33770 - "GET /node/69becc4da85a0f2cbb32d14c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33782 - "GET /node/69903d62985e4efca431e2b5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET /node/6986959f2de8e2dea36664e7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37254 - "GET /node/6882649087dcced18949715c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33998 - "GET /node/6937736a0c55536e7dddaceb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34002 - "GET /node/69848a233a8748f282087939%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35448 - "GET / HTTP/1.0" 200 OK 2026-04-01 19:24:59,238 - lava_callback - INFO - Received callback for node 69cacdfc4b5e3e0ab6a63d24 INFO: 172.21.0.1:35450 - "POST /node/69cacdfc4b5e3e0ab6a63d24 HTTP/1.0" 202 Accepted 2026-04-01 19:24:59,243 - lava_callback - INFO - Starting async job submit for node 69cacdfc4b5e3e0ab6a63d24 2026-04-01 19:24:59,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:24:59,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cacdfc4b5e3e0ab6a63d24 HTTP/1.1" 200 None 2026-04-01 19:24:59,259 - lava_callback - DEBUG - Processing node 69cacdfc4b5e3e0ab6a63d24: baseline-arm64-baylibre 2026-04-01 19:24:59,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cacdfc4b5e3e0ab6a63d24 2026-04-01 19:24:59,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:24:59,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cacdfc4b5e3e0ab6a63d24 HTTP/1.1" 200 None 2026-04-01 19:24:59,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:24:59,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 19:24:59,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:24:59,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cacdfc4b5e3e0ab6a63d24 HTTP/1.1" 200 None 2026-04-01 19:24:59,333 - lava_callback - ERROR - Error processing callback for node 69cacdfc4b5e3e0ab6a63d24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET /node/69bdf4d3d54b5122738c6aaa%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37526 - "GET / HTTP/1.0" 200 OK 2026-04-01 19:27:59,356 - lava_callback - INFO - Received callback for node 69caceb14b5e3e0ab6a63d2f INFO: 172.21.0.1:37534 - "POST /node/69caceb14b5e3e0ab6a63d2f HTTP/1.0" 202 Accepted 2026-04-01 19:27:59,362 - lava_callback - INFO - Starting async job submit for node 69caceb14b5e3e0ab6a63d2f 2026-04-01 19:27:59,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:27:59,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caceb14b5e3e0ab6a63d2f HTTP/1.1" 200 None 2026-04-01 19:27:59,377 - lava_callback - DEBUG - Processing node 69caceb14b5e3e0ab6a63d2f: baseline-arm64-baylibre 2026-04-01 19:27:59,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caceb14b5e3e0ab6a63d2f 2026-04-01 19:27:59,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:27:59,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caceb14b5e3e0ab6a63d2f HTTP/1.1" 200 None 2026-04-01 19:27:59,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:27:59,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 19:27:59,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:27:59,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caceb14b5e3e0ab6a63d2f HTTP/1.1" 200 None 2026-04-01 19:27:59,452 - lava_callback - ERROR - Error processing callback for node 69caceb14b5e3e0ab6a63d2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60726 - "GET / HTTP/1.0" 200 OK 2026-04-01 19:29:59,455 - lava_callback - INFO - Received callback for node 69cacf2b4b5e3e0ab6a63d40 INFO: 172.21.0.1:60734 - "POST /node/69cacf2b4b5e3e0ab6a63d40 HTTP/1.0" 202 Accepted 2026-04-01 19:29:59,460 - lava_callback - INFO - Starting async job submit for node 69cacf2b4b5e3e0ab6a63d40 2026-04-01 19:29:59,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:29:59,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cacf2b4b5e3e0ab6a63d40 HTTP/1.1" 200 None 2026-04-01 19:29:59,477 - lava_callback - DEBUG - Processing node 69cacf2b4b5e3e0ab6a63d40: baseline-arm64-baylibre 2026-04-01 19:29:59,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cacf2b4b5e3e0ab6a63d40 2026-04-01 19:29:59,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:29:59,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cacf2b4b5e3e0ab6a63d40 HTTP/1.1" 200 None 2026-04-01 19:29:59,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:29:59,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 19:29:59,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:29:59,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cacf2b4b5e3e0ab6a63d40 HTTP/1.1" 200 None 2026-04-01 19:29:59,556 - lava_callback - ERROR - Error processing callback for node 69cacf2b4b5e3e0ab6a63d40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58460 - "GET / HTTP/1.0" 200 OK 2026-04-01 19:31:59,773 - lava_callback - INFO - Received callback for node 69cacfa44b5e3e0ab6a63d4d INFO: 172.21.0.1:59362 - "POST /node/69cacfa44b5e3e0ab6a63d4d HTTP/1.0" 202 Accepted 2026-04-01 19:31:59,778 - lava_callback - INFO - Starting async job submit for node 69cacfa44b5e3e0ab6a63d4d 2026-04-01 19:31:59,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:31:59,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cacfa44b5e3e0ab6a63d4d HTTP/1.1" 200 None 2026-04-01 19:31:59,804 - lava_callback - DEBUG - Processing node 69cacfa44b5e3e0ab6a63d4d: baseline-arm64-baylibre 2026-04-01 19:31:59,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cacfa44b5e3e0ab6a63d4d 2026-04-01 19:31:59,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:31:59,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cacfa44b5e3e0ab6a63d4d HTTP/1.1" 200 None 2026-04-01 19:31:59,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:31:59,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 19:31:59,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:31:59,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cacfa44b5e3e0ab6a63d4d HTTP/1.1" 200 None 2026-04-01 19:31:59,860 - lava_callback - ERROR - Error processing callback for node 69cacfa44b5e3e0ab6a63d4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35554 - "GET / HTTP/1.0" 200 OK 2026-04-01 19:34:16,751 - lava_callback - INFO - Received callback for node 69cad0224b5e3e0ab6a63d5b INFO: 172.21.0.1:35562 - "POST /node/69cad0224b5e3e0ab6a63d5b HTTP/1.0" 202 Accepted 2026-04-01 19:34:16,757 - lava_callback - INFO - Starting async job submit for node 69cad0224b5e3e0ab6a63d5b 2026-04-01 19:34:16,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:34:16,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cad0224b5e3e0ab6a63d5b HTTP/1.1" 200 None 2026-04-01 19:34:16,773 - lava_callback - DEBUG - Processing node 69cad0224b5e3e0ab6a63d5b: baseline-arm64-clabbe 2026-04-01 19:34:16,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cad0224b5e3e0ab6a63d5b 2026-04-01 19:34:16,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:34:16,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cad0224b5e3e0ab6a63d5b HTTP/1.1" 200 None 2026-04-01 19:34:16,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:34:16,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 19:34:16,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:34:16,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cad0224b5e3e0ab6a63d5b HTTP/1.1" 200 None 2026-04-01 19:34:16,826 - lava_callback - ERROR - Error processing callback for node 69cad0224b5e3e0ab6a63d5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57580 - "GET /node/6986fc166e077e4126a7d4ce%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57596 - "GET /node/693af910fee8383e92b6c7c4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44846 - "GET / HTTP/1.0" 200 OK 2026-04-01 19:37:16,871 - lava_callback - INFO - Received callback for node 69cad0d64b5e3e0ab6a63d69 INFO: 172.21.0.1:44860 - "POST /node/69cad0d64b5e3e0ab6a63d69 HTTP/1.0" 202 Accepted 2026-04-01 19:37:16,877 - lava_callback - INFO - Starting async job submit for node 69cad0d64b5e3e0ab6a63d69 2026-04-01 19:37:16,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:37:16,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cad0d64b5e3e0ab6a63d69 HTTP/1.1" 200 None 2026-04-01 19:37:16,893 - lava_callback - DEBUG - Processing node 69cad0d64b5e3e0ab6a63d69: baseline-arm64-clabbe 2026-04-01 19:37:16,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cad0d64b5e3e0ab6a63d69 2026-04-01 19:37:16,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:37:16,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cad0d64b5e3e0ab6a63d69 HTTP/1.1" 200 None 2026-04-01 19:37:16,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:37:16,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 19:37:16,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:37:16,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cad0d64b5e3e0ab6a63d69 HTTP/1.1" 200 None 2026-04-01 19:37:16,952 - lava_callback - ERROR - Error processing callback for node 69cad0d64b5e3e0ab6a63d69: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53240 - "GET / HTTP/1.0" 200 OK 2026-04-01 19:39:17,134 - lava_callback - INFO - Received callback for node 69cad14f4b5e3e0ab6a63d77 INFO: 172.21.0.1:53242 - "POST /node/69cad14f4b5e3e0ab6a63d77 HTTP/1.0" 202 Accepted 2026-04-01 19:39:17,140 - lava_callback - INFO - Starting async job submit for node 69cad14f4b5e3e0ab6a63d77 2026-04-01 19:39:17,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:39:17,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cad14f4b5e3e0ab6a63d77 HTTP/1.1" 200 None 2026-04-01 19:39:17,155 - lava_callback - DEBUG - Processing node 69cad14f4b5e3e0ab6a63d77: baseline-arm64-clabbe 2026-04-01 19:39:17,155 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cad14f4b5e3e0ab6a63d77 2026-04-01 19:39:17,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:39:17,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cad14f4b5e3e0ab6a63d77 HTTP/1.1" 200 None 2026-04-01 19:39:17,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:39:17,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 19:39:17,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:39:17,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cad14f4b5e3e0ab6a63d77 HTTP/1.1" 200 None 2026-04-01 19:39:17,210 - lava_callback - ERROR - Error processing callback for node 69cad14f4b5e3e0ab6a63d77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK 2026-04-01 19:42:17,043 - lava_callback - INFO - Received callback for node 69cad2034b5e3e0ab6a63d86 INFO: 172.21.0.1:58168 - "POST /node/69cad2034b5e3e0ab6a63d86 HTTP/1.0" 202 Accepted 2026-04-01 19:42:17,048 - lava_callback - INFO - Starting async job submit for node 69cad2034b5e3e0ab6a63d86 2026-04-01 19:42:17,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:42:17,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cad2034b5e3e0ab6a63d86 HTTP/1.1" 200 None 2026-04-01 19:42:17,099 - lava_callback - DEBUG - Processing node 69cad2034b5e3e0ab6a63d86: baseline-arm64-clabbe 2026-04-01 19:42:17,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cad2034b5e3e0ab6a63d86 2026-04-01 19:42:17,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:42:17,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cad2034b5e3e0ab6a63d86 HTTP/1.1" 200 None 2026-04-01 19:42:17,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:42:17,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 19:42:17,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:42:17,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cad2034b5e3e0ab6a63d86 HTTP/1.1" 200 None 2026-04-01 19:42:17,168 - lava_callback - ERROR - Error processing callback for node 69cad2034b5e3e0ab6a63d86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49996 - "GET /node/69903c97985e4efca431e043%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36042 - "GET /node/693b7a1641fb4c95097627f2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36050 - "GET /node/693e80093c8f1be6d3cf1b22%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35340 - "GET / HTTP/1.0" 200 OK 2026-04-01 19:44:57,190 - lava_callback - INFO - Received callback for node 69cad2b64b5e3e0ab6a63d96 INFO: 172.21.0.1:35342 - "POST /node/69cad2b64b5e3e0ab6a63d96 HTTP/1.0" 202 Accepted 2026-04-01 19:44:57,196 - lava_callback - INFO - Starting async job submit for node 69cad2b64b5e3e0ab6a63d96 2026-04-01 19:44:57,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:44:57,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cad2b64b5e3e0ab6a63d96 HTTP/1.1" 200 None 2026-04-01 19:44:57,220 - lava_callback - DEBUG - Processing node 69cad2b64b5e3e0ab6a63d96: baseline-arm64-clabbe 2026-04-01 19:44:57,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cad2b64b5e3e0ab6a63d96 2026-04-01 19:44:57,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:44:57,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cad2b64b5e3e0ab6a63d96 HTTP/1.1" 200 None 2026-04-01 19:44:57,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:44:57,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 19:44:57,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:44:57,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cad2b64b5e3e0ab6a63d96 HTTP/1.1" 200 None 2026-04-01 19:44:57,320 - lava_callback - ERROR - Error processing callback for node 69cad2b64b5e3e0ab6a63d96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33056 - "GET /node/69934aed523507f3806a52d9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33072 - "GET /node/69937b6ecebe99dd8e06bdf7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52666 - "GET / HTTP/1.0" 200 OK 2026-04-01 19:46:17,240 - lava_callback - INFO - Received callback for node 69cad3054b5e3e0ab6a63d9e INFO: 172.21.0.1:52682 - "POST /node/69cad3054b5e3e0ab6a63d9e HTTP/1.0" 202 Accepted 2026-04-01 19:46:17,246 - lava_callback - INFO - Starting async job submit for node 69cad3054b5e3e0ab6a63d9e 2026-04-01 19:46:17,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:46:17,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cad3054b5e3e0ab6a63d9e HTTP/1.1" 200 None 2026-04-01 19:46:17,263 - lava_callback - DEBUG - Processing node 69cad3054b5e3e0ab6a63d9e: baseline-arm64-clabbe 2026-04-01 19:46:17,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cad3054b5e3e0ab6a63d9e 2026-04-01 19:46:17,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:46:17,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cad3054b5e3e0ab6a63d9e HTTP/1.1" 200 None 2026-04-01 19:46:17,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:46:17,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 19:46:17,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 19:46:17,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cad3054b5e3e0ab6a63d9e HTTP/1.1" 200 None 2026-04-01 19:46:17,322 - lava_callback - ERROR - Error processing callback for node 69cad3054b5e3e0ab6a63d9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43390 - "GET /node/698969b185773790cd34ef10%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34420 - "GET /node/69407b74575bc060ce15ba62%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34430 - "GET /node/6982ac583507dcddca5905ed%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53122 - "GET /node/69878345e31b58f834f1b6b6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET /node/6938c2dae767fbc36e03e31b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54902 - "GET /node/698a184a22b4cc0f227ae50a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39688 - "GET /node/69892e8085773790cd34b769%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET /node/69a3796414c84a8c43f9a77a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58516 - "GET /node/69896eca85773790cd34f159%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET /node/69be595b448e074b3ffe1721%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49298 - "GET /node/69934d0f523507f3806a5bd4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48626 - "GET /node/693e5f4e407f32424eb650aa%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48642 - "GET /node/698af4953b3beb19e7616a5f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42508 - "GET /node/69b7fc31113612b7716bc5e6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42518 - "GET /node/69a168eaa41e9451dcf419ed%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55746 - "GET /node/699374a0cebe99dd8e06a48b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET /node/698fcf2176d4b6342e9d7f78%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51652 - "GET /node/694b01c46c96ed51d3173040%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58360 - "GET /node/69493b8eebaed71d43807cff%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58366 - "GET /node/699113f985f550420785db55%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33932 - "GET /node/69281b67b1b5e06bf6c0544e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49304 - "GET /node/698403f0969566dcb0d2b8b9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49314 - "GET /node/69884ca7e408e9ea60fad4df%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49330 - "GET /node/69930b9031166481c8de2613%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49340 - "GET /node/6984d78b3ff18e47df613131%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET /node/688eafc13a66ab4492e8e9d8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57730 - "GET /node/69a0e73b9f52b1b460a46937%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53764 - "GET /node/693af247fee8383e92b6a2bf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53768 - "GET /node/6938c67fe767fbc36e03e600%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51358 - "GET /node/698733926e077e4126a7fee7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48236 - "GET /node/69903a32985e4efca431d874%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47434 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:25:20,554 - lava_callback - INFO - Received callback for node 69cbfcd78df9359ff4898448 INFO: 172.21.0.1:57146 - "POST /node/69cbfcd78df9359ff4898448 HTTP/1.0" 202 Accepted 2026-04-01 20:25:20,561 - lava_callback - INFO - Starting async job submit for node 69cbfcd78df9359ff4898448 2026-04-01 20:25:20,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:25:20,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcd78df9359ff4898448 HTTP/1.1" 200 None 2026-04-01 20:25:20,599 - lava_callback - DEBUG - Processing node 69cbfcd78df9359ff4898448: baseline-arm64-broonie 2026-04-01 20:25:20,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 20:25:21,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 20:25:21,128 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cbfcd78df9359ff4898448/log.txt.gz 2026-04-01 20:25:21,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 20:25:21,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 20:25:21,629 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cbfcd78df9359ff4898448/lava-logs.yaml 2026-04-01 20:25:21,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 20:25:21,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 20:25:21,810 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cbfcd78df9359ff4898448/lava_callback.json.gz 2026-04-01 20:25:21,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:25:21,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcd78df9359ff4898448 HTTP/1.1" 200 None 2026-04-01 20:25:21,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:25:21,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-01 20:25:21,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:25:21,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfcd78df9359ff4898448 HTTP/1.1" 200 None 2026-04-01 20:25:21,904 - lava_callback - INFO - Completed processing callback for node 69cbfcd78df9359ff4898448 INFO: 172.21.0.1:57160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50208 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:25:39,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:25:39,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46122 - "GET /node/694021a4575bc060ce15358b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36110 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:27:00,319 - lava_callback - INFO - Received callback for node 69ccdef274bda3ec93a41a3d INFO: 172.21.0.1:56896 - "POST /node/69ccdef274bda3ec93a41a3d HTTP/1.0" 202 Accepted 2026-04-01 20:27:00,325 - lava_callback - INFO - Starting async job submit for node 69ccdef274bda3ec93a41a3d 2026-04-01 20:27:00,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:27:00,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdef274bda3ec93a41a3d HTTP/1.1" 200 None 2026-04-01 20:27:00,375 - lava_callback - DEBUG - Processing node 69ccdef274bda3ec93a41a3d: baseline-arm64-broonie 2026-04-01 20:27:00,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 20:27:00,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 20:27:00,796 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdef274bda3ec93a41a3d/log.txt.gz 2026-04-01 20:27:00,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 20:27:01,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 20:27:01,169 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdef274bda3ec93a41a3d/lava-logs.yaml 2026-04-01 20:27:01,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 20:27:01,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 20:27:01,310 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdef274bda3ec93a41a3d/lava_callback.json.gz 2026-04-01 20:27:01,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:27:01,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdef274bda3ec93a41a3d HTTP/1.1" 200 None 2026-04-01 20:27:01,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:27:01,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 20:27:01,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:27:01,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdef274bda3ec93a41a3d HTTP/1.1" 200 None 2026-04-01 20:27:01,397 - lava_callback - INFO - Completed processing callback for node 69ccdef274bda3ec93a41a3d INFO: 172.21.0.1:56898 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:27:09,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:27:09,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41372 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:27:20,347 - lava_callback - INFO - Received callback for node 69cd378074bda3ec93a4317c INFO: 172.21.0.1:48700 - "POST /node/69cd378074bda3ec93a4317c HTTP/1.0" 202 Accepted 2026-04-01 20:27:20,353 - lava_callback - INFO - Starting async job submit for node 69cd378074bda3ec93a4317c 2026-04-01 20:27:20,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:27:20,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cd378074bda3ec93a4317c HTTP/1.1" 200 None 2026-04-01 20:27:20,390 - lava_callback - DEBUG - Processing node 69cd378074bda3ec93a4317c: baseline-arm64-broonie 2026-04-01 20:27:20,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 20:27:20,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 20:27:20,809 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cd378074bda3ec93a4317c/log.txt.gz 2026-04-01 20:27:20,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 20:27:21,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 20:27:21,180 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cd378074bda3ec93a4317c/lava-logs.yaml 2026-04-01 20:27:21,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 20:27:21,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 20:27:21,635 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cd378074bda3ec93a4317c/lava_callback.json.gz 2026-04-01 20:27:21,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:27:21,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cd378074bda3ec93a4317c HTTP/1.1" 200 None 2026-04-01 20:27:21,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:27:21,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 20:27:21,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:27:21,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cd378074bda3ec93a4317c HTTP/1.1" 200 None 2026-04-01 20:27:21,722 - lava_callback - INFO - Completed processing callback for node 69cd378074bda3ec93a4317c INFO: 172.21.0.1:48712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55944 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:27:39,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:27:39,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55568 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:41:59,771 - lava_callback - INFO - Received callback for node 69cae0094b5e3e0ab6a63de7 INFO: 172.21.0.1:58238 - "POST /node/69cae0094b5e3e0ab6a63de7 HTTP/1.0" 202 Accepted 2026-04-01 20:41:59,776 - lava_callback - INFO - Starting async job submit for node 69cae0094b5e3e0ab6a63de7 2026-04-01 20:41:59,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:41:59,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae0094b5e3e0ab6a63de7 HTTP/1.1" 200 None 2026-04-01 20:41:59,801 - lava_callback - DEBUG - Processing node 69cae0094b5e3e0ab6a63de7: baseline-arm-clabbe 2026-04-01 20:41:59,801 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae0094b5e3e0ab6a63de7 2026-04-01 20:41:59,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:41:59,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae0094b5e3e0ab6a63de7 HTTP/1.1" 200 None 2026-04-01 20:41:59,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:41:59,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 20:41:59,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:41:59,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae0094b5e3e0ab6a63de7 HTTP/1.1" 200 None 2026-04-01 20:41:59,853 - lava_callback - ERROR - Error processing callback for node 69cae0094b5e3e0ab6a63de7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34904 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:42:39,582 - lava_callback - INFO - Received callback for node 69cae0314b5e3e0ab6a63df0 INFO: 172.21.0.1:34908 - "POST /node/69cae0314b5e3e0ab6a63df0 HTTP/1.0" 202 Accepted 2026-04-01 20:42:39,588 - lava_callback - INFO - Starting async job submit for node 69cae0314b5e3e0ab6a63df0 2026-04-01 20:42:39,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:42:39,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae0314b5e3e0ab6a63df0 HTTP/1.1" 200 None 2026-04-01 20:42:39,610 - lava_callback - DEBUG - Processing node 69cae0314b5e3e0ab6a63df0: baseline-arm-clabbe 2026-04-01 20:42:39,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae0314b5e3e0ab6a63df0 2026-04-01 20:42:39,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:42:39,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae0314b5e3e0ab6a63df0 HTTP/1.1" 200 None 2026-04-01 20:42:39,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:42:39,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 20:42:39,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:42:39,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae0314b5e3e0ab6a63df0 HTTP/1.1" 200 None 2026-04-01 20:42:39,695 - lava_callback - ERROR - Error processing callback for node 69cae0314b5e3e0ab6a63df0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48594 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:43:19,642 - lava_callback - INFO - Received callback for node 69cae0554b5e3e0ab6a63dfc INFO: 172.21.0.1:48610 - "POST /node/69cae0554b5e3e0ab6a63dfc HTTP/1.0" 202 Accepted 2026-04-01 20:43:19,647 - lava_callback - INFO - Starting async job submit for node 69cae0554b5e3e0ab6a63dfc 2026-04-01 20:43:19,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:43:19,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae0554b5e3e0ab6a63dfc HTTP/1.1" 200 None 2026-04-01 20:43:19,663 - lava_callback - DEBUG - Processing node 69cae0554b5e3e0ab6a63dfc: baseline-arm-clabbe 2026-04-01 20:43:19,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae0554b5e3e0ab6a63dfc 2026-04-01 20:43:19,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:43:19,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae0554b5e3e0ab6a63dfc HTTP/1.1" 200 None 2026-04-01 20:43:19,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:43:19,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 20:43:19,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:43:19,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae0554b5e3e0ab6a63dfc HTTP/1.1" 200 None 2026-04-01 20:43:19,714 - lava_callback - ERROR - Error processing callback for node 69cae0554b5e3e0ab6a63dfc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50248 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:43:59,640 - lava_callback - INFO - Received callback for node 69cae07a4b5e3e0ab6a63e0b INFO: 172.21.0.1:50250 - "POST /node/69cae07a4b5e3e0ab6a63e0b HTTP/1.0" 202 Accepted 2026-04-01 20:43:59,646 - lava_callback - INFO - Starting async job submit for node 69cae07a4b5e3e0ab6a63e0b 2026-04-01 20:43:59,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:43:59,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae07a4b5e3e0ab6a63e0b HTTP/1.1" 200 None 2026-04-01 20:43:59,663 - lava_callback - DEBUG - Processing node 69cae07a4b5e3e0ab6a63e0b: baseline-arm-clabbe 2026-04-01 20:43:59,663 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae07a4b5e3e0ab6a63e0b 2026-04-01 20:43:59,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:43:59,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae07a4b5e3e0ab6a63e0b HTTP/1.1" 200 None 2026-04-01 20:43:59,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:43:59,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 20:43:59,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:43:59,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae07a4b5e3e0ab6a63e0b HTTP/1.1" 200 None 2026-04-01 20:43:59,723 - lava_callback - ERROR - Error processing callback for node 69cae07a4b5e3e0ab6a63e0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:44:19,695 - lava_callback - INFO - Received callback for node 69cae0a04b5e3e0ab6a63e18 INFO: 172.21.0.1:45934 - "POST /node/69cae0a04b5e3e0ab6a63e18 HTTP/1.0" 202 Accepted 2026-04-01 20:44:19,700 - lava_callback - INFO - Starting async job submit for node 69cae0a04b5e3e0ab6a63e18 2026-04-01 20:44:19,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:44:19,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae0a04b5e3e0ab6a63e18 HTTP/1.1" 200 None 2026-04-01 20:44:19,716 - lava_callback - DEBUG - Processing node 69cae0a04b5e3e0ab6a63e18: baseline-arm-clabbe 2026-04-01 20:44:19,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae0a04b5e3e0ab6a63e18 2026-04-01 20:44:19,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:44:19,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae0a04b5e3e0ab6a63e18 HTTP/1.1" 200 None 2026-04-01 20:44:19,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:44:19,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 20:44:19,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:44:19,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae0a04b5e3e0ab6a63e18 HTTP/1.1" 200 None 2026-04-01 20:44:19,766 - lava_callback - ERROR - Error processing callback for node 69cae0a04b5e3e0ab6a63e18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57828 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:45:39,775 - lava_callback - INFO - Received callback for node 69cae0e94b5e3e0ab6a63e31 INFO: 172.21.0.1:38148 - "POST /node/69cae0e94b5e3e0ab6a63e31 HTTP/1.0" 202 Accepted 2026-04-01 20:45:39,780 - lava_callback - INFO - Starting async job submit for node 69cae0e94b5e3e0ab6a63e31 2026-04-01 20:45:39,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:45:39,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae0e94b5e3e0ab6a63e31 HTTP/1.1" 200 None 2026-04-01 20:45:39,797 - lava_callback - DEBUG - Processing node 69cae0e94b5e3e0ab6a63e31: baseline-arm-clabbe 2026-04-01 20:45:39,797 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae0e94b5e3e0ab6a63e31 2026-04-01 20:45:39,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:45:39,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae0e94b5e3e0ab6a63e31 HTTP/1.1" 200 None 2026-04-01 20:45:39,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:45:39,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 20:45:39,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:45:39,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae0e94b5e3e0ab6a63e31 HTTP/1.1" 200 None 2026-04-01 20:45:39,857 - lava_callback - ERROR - Error processing callback for node 69cae0e94b5e3e0ab6a63e31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:46:19,744 - lava_callback - INFO - Received callback for node 69cae10e4b5e3e0ab6a63e3f INFO: 172.21.0.1:34000 - "POST /node/69cae10e4b5e3e0ab6a63e3f HTTP/1.0" 202 Accepted 2026-04-01 20:46:19,749 - lava_callback - INFO - Starting async job submit for node 69cae10e4b5e3e0ab6a63e3f 2026-04-01 20:46:19,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:46:19,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae10e4b5e3e0ab6a63e3f HTTP/1.1" 200 None 2026-04-01 20:46:19,775 - lava_callback - DEBUG - Processing node 69cae10e4b5e3e0ab6a63e3f: baseline-arm-clabbe 2026-04-01 20:46:19,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae10e4b5e3e0ab6a63e3f 2026-04-01 20:46:19,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:46:19,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae10e4b5e3e0ab6a63e3f HTTP/1.1" 200 None 2026-04-01 20:46:19,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:46:19,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 20:46:19,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:46:19,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae10e4b5e3e0ab6a63e3f HTTP/1.1" 200 None 2026-04-01 20:46:19,830 - lava_callback - ERROR - Error processing callback for node 69cae10e4b5e3e0ab6a63e3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37338 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:47:39,909 - lava_callback - INFO - Received callback for node 69cae1584b5e3e0ab6a63e58 INFO: 172.21.0.1:45804 - "POST /node/69cae1584b5e3e0ab6a63e58 HTTP/1.0" 202 Accepted 2026-04-01 20:47:39,915 - lava_callback - INFO - Starting async job submit for node 69cae1584b5e3e0ab6a63e58 2026-04-01 20:47:39,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:47:39,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae1584b5e3e0ab6a63e58 HTTP/1.1" 200 None 2026-04-01 20:47:39,930 - lava_callback - DEBUG - Processing node 69cae1584b5e3e0ab6a63e58: baseline-arm-clabbe 2026-04-01 20:47:39,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae1584b5e3e0ab6a63e58 2026-04-01 20:47:39,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:47:39,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae1584b5e3e0ab6a63e58 HTTP/1.1" 200 None 2026-04-01 20:47:39,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:47:39,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 20:47:39,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:47:39,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae1584b5e3e0ab6a63e58 HTTP/1.1" 200 None 2026-04-01 20:47:39,995 - lava_callback - ERROR - Error processing callback for node 69cae1584b5e3e0ab6a63e58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:47:59,791 - lava_callback - INFO - Received callback for node 69cae17d4b5e3e0ab6a63e60 INFO: 172.21.0.1:52164 - "POST /node/69cae17d4b5e3e0ab6a63e60 HTTP/1.0" 202 Accepted 2026-04-01 20:47:59,796 - lava_callback - INFO - Starting async job submit for node 69cae17d4b5e3e0ab6a63e60 2026-04-01 20:47:59,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:47:59,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae17d4b5e3e0ab6a63e60 HTTP/1.1" 200 None 2026-04-01 20:47:59,822 - lava_callback - DEBUG - Processing node 69cae17d4b5e3e0ab6a63e60: baseline-arm-clabbe 2026-04-01 20:47:59,822 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae17d4b5e3e0ab6a63e60 2026-04-01 20:47:59,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:47:59,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae17d4b5e3e0ab6a63e60 HTTP/1.1" 200 None 2026-04-01 20:47:59,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:47:59,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 20:47:59,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:47:59,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae17d4b5e3e0ab6a63e60 HTTP/1.1" 200 None 2026-04-01 20:47:59,891 - lava_callback - ERROR - Error processing callback for node 69cae17d4b5e3e0ab6a63e60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:48:39,829 - lava_callback - INFO - Received callback for node 69cae1a34b5e3e0ab6a63e6a INFO: 172.21.0.1:46530 - "POST /node/69cae1a34b5e3e0ab6a63e6a HTTP/1.0" 202 Accepted 2026-04-01 20:48:39,834 - lava_callback - INFO - Starting async job submit for node 69cae1a34b5e3e0ab6a63e6a 2026-04-01 20:48:39,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:48:39,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae1a34b5e3e0ab6a63e6a HTTP/1.1" 200 None 2026-04-01 20:48:39,851 - lava_callback - DEBUG - Processing node 69cae1a34b5e3e0ab6a63e6a: baseline-arm-clabbe 2026-04-01 20:48:39,851 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae1a34b5e3e0ab6a63e6a 2026-04-01 20:48:39,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:48:39,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae1a34b5e3e0ab6a63e6a HTTP/1.1" 200 None 2026-04-01 20:48:39,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:48:39,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 20:48:39,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:48:39,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae1a34b5e3e0ab6a63e6a HTTP/1.1" 200 None 2026-04-01 20:48:39,913 - lava_callback - ERROR - Error processing callback for node 69cae1a34b5e3e0ab6a63e6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40642 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:49:19,835 - lava_callback - INFO - Received callback for node 69cae1c94b5e3e0ab6a63e77 INFO: 172.21.0.1:47174 - "POST /node/69cae1c94b5e3e0ab6a63e77 HTTP/1.0" 202 Accepted 2026-04-01 20:49:19,840 - lava_callback - INFO - Starting async job submit for node 69cae1c94b5e3e0ab6a63e77 2026-04-01 20:49:19,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:49:19,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae1c94b5e3e0ab6a63e77 HTTP/1.1" 200 None 2026-04-01 20:49:19,895 - lava_callback - DEBUG - Processing node 69cae1c94b5e3e0ab6a63e77: baseline-arm-clabbe 2026-04-01 20:49:19,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae1c94b5e3e0ab6a63e77 2026-04-01 20:49:19,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:49:19,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae1c94b5e3e0ab6a63e77 HTTP/1.1" 200 None 2026-04-01 20:49:19,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:49:19,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 20:49:19,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:49:19,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae1c94b5e3e0ab6a63e77 HTTP/1.1" 200 None 2026-04-01 20:49:19,968 - lava_callback - ERROR - Error processing callback for node 69cae1c94b5e3e0ab6a63e77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59928 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:51:20,066 - lava_callback - INFO - Received callback for node 69cae2394b5e3e0ab6a63e9e INFO: 172.21.0.1:59942 - "POST /node/69cae2394b5e3e0ab6a63e9e HTTP/1.0" 202 Accepted 2026-04-01 20:51:20,072 - lava_callback - INFO - Starting async job submit for node 69cae2394b5e3e0ab6a63e9e 2026-04-01 20:51:20,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:51:20,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae2394b5e3e0ab6a63e9e HTTP/1.1" 200 None 2026-04-01 20:51:20,086 - lava_callback - DEBUG - Processing node 69cae2394b5e3e0ab6a63e9e: baseline-arm-clabbe 2026-04-01 20:51:20,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae2394b5e3e0ab6a63e9e 2026-04-01 20:51:20,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:51:20,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae2394b5e3e0ab6a63e9e HTTP/1.1" 200 None 2026-04-01 20:51:20,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:51:20,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 20:51:20,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:51:20,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae2394b5e3e0ab6a63e9e HTTP/1.1" 200 None 2026-04-01 20:51:20,160 - lava_callback - ERROR - Error processing callback for node 69cae2394b5e3e0ab6a63e9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57890 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:51:59,949 - lava_callback - INFO - Received callback for node 69cae25f4b5e3e0ab6a63eae INFO: 172.21.0.1:50972 - "POST /node/69cae25f4b5e3e0ab6a63eae HTTP/1.0" 202 Accepted 2026-04-01 20:51:59,954 - lava_callback - INFO - Starting async job submit for node 69cae25f4b5e3e0ab6a63eae 2026-04-01 20:51:59,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:51:59,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae25f4b5e3e0ab6a63eae HTTP/1.1" 200 None 2026-04-01 20:51:59,999 - lava_callback - DEBUG - Processing node 69cae25f4b5e3e0ab6a63eae: baseline-arm-clabbe 2026-04-01 20:52:00,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae25f4b5e3e0ab6a63eae 2026-04-01 20:52:00,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:52:00,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae25f4b5e3e0ab6a63eae HTTP/1.1" 200 None 2026-04-01 20:52:00,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:52:00,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 20:52:00,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:52:00,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae25f4b5e3e0ab6a63eae HTTP/1.1" 200 None 2026-04-01 20:52:00,072 - lava_callback - ERROR - Error processing callback for node 69cae25f4b5e3e0ab6a63eae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:52:40,054 - lava_callback - INFO - Received callback for node 69cae2854b5e3e0ab6a63eba INFO: 172.21.0.1:33756 - "POST /node/69cae2854b5e3e0ab6a63eba HTTP/1.0" 202 Accepted 2026-04-01 20:52:40,060 - lava_callback - INFO - Starting async job submit for node 69cae2854b5e3e0ab6a63eba 2026-04-01 20:52:40,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:52:40,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae2854b5e3e0ab6a63eba HTTP/1.1" 200 None 2026-04-01 20:52:40,076 - lava_callback - DEBUG - Processing node 69cae2854b5e3e0ab6a63eba: baseline-arm-clabbe 2026-04-01 20:52:40,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae2854b5e3e0ab6a63eba 2026-04-01 20:52:40,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:52:40,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae2854b5e3e0ab6a63eba HTTP/1.1" 200 None 2026-04-01 20:52:40,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:52:40,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 20:52:40,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:52:40,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae2854b5e3e0ab6a63eba HTTP/1.1" 200 None 2026-04-01 20:52:40,137 - lava_callback - ERROR - Error processing callback for node 69cae2854b5e3e0ab6a63eba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32942 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:53:20,014 - lava_callback - INFO - Received callback for node 69cae2ab4b5e3e0ab6a63ec8 INFO: 172.21.0.1:32954 - "POST /node/69cae2ab4b5e3e0ab6a63ec8 HTTP/1.0" 202 Accepted 2026-04-01 20:53:20,020 - lava_callback - INFO - Starting async job submit for node 69cae2ab4b5e3e0ab6a63ec8 2026-04-01 20:53:20,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:53:20,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae2ab4b5e3e0ab6a63ec8 HTTP/1.1" 200 None 2026-04-01 20:53:20,036 - lava_callback - DEBUG - Processing node 69cae2ab4b5e3e0ab6a63ec8: baseline-arm-clabbe 2026-04-01 20:53:20,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae2ab4b5e3e0ab6a63ec8 2026-04-01 20:53:20,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:53:20,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae2ab4b5e3e0ab6a63ec8 HTTP/1.1" 200 None 2026-04-01 20:53:20,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:53:20,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 20:53:20,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:53:20,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae2ab4b5e3e0ab6a63ec8 HTTP/1.1" 200 None 2026-04-01 20:53:20,099 - lava_callback - ERROR - Error processing callback for node 69cae2ab4b5e3e0ab6a63ec8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:53:40,066 - lava_callback - INFO - Received callback for node 69cae2d04b5e3e0ab6a63ed2 INFO: 172.21.0.1:53174 - "POST /node/69cae2d04b5e3e0ab6a63ed2 HTTP/1.0" 202 Accepted 2026-04-01 20:53:40,072 - lava_callback - INFO - Starting async job submit for node 69cae2d04b5e3e0ab6a63ed2 2026-04-01 20:53:40,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:53:40,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae2d04b5e3e0ab6a63ed2 HTTP/1.1" 200 None 2026-04-01 20:53:40,087 - lava_callback - DEBUG - Processing node 69cae2d04b5e3e0ab6a63ed2: baseline-arm-clabbe 2026-04-01 20:53:40,088 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae2d04b5e3e0ab6a63ed2 2026-04-01 20:53:40,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:53:40,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae2d04b5e3e0ab6a63ed2 HTTP/1.1" 200 None 2026-04-01 20:53:40,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:53:40,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 20:53:40,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:53:40,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae2d04b5e3e0ab6a63ed2 HTTP/1.1" 200 None 2026-04-01 20:53:40,148 - lava_callback - ERROR - Error processing callback for node 69cae2d04b5e3e0ab6a63ed2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55886 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:54:20,079 - lava_callback - INFO - Received callback for node 69cae2f74b5e3e0ab6a63edf INFO: 172.21.0.1:55900 - "POST /node/69cae2f74b5e3e0ab6a63edf HTTP/1.0" 202 Accepted 2026-04-01 20:54:20,085 - lava_callback - INFO - Starting async job submit for node 69cae2f74b5e3e0ab6a63edf 2026-04-01 20:54:20,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:54:20,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae2f74b5e3e0ab6a63edf HTTP/1.1" 200 None 2026-04-01 20:54:20,103 - lava_callback - DEBUG - Processing node 69cae2f74b5e3e0ab6a63edf: baseline-arm-clabbe 2026-04-01 20:54:20,104 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae2f74b5e3e0ab6a63edf 2026-04-01 20:54:20,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:54:20,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae2f74b5e3e0ab6a63edf HTTP/1.1" 200 None 2026-04-01 20:54:20,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:54:20,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 20:54:20,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:54:20,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae2f74b5e3e0ab6a63edf HTTP/1.1" 200 None 2026-04-01 20:54:20,197 - lava_callback - ERROR - Error processing callback for node 69cae2f74b5e3e0ab6a63edf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56100 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:55:00,208 - lava_callback - INFO - Received callback for node 69cae31c4b5e3e0ab6a63ef1 INFO: 172.21.0.1:33304 - "POST /node/69cae31c4b5e3e0ab6a63ef1 HTTP/1.0" 202 Accepted 2026-04-01 20:55:00,214 - lava_callback - INFO - Starting async job submit for node 69cae31c4b5e3e0ab6a63ef1 2026-04-01 20:55:00,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:55:00,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae31c4b5e3e0ab6a63ef1 HTTP/1.1" 200 None 2026-04-01 20:55:00,230 - lava_callback - DEBUG - Processing node 69cae31c4b5e3e0ab6a63ef1: baseline-arm-clabbe 2026-04-01 20:55:00,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae31c4b5e3e0ab6a63ef1 2026-04-01 20:55:00,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:55:00,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae31c4b5e3e0ab6a63ef1 HTTP/1.1" 200 None 2026-04-01 20:55:00,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:55:00,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 20:55:00,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:55:00,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae31c4b5e3e0ab6a63ef1 HTTP/1.1" 200 None 2026-04-01 20:55:00,292 - lava_callback - ERROR - Error processing callback for node 69cae31c4b5e3e0ab6a63ef1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52058 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:55:40,412 - lava_callback - INFO - Received callback for node 69cae3424b5e3e0ab6a63ef9 INFO: 172.21.0.1:38492 - "POST /node/69cae3424b5e3e0ab6a63ef9 HTTP/1.0" 202 Accepted 2026-04-01 20:55:40,418 - lava_callback - INFO - Starting async job submit for node 69cae3424b5e3e0ab6a63ef9 2026-04-01 20:55:40,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:55:40,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae3424b5e3e0ab6a63ef9 HTTP/1.1" 200 None 2026-04-01 20:55:40,438 - lava_callback - DEBUG - Processing node 69cae3424b5e3e0ab6a63ef9: baseline-arm-clabbe 2026-04-01 20:55:40,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae3424b5e3e0ab6a63ef9 2026-04-01 20:55:40,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:55:40,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae3424b5e3e0ab6a63ef9 HTTP/1.1" 200 None 2026-04-01 20:55:40,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:55:40,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 20:55:40,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:55:40,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae3424b5e3e0ab6a63ef9 HTTP/1.1" 200 None 2026-04-01 20:55:40,509 - lava_callback - ERROR - Error processing callback for node 69cae3424b5e3e0ab6a63ef9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39594 - "GET / HTTP/1.0" 200 OK 2026-04-01 20:56:20,197 - lava_callback - INFO - Received callback for node 69cae3674b5e3e0ab6a63f06 INFO: 172.21.0.1:39600 - "POST /node/69cae3674b5e3e0ab6a63f06 HTTP/1.0" 202 Accepted 2026-04-01 20:56:20,207 - lava_callback - INFO - Starting async job submit for node 69cae3674b5e3e0ab6a63f06 2026-04-01 20:56:20,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:56:20,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae3674b5e3e0ab6a63f06 HTTP/1.1" 200 None 2026-04-01 20:56:20,231 - lava_callback - DEBUG - Processing node 69cae3674b5e3e0ab6a63f06: baseline-arm-clabbe 2026-04-01 20:56:20,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae3674b5e3e0ab6a63f06 2026-04-01 20:56:20,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:56:20,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae3674b5e3e0ab6a63f06 HTTP/1.1" 200 None 2026-04-01 20:56:20,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:56:20,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 20:56:20,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 20:56:20,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae3674b5e3e0ab6a63f06 HTTP/1.1" 200 None 2026-04-01 20:56:20,291 - lava_callback - ERROR - Error processing callback for node 69cae3674b5e3e0ab6a63f06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46944 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:46954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:06:04,818 - lava_callback - INFO - Received callback for node 69cae5b04b5e3e0ab6a63f4f INFO: 172.21.0.1:56398 - "POST /node/69cae5b04b5e3e0ab6a63f4f HTTP/1.0" 202 Accepted 2026-04-01 21:06:04,823 - lava_callback - INFO - Starting async job submit for node 69cae5b04b5e3e0ab6a63f4f 2026-04-01 21:06:04,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:06:04,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae5b04b5e3e0ab6a63f4f HTTP/1.1" 200 None 2026-04-01 21:06:04,841 - lava_callback - DEBUG - Processing node 69cae5b04b5e3e0ab6a63f4f: baseline-arm64-baylibre 2026-04-01 21:06:04,841 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae5b04b5e3e0ab6a63f4f 2026-04-01 21:06:04,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:06:04,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae5b04b5e3e0ab6a63f4f HTTP/1.1" 200 None 2026-04-01 21:06:04,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:06:04,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 21:06:04,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:06:04,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae5b04b5e3e0ab6a63f4f HTTP/1.1" 200 None 2026-04-01 21:06:04,917 - lava_callback - ERROR - Error processing callback for node 69cae5b04b5e3e0ab6a63f4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:07:24,710 - lava_callback - INFO - Received callback for node 69cae5ff4b5e3e0ab6a63f58 INFO: 172.21.0.1:54890 - "POST /node/69cae5ff4b5e3e0ab6a63f58 HTTP/1.0" 202 Accepted 2026-04-01 21:07:24,716 - lava_callback - INFO - Starting async job submit for node 69cae5ff4b5e3e0ab6a63f58 2026-04-01 21:07:24,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:07:24,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae5ff4b5e3e0ab6a63f58 HTTP/1.1" 200 None 2026-04-01 21:07:24,731 - lava_callback - DEBUG - Processing node 69cae5ff4b5e3e0ab6a63f58: baseline-arm64-baylibre 2026-04-01 21:07:24,732 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae5ff4b5e3e0ab6a63f58 2026-04-01 21:07:24,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:07:24,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae5ff4b5e3e0ab6a63f58 HTTP/1.1" 200 None 2026-04-01 21:07:24,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:07:24,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 21:07:24,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:07:24,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae5ff4b5e3e0ab6a63f58 HTTP/1.1" 200 None 2026-04-01 21:07:24,793 - lava_callback - ERROR - Error processing callback for node 69cae5ff4b5e3e0ab6a63f58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:08:44,858 - lava_callback - INFO - Received callback for node 69cae6584b5e3e0ab6a63f68 INFO: 172.21.0.1:33652 - "POST /node/69cae6584b5e3e0ab6a63f68 HTTP/1.0" 202 Accepted 2026-04-01 21:08:44,863 - lava_callback - INFO - Starting async job submit for node 69cae6584b5e3e0ab6a63f68 2026-04-01 21:08:44,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:08:44,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae6584b5e3e0ab6a63f68 HTTP/1.1" 200 None 2026-04-01 21:08:44,880 - lava_callback - DEBUG - Processing node 69cae6584b5e3e0ab6a63f68: baseline-arm64-baylibre 2026-04-01 21:08:44,880 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae6584b5e3e0ab6a63f68 2026-04-01 21:08:44,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:08:44,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae6584b5e3e0ab6a63f68 HTTP/1.1" 200 None 2026-04-01 21:08:44,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:08:44,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 21:08:44,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:08:44,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae6584b5e3e0ab6a63f68 HTTP/1.1" 200 None 2026-04-01 21:08:44,938 - lava_callback - ERROR - Error processing callback for node 69cae6584b5e3e0ab6a63f68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53356 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:10:04,881 - lava_callback - INFO - Received callback for node 69cae6a64b5e3e0ab6a63f77 INFO: 172.21.0.1:54816 - "POST /node/69cae6a64b5e3e0ab6a63f77 HTTP/1.0" 202 Accepted 2026-04-01 21:10:04,887 - lava_callback - INFO - Starting async job submit for node 69cae6a64b5e3e0ab6a63f77 2026-04-01 21:10:04,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:10:04,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae6a64b5e3e0ab6a63f77 HTTP/1.1" 200 None 2026-04-01 21:10:04,905 - lava_callback - DEBUG - Processing node 69cae6a64b5e3e0ab6a63f77: baseline-arm64-baylibre 2026-04-01 21:10:04,906 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae6a64b5e3e0ab6a63f77 2026-04-01 21:10:04,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:10:04,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae6a64b5e3e0ab6a63f77 HTTP/1.1" 200 None 2026-04-01 21:10:04,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:10:04,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:10:04,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:10:04,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae6a64b5e3e0ab6a63f77 HTTP/1.1" 200 None 2026-04-01 21:10:04,957 - lava_callback - ERROR - Error processing callback for node 69cae6a64b5e3e0ab6a63f77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET /node/69c806f2123b47fd237700ec%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35408 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:11:25,029 - lava_callback - INFO - Received callback for node 69cae6f54b5e3e0ab6a63f83 INFO: 172.21.0.1:35414 - "POST /node/69cae6f54b5e3e0ab6a63f83 HTTP/1.0" 202 Accepted 2026-04-01 21:11:25,034 - lava_callback - INFO - Starting async job submit for node 69cae6f54b5e3e0ab6a63f83 2026-04-01 21:11:25,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:11:25,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae6f54b5e3e0ab6a63f83 HTTP/1.1" 200 None 2026-04-01 21:11:25,050 - lava_callback - DEBUG - Processing node 69cae6f54b5e3e0ab6a63f83: baseline-arm64-baylibre 2026-04-01 21:11:25,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae6f54b5e3e0ab6a63f83 2026-04-01 21:11:25,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:11:25,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae6f54b5e3e0ab6a63f83 HTTP/1.1" 200 None 2026-04-01 21:11:25,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:11:25,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 21:11:25,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:11:25,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae6f54b5e3e0ab6a63f83 HTTP/1.1" 200 None 2026-04-01 21:11:25,107 - lava_callback - ERROR - Error processing callback for node 69cae6f54b5e3e0ab6a63f83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:12:45,045 - lava_callback - INFO - Received callback for node 69cae7464b5e3e0ab6a63f91 INFO: 172.21.0.1:38802 - "POST /node/69cae7464b5e3e0ab6a63f91 HTTP/1.0" 202 Accepted 2026-04-01 21:12:45,051 - lava_callback - INFO - Starting async job submit for node 69cae7464b5e3e0ab6a63f91 2026-04-01 21:12:45,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:12:45,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae7464b5e3e0ab6a63f91 HTTP/1.1" 200 None 2026-04-01 21:12:45,067 - lava_callback - DEBUG - Processing node 69cae7464b5e3e0ab6a63f91: baseline-arm64-baylibre 2026-04-01 21:12:45,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae7464b5e3e0ab6a63f91 2026-04-01 21:12:45,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:12:45,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae7464b5e3e0ab6a63f91 HTTP/1.1" 200 None 2026-04-01 21:12:45,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:12:45,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 21:12:45,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:12:45,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae7464b5e3e0ab6a63f91 HTTP/1.1" 200 None 2026-04-01 21:12:45,129 - lava_callback - ERROR - Error processing callback for node 69cae7464b5e3e0ab6a63f91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38084 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:14:05,108 - lava_callback - INFO - Received callback for node 69cae7964b5e3e0ab6a63fa5 INFO: 172.21.0.1:40856 - "POST /node/69cae7964b5e3e0ab6a63fa5 HTTP/1.0" 202 Accepted 2026-04-01 21:14:05,113 - lava_callback - INFO - Starting async job submit for node 69cae7964b5e3e0ab6a63fa5 2026-04-01 21:14:05,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:14:05,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae7964b5e3e0ab6a63fa5 HTTP/1.1" 200 None 2026-04-01 21:14:05,129 - lava_callback - DEBUG - Processing node 69cae7964b5e3e0ab6a63fa5: baseline-arm64-baylibre 2026-04-01 21:14:05,129 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae7964b5e3e0ab6a63fa5 2026-04-01 21:14:05,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:14:05,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae7964b5e3e0ab6a63fa5 HTTP/1.1" 200 None 2026-04-01 21:14:05,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:14:05,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:14:05,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:14:05,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae7964b5e3e0ab6a63fa5 HTTP/1.1" 200 None 2026-04-01 21:14:05,192 - lava_callback - ERROR - Error processing callback for node 69cae7964b5e3e0ab6a63fa5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:15:41,059 - lava_callback - INFO - Received callback for node 69cae7ec4b5e3e0ab6a63fb9 INFO: 172.21.0.1:53828 - "POST /node/69cae7ec4b5e3e0ab6a63fb9 HTTP/1.0" 202 Accepted 2026-04-01 21:15:41,065 - lava_callback - INFO - Starting async job submit for node 69cae7ec4b5e3e0ab6a63fb9 2026-04-01 21:15:41,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:15:41,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae7ec4b5e3e0ab6a63fb9 HTTP/1.1" 200 None 2026-04-01 21:15:41,085 - lava_callback - DEBUG - Processing node 69cae7ec4b5e3e0ab6a63fb9: baseline-arm64-clabbe 2026-04-01 21:15:41,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae7ec4b5e3e0ab6a63fb9 2026-04-01 21:15:41,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:15:41,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae7ec4b5e3e0ab6a63fb9 HTTP/1.1" 200 None 2026-04-01 21:15:41,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:15:41,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:15:41,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:15:41,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae7ec4b5e3e0ab6a63fb9 HTTP/1.1" 200 None 2026-04-01 21:15:41,142 - lava_callback - ERROR - Error processing callback for node 69cae7ec4b5e3e0ab6a63fb9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38990 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:17:01,013 - lava_callback - INFO - Received callback for node 69cae83c4b5e3e0ab6a63fc3 INFO: 172.21.0.1:54764 - "POST /node/69cae83c4b5e3e0ab6a63fc3 HTTP/1.0" 202 Accepted 2026-04-01 21:17:01,022 - lava_callback - INFO - Starting async job submit for node 69cae83c4b5e3e0ab6a63fc3 2026-04-01 21:17:01,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:17:01,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae83c4b5e3e0ab6a63fc3 HTTP/1.1" 200 None 2026-04-01 21:17:01,046 - lava_callback - DEBUG - Processing node 69cae83c4b5e3e0ab6a63fc3: baseline-arm64-clabbe 2026-04-01 21:17:01,046 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae83c4b5e3e0ab6a63fc3 2026-04-01 21:17:01,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:17:01,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae83c4b5e3e0ab6a63fc3 HTTP/1.1" 200 None 2026-04-01 21:17:01,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:17:01,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 21:17:01,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:17:01,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae83c4b5e3e0ab6a63fc3 HTTP/1.1" 200 None 2026-04-01 21:17:01,120 - lava_callback - ERROR - Error processing callback for node 69cae83c4b5e3e0ab6a63fc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46352 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:18:21,129 - lava_callback - INFO - Received callback for node 69cae88d4b5e3e0ab6a63fd5 INFO: 172.21.0.1:46368 - "POST /node/69cae88d4b5e3e0ab6a63fd5 HTTP/1.0" 202 Accepted 2026-04-01 21:18:21,134 - lava_callback - INFO - Starting async job submit for node 69cae88d4b5e3e0ab6a63fd5 2026-04-01 21:18:21,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:18:21,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae88d4b5e3e0ab6a63fd5 HTTP/1.1" 200 None 2026-04-01 21:18:21,150 - lava_callback - DEBUG - Processing node 69cae88d4b5e3e0ab6a63fd5: baseline-arm64-clabbe 2026-04-01 21:18:21,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae88d4b5e3e0ab6a63fd5 2026-04-01 21:18:21,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:18:21,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae88d4b5e3e0ab6a63fd5 HTTP/1.1" 200 None 2026-04-01 21:18:21,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:18:21,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:18:21,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:18:21,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae88d4b5e3e0ab6a63fd5 HTTP/1.1" 200 None 2026-04-01 21:18:21,207 - lava_callback - ERROR - Error processing callback for node 69cae88d4b5e3e0ab6a63fd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46916 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:19:41,175 - lava_callback - INFO - Received callback for node 69cae8dd4b5e3e0ab6a63fe8 INFO: 172.21.0.1:49172 - "POST /node/69cae8dd4b5e3e0ab6a63fe8 HTTP/1.0" 202 Accepted 2026-04-01 21:19:41,180 - lava_callback - INFO - Starting async job submit for node 69cae8dd4b5e3e0ab6a63fe8 2026-04-01 21:19:41,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:19:41,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae8dd4b5e3e0ab6a63fe8 HTTP/1.1" 200 None 2026-04-01 21:19:41,201 - lava_callback - DEBUG - Processing node 69cae8dd4b5e3e0ab6a63fe8: baseline-arm64-clabbe 2026-04-01 21:19:41,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae8dd4b5e3e0ab6a63fe8 2026-04-01 21:19:41,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:19:41,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae8dd4b5e3e0ab6a63fe8 HTTP/1.1" 200 None 2026-04-01 21:19:41,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:19:41,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 21:19:41,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:19:41,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae8dd4b5e3e0ab6a63fe8 HTTP/1.1" 200 None 2026-04-01 21:19:41,280 - lava_callback - ERROR - Error processing callback for node 69cae8dd4b5e3e0ab6a63fe8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53386 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:21:01,193 - lava_callback - INFO - Received callback for node 69cae92d4b5e3e0ab6a63ff3 INFO: 172.21.0.1:48698 - "POST /node/69cae92d4b5e3e0ab6a63ff3 HTTP/1.0" 202 Accepted 2026-04-01 21:21:01,199 - lava_callback - INFO - Starting async job submit for node 69cae92d4b5e3e0ab6a63ff3 2026-04-01 21:21:01,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:21:01,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae92d4b5e3e0ab6a63ff3 HTTP/1.1" 200 None 2026-04-01 21:21:01,215 - lava_callback - DEBUG - Processing node 69cae92d4b5e3e0ab6a63ff3: baseline-arm64-clabbe 2026-04-01 21:21:01,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae92d4b5e3e0ab6a63ff3 2026-04-01 21:21:01,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:21:01,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae92d4b5e3e0ab6a63ff3 HTTP/1.1" 200 None 2026-04-01 21:21:01,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:21:01,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:21:01,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:21:01,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae92d4b5e3e0ab6a63ff3 HTTP/1.1" 200 None 2026-04-01 21:21:01,293 - lava_callback - ERROR - Error processing callback for node 69cae92d4b5e3e0ab6a63ff3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33842 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:22:21,292 - lava_callback - INFO - Received callback for node 69cae97c4b5e3e0ab6a64000 INFO: 172.21.0.1:33844 - "POST /node/69cae97c4b5e3e0ab6a64000 HTTP/1.0" 202 Accepted 2026-04-01 21:22:21,298 - lava_callback - INFO - Starting async job submit for node 69cae97c4b5e3e0ab6a64000 2026-04-01 21:22:21,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:22:21,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae97c4b5e3e0ab6a64000 HTTP/1.1" 200 None 2026-04-01 21:22:21,315 - lava_callback - DEBUG - Processing node 69cae97c4b5e3e0ab6a64000: baseline-arm64-clabbe 2026-04-01 21:22:21,316 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae97c4b5e3e0ab6a64000 2026-04-01 21:22:21,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:22:21,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae97c4b5e3e0ab6a64000 HTTP/1.1" 200 None 2026-04-01 21:22:21,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:22:21,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 21:22:21,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:22:21,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae97c4b5e3e0ab6a64000 HTTP/1.1" 200 None 2026-04-01 21:22:21,370 - lava_callback - ERROR - Error processing callback for node 69cae97c4b5e3e0ab6a64000: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52486 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:23:41,346 - lava_callback - INFO - Received callback for node 69cae9cc4b5e3e0ab6a6400f INFO: 172.21.0.1:36898 - "POST /node/69cae9cc4b5e3e0ab6a6400f HTTP/1.0" 202 Accepted 2026-04-01 21:23:41,351 - lava_callback - INFO - Starting async job submit for node 69cae9cc4b5e3e0ab6a6400f 2026-04-01 21:23:41,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:23:41,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae9cc4b5e3e0ab6a6400f HTTP/1.1" 200 None 2026-04-01 21:23:41,367 - lava_callback - DEBUG - Processing node 69cae9cc4b5e3e0ab6a6400f: baseline-arm64-clabbe 2026-04-01 21:23:41,367 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cae9cc4b5e3e0ab6a6400f 2026-04-01 21:23:41,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:23:41,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cae9cc4b5e3e0ab6a6400f HTTP/1.1" 200 None 2026-04-01 21:23:41,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:23:41,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:23:41,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:23:41,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cae9cc4b5e3e0ab6a6400f HTTP/1.1" 200 None 2026-04-01 21:23:41,430 - lava_callback - ERROR - Error processing callback for node 69cae9cc4b5e3e0ab6a6400f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49424 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:25:01,390 - lava_callback - INFO - Received callback for node 69caea1b4b5e3e0ab6a6401b INFO: 172.21.0.1:55512 - "POST /node/69caea1b4b5e3e0ab6a6401b HTTP/1.0" 202 Accepted 2026-04-01 21:25:01,396 - lava_callback - INFO - Starting async job submit for node 69caea1b4b5e3e0ab6a6401b 2026-04-01 21:25:01,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:25:01,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caea1b4b5e3e0ab6a6401b HTTP/1.1" 200 None 2026-04-01 21:25:01,412 - lava_callback - DEBUG - Processing node 69caea1b4b5e3e0ab6a6401b: baseline-arm64-clabbe 2026-04-01 21:25:01,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caea1b4b5e3e0ab6a6401b 2026-04-01 21:25:01,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:25:01,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caea1b4b5e3e0ab6a6401b HTTP/1.1" 200 None 2026-04-01 21:25:01,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:25:01,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 21:25:01,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:25:01,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caea1b4b5e3e0ab6a6401b HTTP/1.1" 200 None 2026-04-01 21:25:01,488 - lava_callback - ERROR - Error processing callback for node 69caea1b4b5e3e0ab6a6401b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:26:21,386 - lava_callback - INFO - Received callback for node 69caea694b5e3e0ab6a6402b INFO: 172.21.0.1:39192 - "POST /node/69caea694b5e3e0ab6a6402b HTTP/1.0" 202 Accepted 2026-04-01 21:26:21,391 - lava_callback - INFO - Starting async job submit for node 69caea694b5e3e0ab6a6402b 2026-04-01 21:26:21,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:26:21,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caea694b5e3e0ab6a6402b HTTP/1.1" 200 None 2026-04-01 21:26:21,409 - lava_callback - DEBUG - Processing node 69caea694b5e3e0ab6a6402b: baseline-arm64-clabbe 2026-04-01 21:26:21,409 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caea694b5e3e0ab6a6402b 2026-04-01 21:26:21,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:26:21,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caea694b5e3e0ab6a6402b HTTP/1.1" 200 None 2026-04-01 21:26:21,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:26:21,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:26:21,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:26:21,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caea694b5e3e0ab6a6402b HTTP/1.1" 200 None 2026-04-01 21:26:21,477 - lava_callback - ERROR - Error processing callback for node 69caea694b5e3e0ab6a6402b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49094 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:27:41,591 - lava_callback - INFO - Received callback for node 69caeab84b5e3e0ab6a6403b INFO: 172.21.0.1:53760 - "POST /node/69caeab84b5e3e0ab6a6403b HTTP/1.0" 202 Accepted 2026-04-01 21:27:41,597 - lava_callback - INFO - Starting async job submit for node 69caeab84b5e3e0ab6a6403b 2026-04-01 21:27:41,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:27:41,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caeab84b5e3e0ab6a6403b HTTP/1.1" 200 None 2026-04-01 21:27:41,613 - lava_callback - DEBUG - Processing node 69caeab84b5e3e0ab6a6403b: baseline-arm64-clabbe 2026-04-01 21:27:41,614 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caeab84b5e3e0ab6a6403b 2026-04-01 21:27:41,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:27:41,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caeab84b5e3e0ab6a6403b HTTP/1.1" 200 None 2026-04-01 21:27:41,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:27:41,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 21:27:41,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:27:41,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caeab84b5e3e0ab6a6403b HTTP/1.1" 200 None 2026-04-01 21:27:41,672 - lava_callback - ERROR - Error processing callback for node 69caeab84b5e3e0ab6a6403b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51422 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:28:41,585 - lava_callback - INFO - Received callback for node 69caeb064b5e3e0ab6a64042 INFO: 172.21.0.1:43100 - "POST /node/69caeb064b5e3e0ab6a64042 HTTP/1.0" 202 Accepted 2026-04-01 21:28:41,591 - lava_callback - INFO - Starting async job submit for node 69caeb064b5e3e0ab6a64042 2026-04-01 21:28:41,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:28:41,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caeb064b5e3e0ab6a64042 HTTP/1.1" 200 None 2026-04-01 21:28:41,606 - lava_callback - DEBUG - Processing node 69caeb064b5e3e0ab6a64042: baseline-arm64-clabbe 2026-04-01 21:28:41,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caeb064b5e3e0ab6a64042 2026-04-01 21:28:41,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:28:41,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caeb064b5e3e0ab6a64042 HTTP/1.1" 200 None 2026-04-01 21:28:41,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:28:41,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:28:41,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:28:41,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caeb064b5e3e0ab6a64042 HTTP/1.1" 200 None 2026-04-01 21:28:41,661 - lava_callback - ERROR - Error processing callback for node 69caeb064b5e3e0ab6a64042: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33410 - "GET /node/694ddc108177197a294f0707%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33412 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:30:01,597 - lava_callback - INFO - Received callback for node 69caeb524b5e3e0ab6a6404f INFO: 172.21.0.1:41010 - "POST /node/69caeb524b5e3e0ab6a6404f HTTP/1.0" 202 Accepted 2026-04-01 21:30:01,603 - lava_callback - INFO - Starting async job submit for node 69caeb524b5e3e0ab6a6404f 2026-04-01 21:30:01,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:30:01,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caeb524b5e3e0ab6a6404f HTTP/1.1" 200 None 2026-04-01 21:30:01,627 - lava_callback - DEBUG - Processing node 69caeb524b5e3e0ab6a6404f: baseline-arm64-clabbe 2026-04-01 21:30:01,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caeb524b5e3e0ab6a6404f 2026-04-01 21:30:01,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:30:01,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caeb524b5e3e0ab6a6404f HTTP/1.1" 200 None 2026-04-01 21:30:01,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:30:01,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 21:30:01,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:30:01,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caeb524b5e3e0ab6a6404f HTTP/1.1" 200 None 2026-04-01 21:30:01,692 - lava_callback - ERROR - Error processing callback for node 69caeb524b5e3e0ab6a6404f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58954 - "GET /node/69303bfb009d5f8c767ee1f6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58958 - "GET /node/6929398ba7fbd8958ccf0e27%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-01 21:31:06,185 - lava_callback - INFO - Received callback for node 69caeb964b5e3e0ab6a64059 INFO: 172.21.0.1:58964 - "POST /node/69caeb964b5e3e0ab6a64059 HTTP/1.0" 202 Accepted 2026-04-01 21:31:06,193 - lava_callback - INFO - Starting async job submit for node 69caeb964b5e3e0ab6a64059 2026-04-01 21:31:06,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:31:06,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caeb964b5e3e0ab6a64059 HTTP/1.1" 200 None 2026-04-01 21:31:06,231 - lava_callback - DEBUG - Processing node 69caeb964b5e3e0ab6a64059: baseline-arm64-baylibre 2026-04-01 21:31:06,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caeb964b5e3e0ab6a64059 2026-04-01 21:31:06,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:31:06,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caeb964b5e3e0ab6a64059 HTTP/1.1" 200 None 2026-04-01 21:31:06,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:31:06,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:31:06,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:31:06,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caeb964b5e3e0ab6a64059 HTTP/1.1" 200 None 2026-04-01 21:31:06,301 - lava_callback - ERROR - Error processing callback for node 69caeb964b5e3e0ab6a64059: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59548 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:34:06,209 - lava_callback - INFO - Received callback for node 69caec484b5e3e0ab6a64068 INFO: 172.21.0.1:50838 - "POST /node/69caec484b5e3e0ab6a64068 HTTP/1.0" 202 Accepted 2026-04-01 21:34:06,214 - lava_callback - INFO - Starting async job submit for node 69caec484b5e3e0ab6a64068 2026-04-01 21:34:06,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:34:06,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caec484b5e3e0ab6a64068 HTTP/1.1" 200 None 2026-04-01 21:34:06,230 - lava_callback - DEBUG - Processing node 69caec484b5e3e0ab6a64068: baseline-arm64-baylibre 2026-04-01 21:34:06,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caec484b5e3e0ab6a64068 2026-04-01 21:34:06,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:34:06,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caec484b5e3e0ab6a64068 HTTP/1.1" 200 None 2026-04-01 21:34:06,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:34:06,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:34:06,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:34:06,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caec484b5e3e0ab6a64068 HTTP/1.1" 200 None 2026-04-01 21:34:06,292 - lava_callback - ERROR - Error processing callback for node 69caec484b5e3e0ab6a64068: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35458 - "GET /node/693a1eac78d7681e6b4912c8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35464 - "GET /node/69280e22b1b5e06bf6c04e2a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44830 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:36:21,897 - lava_callback - INFO - Received callback for node 69caecc44b5e3e0ab6a64075 INFO: 172.21.0.1:44836 - "POST /node/69caecc44b5e3e0ab6a64075 HTTP/1.0" 202 Accepted 2026-04-01 21:36:21,903 - lava_callback - INFO - Starting async job submit for node 69caecc44b5e3e0ab6a64075 2026-04-01 21:36:21,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:36:21,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caecc44b5e3e0ab6a64075 HTTP/1.1" 200 None 2026-04-01 21:36:21,923 - lava_callback - DEBUG - Processing node 69caecc44b5e3e0ab6a64075: baseline-arm64-clabbe 2026-04-01 21:36:21,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caecc44b5e3e0ab6a64075 2026-04-01 21:36:21,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:36:21,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caecc44b5e3e0ab6a64075 HTTP/1.1" 200 None 2026-04-01 21:36:21,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:36:21,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:36:21,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:36:21,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caecc44b5e3e0ab6a64075 HTTP/1.1" 200 None 2026-04-01 21:36:21,978 - lava_callback - ERROR - Error processing callback for node 69caecc44b5e3e0ab6a64075: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59134 - "GET /node/698af5e53b3beb19e7616ee7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59138 - "GET /node/698312be409235c29c0debf3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:37:26,407 - lava_callback - INFO - Received callback for node 69caed0a4b5e3e0ab6a6407d INFO: 172.21.0.1:34866 - "POST /node/69caed0a4b5e3e0ab6a6407d HTTP/1.0" 202 Accepted 2026-04-01 21:37:26,412 - lava_callback - INFO - Starting async job submit for node 69caed0a4b5e3e0ab6a6407d 2026-04-01 21:37:26,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:37:26,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caed0a4b5e3e0ab6a6407d HTTP/1.1" 200 None 2026-04-01 21:37:26,428 - lava_callback - DEBUG - Processing node 69caed0a4b5e3e0ab6a6407d: baseline-arm64-baylibre 2026-04-01 21:37:26,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caed0a4b5e3e0ab6a6407d 2026-04-01 21:37:26,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:37:26,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caed0a4b5e3e0ab6a6407d HTTP/1.1" 200 None 2026-04-01 21:37:26,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:37:26,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:37:26,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:37:26,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caed0a4b5e3e0ab6a6407d HTTP/1.1" 200 None 2026-04-01 21:37:26,481 - lava_callback - ERROR - Error processing callback for node 69caed0a4b5e3e0ab6a6407d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42868 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:39:22,061 - lava_callback - INFO - Received callback for node 69caed7a4b5e3e0ab6a6408c INFO: 172.21.0.1:42876 - "POST /node/69caed7a4b5e3e0ab6a6408c HTTP/1.0" 202 Accepted 2026-04-01 21:39:22,067 - lava_callback - INFO - Starting async job submit for node 69caed7a4b5e3e0ab6a6408c 2026-04-01 21:39:22,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:39:22,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caed7a4b5e3e0ab6a6408c HTTP/1.1" 200 None 2026-04-01 21:39:22,083 - lava_callback - DEBUG - Processing node 69caed7a4b5e3e0ab6a6408c: baseline-arm64-clabbe 2026-04-01 21:39:22,083 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caed7a4b5e3e0ab6a6408c 2026-04-01 21:39:22,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:39:22,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caed7a4b5e3e0ab6a6408c HTTP/1.1" 200 None 2026-04-01 21:39:22,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:39:22,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:39:22,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:39:22,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caed7a4b5e3e0ab6a6408c HTTP/1.1" 200 None 2026-04-01 21:39:22,181 - lava_callback - ERROR - Error processing callback for node 69caed7a4b5e3e0ab6a6408c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET /node/694c2d302f7ca341fdeb3260%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49824 - "GET /node/699c81eba6c64c0c4f7a62b4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49828 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:40:26,534 - lava_callback - INFO - Received callback for node 69caedc24b5e3e0ab6a64094 INFO: 172.21.0.1:49842 - "POST /node/69caedc24b5e3e0ab6a64094 HTTP/1.0" 202 Accepted 2026-04-01 21:40:26,541 - lava_callback - INFO - Starting async job submit for node 69caedc24b5e3e0ab6a64094 2026-04-01 21:40:26,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:40:26,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caedc24b5e3e0ab6a64094 HTTP/1.1" 200 None 2026-04-01 21:40:26,557 - lava_callback - DEBUG - Processing node 69caedc24b5e3e0ab6a64094: baseline-arm64-baylibre 2026-04-01 21:40:26,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caedc24b5e3e0ab6a64094 2026-04-01 21:40:26,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:40:26,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caedc24b5e3e0ab6a64094 HTTP/1.1" 200 None 2026-04-01 21:40:26,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:40:26,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:40:26,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:40:26,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caedc24b5e3e0ab6a64094 HTTP/1.1" 200 None 2026-04-01 21:40:26,623 - lava_callback - ERROR - Error processing callback for node 69caedc24b5e3e0ab6a64094: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56722 - "GET /node/6981b5edf633e773758f9b49%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42300 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:41:46,612 - lava_callback - INFO - Received callback for node 69caee124b5e3e0ab6a640a1 INFO: 172.21.0.1:42314 - "POST /node/69caee124b5e3e0ab6a640a1 HTTP/1.0" 202 Accepted 2026-04-01 21:41:46,618 - lava_callback - INFO - Starting async job submit for node 69caee124b5e3e0ab6a640a1 2026-04-01 21:41:46,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:41:46,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caee124b5e3e0ab6a640a1 HTTP/1.1" 200 None 2026-04-01 21:41:46,634 - lava_callback - DEBUG - Processing node 69caee124b5e3e0ab6a640a1: baseline-arm64-baylibre 2026-04-01 21:41:46,634 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caee124b5e3e0ab6a640a1 2026-04-01 21:41:46,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:41:46,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caee124b5e3e0ab6a640a1 HTTP/1.1" 200 None 2026-04-01 21:41:46,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:41:46,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:41:46,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:41:46,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caee124b5e3e0ab6a640a1 HTTP/1.1" 200 None 2026-04-01 21:41:46,694 - lava_callback - ERROR - Error processing callback for node 69caee124b5e3e0ab6a640a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42010 - "GET /node/694777674917c2d89a1ed50b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42018 - "GET /node/69296125f7abe3da4c22a96d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49688 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:43:22,250 - lava_callback - INFO - Received callback for node 69caee684b5e3e0ab6a640b1 INFO: 172.21.0.1:49698 - "POST /node/69caee684b5e3e0ab6a640b1 HTTP/1.0" 202 Accepted 2026-04-01 21:43:22,256 - lava_callback - INFO - Starting async job submit for node 69caee684b5e3e0ab6a640b1 2026-04-01 21:43:22,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:43:22,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caee684b5e3e0ab6a640b1 HTTP/1.1" 200 None 2026-04-01 21:43:22,271 - lava_callback - DEBUG - Processing node 69caee684b5e3e0ab6a640b1: baseline-arm64-clabbe 2026-04-01 21:43:22,272 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caee684b5e3e0ab6a640b1 2026-04-01 21:43:22,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:43:22,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caee684b5e3e0ab6a640b1 HTTP/1.1" 200 None 2026-04-01 21:43:22,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:43:22,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:43:22,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:43:22,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caee684b5e3e0ab6a640b1 HTTP/1.1" 200 None 2026-04-01 21:43:22,337 - lava_callback - ERROR - Error processing callback for node 69caee684b5e3e0ab6a640b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53546 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:44:42,279 - lava_callback - INFO - Received callback for node 69caeeba4b5e3e0ab6a640c0 INFO: 172.21.0.1:40712 - "POST /node/69caeeba4b5e3e0ab6a640c0 HTTP/1.0" 202 Accepted 2026-04-01 21:44:42,285 - lava_callback - INFO - Starting async job submit for node 69caeeba4b5e3e0ab6a640c0 2026-04-01 21:44:42,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:44:42,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caeeba4b5e3e0ab6a640c0 HTTP/1.1" 200 None 2026-04-01 21:44:42,301 - lava_callback - DEBUG - Processing node 69caeeba4b5e3e0ab6a640c0: baseline-arm64-clabbe 2026-04-01 21:44:42,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caeeba4b5e3e0ab6a640c0 2026-04-01 21:44:42,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:44:42,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caeeba4b5e3e0ab6a640c0 HTTP/1.1" 200 None 2026-04-01 21:44:42,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:44:42,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:44:42,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:44:42,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caeeba4b5e3e0ab6a640c0 HTTP/1.1" 200 None 2026-04-01 21:44:42,353 - lava_callback - ERROR - Error processing callback for node 69caeeba4b5e3e0ab6a640c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:45:46,788 - lava_callback - INFO - Received callback for node 69caef004b5e3e0ab6a640c8 INFO: 172.21.0.1:37860 - "POST /node/69caef004b5e3e0ab6a640c8 HTTP/1.0" 202 Accepted 2026-04-01 21:45:46,793 - lava_callback - INFO - Starting async job submit for node 69caef004b5e3e0ab6a640c8 2026-04-01 21:45:46,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:45:46,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caef004b5e3e0ab6a640c8 HTTP/1.1" 200 None 2026-04-01 21:45:46,809 - lava_callback - DEBUG - Processing node 69caef004b5e3e0ab6a640c8: baseline-arm64-baylibre 2026-04-01 21:45:46,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caef004b5e3e0ab6a640c8 2026-04-01 21:45:46,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:45:46,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caef004b5e3e0ab6a640c8 HTTP/1.1" 200 None 2026-04-01 21:45:46,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:45:46,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:45:46,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:45:46,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caef004b5e3e0ab6a640c8 HTTP/1.1" 200 None 2026-04-01 21:45:46,882 - lava_callback - ERROR - Error processing callback for node 69caef004b5e3e0ab6a640c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38168 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:47:22,345 - lava_callback - INFO - Received callback for node 69caef594b5e3e0ab6a640d6 INFO: 172.21.0.1:38182 - "POST /node/69caef594b5e3e0ab6a640d6 HTTP/1.0" 202 Accepted 2026-04-01 21:47:22,350 - lava_callback - INFO - Starting async job submit for node 69caef594b5e3e0ab6a640d6 2026-04-01 21:47:22,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:47:22,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caef594b5e3e0ab6a640d6 HTTP/1.1" 200 None 2026-04-01 21:47:22,366 - lava_callback - DEBUG - Processing node 69caef594b5e3e0ab6a640d6: baseline-arm64-clabbe 2026-04-01 21:47:22,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caef594b5e3e0ab6a640d6 2026-04-01 21:47:22,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:47:22,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caef594b5e3e0ab6a640d6 HTTP/1.1" 200 None 2026-04-01 21:47:22,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:47:22,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:47:22,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:47:22,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caef594b5e3e0ab6a640d6 HTTP/1.1" 200 None 2026-04-01 21:47:22,441 - lava_callback - ERROR - Error processing callback for node 69caef594b5e3e0ab6a640d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:48:26,906 - lava_callback - INFO - Received callback for node 69caefa14b5e3e0ab6a640e1 INFO: 172.21.0.1:56944 - "POST /node/69caefa14b5e3e0ab6a640e1 HTTP/1.0" 202 Accepted 2026-04-01 21:48:26,912 - lava_callback - INFO - Starting async job submit for node 69caefa14b5e3e0ab6a640e1 2026-04-01 21:48:26,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:48:26,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caefa14b5e3e0ab6a640e1 HTTP/1.1" 200 None 2026-04-01 21:48:26,927 - lava_callback - DEBUG - Processing node 69caefa14b5e3e0ab6a640e1: baseline-arm64-baylibre 2026-04-01 21:48:26,928 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caefa14b5e3e0ab6a640e1 2026-04-01 21:48:26,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:48:26,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caefa14b5e3e0ab6a640e1 HTTP/1.1" 200 None 2026-04-01 21:48:26,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:48:26,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:48:26,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:48:27,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caefa14b5e3e0ab6a640e1 HTTP/1.1" 200 None 2026-04-01 21:48:27,029 - lava_callback - ERROR - Error processing callback for node 69caefa14b5e3e0ab6a640e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48106 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:49:00,060 - lava_callback - INFO - Received callback for node 69cbfcce8df9359ff4898433 INFO: 172.21.0.1:60064 - "POST /node/69cbfcce8df9359ff4898433 HTTP/1.0" 202 Accepted 2026-04-01 21:49:00,067 - lava_callback - INFO - Starting async job submit for node 69cbfcce8df9359ff4898433 2026-04-01 21:49:00,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:49:00,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcce8df9359ff4898433 HTTP/1.1" 200 None 2026-04-01 21:49:00,104 - lava_callback - DEBUG - Processing node 69cbfcce8df9359ff4898433: baseline-arm64-broonie 2026-04-01 21:49:00,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 21:49:00,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 21:49:00,503 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cbfcce8df9359ff4898433/log.txt.gz 2026-04-01 21:49:00,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 21:49:00,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 21:49:00,995 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cbfcce8df9359ff4898433/lava-logs.yaml 2026-04-01 21:49:01,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 21:49:01,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 21:49:01,128 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cbfcce8df9359ff4898433/lava_callback.json.gz 2026-04-01 21:49:01,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:49:01,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcce8df9359ff4898433 HTTP/1.1" 200 None 2026-04-01 21:49:01,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:49:01,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-01 21:49:01,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:49:01,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfcce8df9359ff4898433 HTTP/1.1" 200 None 2026-04-01 21:49:01,222 - lava_callback - INFO - Completed processing callback for node 69cbfcce8df9359ff4898433 INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:49:09,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:49:09,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51096 - "GET /node/6990ace9c45febfe44521ad7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51102 - "GET /node/693b318ced677bab79b2cdc4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41616 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:50:22,575 - lava_callback - INFO - Received callback for node 69caf00d4b5e3e0ab6a640f1 INFO: 172.21.0.1:41624 - "POST /node/69caf00d4b5e3e0ab6a640f1 HTTP/1.0" 202 Accepted 2026-04-01 21:50:22,580 - lava_callback - INFO - Starting async job submit for node 69caf00d4b5e3e0ab6a640f1 2026-04-01 21:50:22,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:50:22,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caf00d4b5e3e0ab6a640f1 HTTP/1.1" 200 None 2026-04-01 21:50:22,596 - lava_callback - DEBUG - Processing node 69caf00d4b5e3e0ab6a640f1: baseline-arm64-clabbe 2026-04-01 21:50:22,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caf00d4b5e3e0ab6a640f1 2026-04-01 21:50:22,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:50:22,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caf00d4b5e3e0ab6a640f1 HTTP/1.1" 200 None 2026-04-01 21:50:22,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:50:22,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:50:22,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:50:22,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caf00d4b5e3e0ab6a640f1 HTTP/1.1" 200 None 2026-04-01 21:50:22,661 - lava_callback - ERROR - Error processing callback for node 69caf00d4b5e3e0ab6a640f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:51:27,299 - lava_callback - INFO - Received callback for node 69caf0554b5e3e0ab6a640fd INFO: 172.21.0.1:42566 - "POST /node/69caf0554b5e3e0ab6a640fd HTTP/1.0" 202 Accepted 2026-04-01 21:51:27,305 - lava_callback - INFO - Starting async job submit for node 69caf0554b5e3e0ab6a640fd 2026-04-01 21:51:27,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:51:27,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caf0554b5e3e0ab6a640fd HTTP/1.1" 200 None 2026-04-01 21:51:27,320 - lava_callback - DEBUG - Processing node 69caf0554b5e3e0ab6a640fd: baseline-arm64-baylibre 2026-04-01 21:51:27,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caf0554b5e3e0ab6a640fd 2026-04-01 21:51:27,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:51:27,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caf0554b5e3e0ab6a640fd HTTP/1.1" 200 None 2026-04-01 21:51:27,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:51:27,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:51:27,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:51:27,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caf0554b5e3e0ab6a640fd HTTP/1.1" 200 None 2026-04-01 21:51:27,375 - lava_callback - ERROR - Error processing callback for node 69caf0554b5e3e0ab6a640fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37348 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:53:02,639 - lava_callback - INFO - Received callback for node 69caf0aa4b5e3e0ab6a6410c INFO: 172.21.0.1:33558 - "POST /node/69caf0aa4b5e3e0ab6a6410c HTTP/1.0" 202 Accepted 2026-04-01 21:53:02,645 - lava_callback - INFO - Starting async job submit for node 69caf0aa4b5e3e0ab6a6410c 2026-04-01 21:53:02,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:53:02,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caf0aa4b5e3e0ab6a6410c HTTP/1.1" 200 None 2026-04-01 21:53:02,661 - lava_callback - DEBUG - Processing node 69caf0aa4b5e3e0ab6a6410c: baseline-arm64-clabbe 2026-04-01 21:53:02,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caf0aa4b5e3e0ab6a6410c 2026-04-01 21:53:02,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:53:02,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caf0aa4b5e3e0ab6a6410c HTTP/1.1" 200 None 2026-04-01 21:53:02,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:53:02,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:53:02,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:53:02,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caf0aa4b5e3e0ab6a6410c HTTP/1.1" 200 None 2026-04-01 21:53:02,721 - lava_callback - ERROR - Error processing callback for node 69caf0aa4b5e3e0ab6a6410c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57508 - "GET /node/6940abd71e3c24e95681a6a1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:54:22,659 - lava_callback - INFO - Received callback for node 69caf0fe4b5e3e0ab6a6411b INFO: 172.21.0.1:49836 - "POST /node/69caf0fe4b5e3e0ab6a6411b HTTP/1.0" 202 Accepted 2026-04-01 21:54:22,665 - lava_callback - INFO - Starting async job submit for node 69caf0fe4b5e3e0ab6a6411b 2026-04-01 21:54:22,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:54:22,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caf0fe4b5e3e0ab6a6411b HTTP/1.1" 200 None 2026-04-01 21:54:22,681 - lava_callback - DEBUG - Processing node 69caf0fe4b5e3e0ab6a6411b: baseline-arm64-clabbe 2026-04-01 21:54:22,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caf0fe4b5e3e0ab6a6411b 2026-04-01 21:54:22,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:54:22,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caf0fe4b5e3e0ab6a6411b HTTP/1.1" 200 None 2026-04-01 21:54:22,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:54:22,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:54:22,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:54:22,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caf0fe4b5e3e0ab6a6411b HTTP/1.1" 200 None 2026-04-01 21:54:22,733 - lava_callback - ERROR - Error processing callback for node 69caf0fe4b5e3e0ab6a6411b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54420 - "GET /node/6990aec5c45febfe445224fe%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40296 - "GET /node/69863d20177ca0f097bd3098%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45348 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:55:42,764 - lava_callback - INFO - Received callback for node 69caf1514b5e3e0ab6a6412a INFO: 172.21.0.1:54348 - "POST /node/69caf1514b5e3e0ab6a6412a HTTP/1.0" 202 Accepted 2026-04-01 21:55:42,770 - lava_callback - INFO - Starting async job submit for node 69caf1514b5e3e0ab6a6412a 2026-04-01 21:55:42,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:55:42,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caf1514b5e3e0ab6a6412a HTTP/1.1" 200 None 2026-04-01 21:55:42,786 - lava_callback - DEBUG - Processing node 69caf1514b5e3e0ab6a6412a: baseline-arm64-clabbe 2026-04-01 21:55:42,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caf1514b5e3e0ab6a6412a 2026-04-01 21:55:42,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:55:42,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caf1514b5e3e0ab6a6412a HTTP/1.1" 200 None 2026-04-01 21:55:42,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:55:42,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:55:42,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:55:42,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caf1514b5e3e0ab6a6412a HTTP/1.1" 200 None 2026-04-01 21:55:42,841 - lava_callback - ERROR - Error processing callback for node 69caf1514b5e3e0ab6a6412a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46918 - "GET /node/693b7f1c41fb4c9509764205%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43536 - "GET /node/69934d0f523507f3806a5bd2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43544 - "GET /node/694a42562060d3d847922d74%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48560 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:57:02,827 - lava_callback - INFO - Received callback for node 69caf1a24b5e3e0ab6a6413a INFO: 172.21.0.1:33444 - "POST /node/69caf1a24b5e3e0ab6a6413a HTTP/1.0" 202 Accepted 2026-04-01 21:57:02,833 - lava_callback - INFO - Starting async job submit for node 69caf1a24b5e3e0ab6a6413a 2026-04-01 21:57:02,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:57:02,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caf1a24b5e3e0ab6a6413a HTTP/1.1" 200 None 2026-04-01 21:57:02,849 - lava_callback - DEBUG - Processing node 69caf1a24b5e3e0ab6a6413a: baseline-arm64-clabbe 2026-04-01 21:57:02,849 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caf1a24b5e3e0ab6a6413a 2026-04-01 21:57:02,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:57:02,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caf1a24b5e3e0ab6a6413a HTTP/1.1" 200 None 2026-04-01 21:57:02,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:57:02,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:57:02,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:57:02,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caf1a24b5e3e0ab6a6413a HTTP/1.1" 200 None 2026-04-01 21:57:02,904 - lava_callback - ERROR - Error processing callback for node 69caf1a24b5e3e0ab6a6413a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47290 - "GET /node/69840344969566dcb0d2b80e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52536 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:58:22,966 - lava_callback - INFO - Received callback for node 69caf1f24b5e3e0ab6a64143 INFO: 172.21.0.1:52544 - "POST /node/69caf1f24b5e3e0ab6a64143 HTTP/1.0" 202 Accepted 2026-04-01 21:58:22,972 - lava_callback - INFO - Starting async job submit for node 69caf1f24b5e3e0ab6a64143 2026-04-01 21:58:22,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:58:22,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caf1f24b5e3e0ab6a64143 HTTP/1.1" 200 None 2026-04-01 21:58:22,989 - lava_callback - DEBUG - Processing node 69caf1f24b5e3e0ab6a64143: baseline-arm64-clabbe 2026-04-01 21:58:22,989 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caf1f24b5e3e0ab6a64143 2026-04-01 21:58:22,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:58:23,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caf1f24b5e3e0ab6a64143 HTTP/1.1" 200 None 2026-04-01 21:58:23,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:58:23,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:58:23,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:58:23,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caf1f24b5e3e0ab6a64143 HTTP/1.1" 200 None 2026-04-01 21:58:23,065 - lava_callback - ERROR - Error processing callback for node 69caf1f24b5e3e0ab6a64143: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK 2026-04-01 21:59:42,925 - lava_callback - INFO - Received callback for node 69caf2434b5e3e0ab6a64154 INFO: 172.21.0.1:38754 - "POST /node/69caf2434b5e3e0ab6a64154 HTTP/1.0" 202 Accepted 2026-04-01 21:59:42,932 - lava_callback - INFO - Starting async job submit for node 69caf2434b5e3e0ab6a64154 2026-04-01 21:59:42,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:59:42,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caf2434b5e3e0ab6a64154 HTTP/1.1" 200 None 2026-04-01 21:59:42,959 - lava_callback - DEBUG - Processing node 69caf2434b5e3e0ab6a64154: baseline-arm64-clabbe 2026-04-01 21:59:42,959 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caf2434b5e3e0ab6a64154 2026-04-01 21:59:42,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:59:42,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caf2434b5e3e0ab6a64154 HTTP/1.1" 200 None 2026-04-01 21:59:42,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:59:42,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 21:59:42,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 21:59:43,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caf2434b5e3e0ab6a64154 HTTP/1.1" 200 None 2026-04-01 21:59:43,017 - lava_callback - ERROR - Error processing callback for node 69caf2434b5e3e0ab6a64154: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56160 - "GET / HTTP/1.0" 200 OK 2026-04-01 22:43:04,848 - lava_callback - INFO - Received callback for node 69cafc704b5e3e0ab6a64182 INFO: 172.21.0.1:59196 - "POST /node/69cafc704b5e3e0ab6a64182 HTTP/1.0" 202 Accepted 2026-04-01 22:43:04,853 - lava_callback - INFO - Starting async job submit for node 69cafc704b5e3e0ab6a64182 2026-04-01 22:43:04,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:43:04,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafc704b5e3e0ab6a64182 HTTP/1.1" 200 None 2026-04-01 22:43:04,870 - lava_callback - DEBUG - Processing node 69cafc704b5e3e0ab6a64182: baseline-arm-clabbe 2026-04-01 22:43:04,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cafc704b5e3e0ab6a64182 2026-04-01 22:43:04,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:43:04,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafc704b5e3e0ab6a64182 HTTP/1.1" 200 None 2026-04-01 22:43:04,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:43:04,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-04-01 22:43:04,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:43:04,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cafc704b5e3e0ab6a64182 HTTP/1.1" 200 None 2026-04-01 22:43:04,930 - lava_callback - ERROR - Error processing callback for node 69cafc704b5e3e0ab6a64182: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53172 - "GET / HTTP/1.0" 200 OK 2026-04-01 22:43:44,811 - lava_callback - INFO - Received callback for node 69cafc974b5e3e0ab6a6418b INFO: 172.21.0.1:42574 - "POST /node/69cafc974b5e3e0ab6a6418b HTTP/1.0" 202 Accepted 2026-04-01 22:43:44,817 - lava_callback - INFO - Starting async job submit for node 69cafc974b5e3e0ab6a6418b 2026-04-01 22:43:44,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:43:44,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafc974b5e3e0ab6a6418b HTTP/1.1" 200 None 2026-04-01 22:43:44,832 - lava_callback - DEBUG - Processing node 69cafc974b5e3e0ab6a6418b: baseline-arm-clabbe 2026-04-01 22:43:44,832 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cafc974b5e3e0ab6a6418b 2026-04-01 22:43:44,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:43:44,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafc974b5e3e0ab6a6418b HTTP/1.1" 200 None 2026-04-01 22:43:44,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:43:44,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-04-01 22:43:44,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:43:44,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cafc974b5e3e0ab6a6418b HTTP/1.1" 200 None 2026-04-01 22:43:44,882 - lava_callback - ERROR - Error processing callback for node 69cafc974b5e3e0ab6a6418b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60764 - "GET / HTTP/1.0" 200 OK 2026-04-01 22:44:24,971 - lava_callback - INFO - Received callback for node 69cafcbe4b5e3e0ab6a64197 INFO: 172.21.0.1:60778 - "POST /node/69cafcbe4b5e3e0ab6a64197 HTTP/1.0" 202 Accepted 2026-04-01 22:44:24,976 - lava_callback - INFO - Starting async job submit for node 69cafcbe4b5e3e0ab6a64197 2026-04-01 22:44:24,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:44:24,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafcbe4b5e3e0ab6a64197 HTTP/1.1" 200 None 2026-04-01 22:44:24,992 - lava_callback - DEBUG - Processing node 69cafcbe4b5e3e0ab6a64197: baseline-arm-clabbe 2026-04-01 22:44:24,992 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cafcbe4b5e3e0ab6a64197 2026-04-01 22:44:24,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:44:25,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafcbe4b5e3e0ab6a64197 HTTP/1.1" 200 None 2026-04-01 22:44:25,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:44:25,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-04-01 22:44:25,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:44:25,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cafcbe4b5e3e0ab6a64197 HTTP/1.1" 200 None 2026-04-01 22:44:25,043 - lava_callback - ERROR - Error processing callback for node 69cafcbe4b5e3e0ab6a64197: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET / HTTP/1.0" 200 OK 2026-04-01 22:45:04,974 - lava_callback - INFO - Received callback for node 69cafce44b5e3e0ab6a641a8 INFO: 172.21.0.1:44272 - "POST /node/69cafce44b5e3e0ab6a641a8 HTTP/1.0" 202 Accepted 2026-04-01 22:45:04,980 - lava_callback - INFO - Starting async job submit for node 69cafce44b5e3e0ab6a641a8 2026-04-01 22:45:04,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:45:04,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafce44b5e3e0ab6a641a8 HTTP/1.1" 200 None 2026-04-01 22:45:04,996 - lava_callback - DEBUG - Processing node 69cafce44b5e3e0ab6a641a8: baseline-arm-clabbe 2026-04-01 22:45:04,996 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cafce44b5e3e0ab6a641a8 2026-04-01 22:45:04,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:45:05,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafce44b5e3e0ab6a641a8 HTTP/1.1" 200 None 2026-04-01 22:45:05,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:45:05,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-04-01 22:45:05,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:45:05,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cafce44b5e3e0ab6a641a8 HTTP/1.1" 200 None 2026-04-01 22:45:05,066 - lava_callback - ERROR - Error processing callback for node 69cafce44b5e3e0ab6a641a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55438 - "GET / HTTP/1.0" 200 OK 2026-04-01 22:45:44,954 - lava_callback - INFO - Received callback for node 69cafd0a4b5e3e0ab6a641b3 INFO: 172.21.0.1:59168 - "POST /node/69cafd0a4b5e3e0ab6a641b3 HTTP/1.0" 202 Accepted 2026-04-01 22:45:44,960 - lava_callback - INFO - Starting async job submit for node 69cafd0a4b5e3e0ab6a641b3 2026-04-01 22:45:44,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:45:44,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafd0a4b5e3e0ab6a641b3 HTTP/1.1" 200 None 2026-04-01 22:45:44,975 - lava_callback - DEBUG - Processing node 69cafd0a4b5e3e0ab6a641b3: baseline-arm-clabbe 2026-04-01 22:45:44,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cafd0a4b5e3e0ab6a641b3 2026-04-01 22:45:44,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:45:44,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafd0a4b5e3e0ab6a641b3 HTTP/1.1" 200 None 2026-04-01 22:45:44,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:45:45,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-04-01 22:45:45,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:45:45,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cafd0a4b5e3e0ab6a641b3 HTTP/1.1" 200 None 2026-04-01 22:45:45,025 - lava_callback - ERROR - Error processing callback for node 69cafd0a4b5e3e0ab6a641b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK 2026-04-01 22:46:24,981 - lava_callback - INFO - Received callback for node 69cafd324b5e3e0ab6a641be INFO: 172.21.0.1:40736 - "POST /node/69cafd324b5e3e0ab6a641be HTTP/1.0" 202 Accepted 2026-04-01 22:46:24,987 - lava_callback - INFO - Starting async job submit for node 69cafd324b5e3e0ab6a641be 2026-04-01 22:46:24,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:46:25,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafd324b5e3e0ab6a641be HTTP/1.1" 200 None 2026-04-01 22:46:25,003 - lava_callback - DEBUG - Processing node 69cafd324b5e3e0ab6a641be: baseline-arm-clabbe 2026-04-01 22:46:25,003 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cafd324b5e3e0ab6a641be 2026-04-01 22:46:25,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:46:25,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafd324b5e3e0ab6a641be HTTP/1.1" 200 None 2026-04-01 22:46:25,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:46:25,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-04-01 22:46:25,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:46:25,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cafd324b5e3e0ab6a641be HTTP/1.1" 200 None 2026-04-01 22:46:25,056 - lava_callback - ERROR - Error processing callback for node 69cafd324b5e3e0ab6a641be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37168 - "GET / HTTP/1.0" 200 OK 2026-04-01 22:47:05,017 - lava_callback - INFO - Received callback for node 69cafd5a4b5e3e0ab6a641cd INFO: 172.21.0.1:33702 - "POST /node/69cafd5a4b5e3e0ab6a641cd HTTP/1.0" 202 Accepted 2026-04-01 22:47:05,022 - lava_callback - INFO - Starting async job submit for node 69cafd5a4b5e3e0ab6a641cd 2026-04-01 22:47:05,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:47:05,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafd5a4b5e3e0ab6a641cd HTTP/1.1" 200 None 2026-04-01 22:47:05,038 - lava_callback - DEBUG - Processing node 69cafd5a4b5e3e0ab6a641cd: baseline-arm-clabbe 2026-04-01 22:47:05,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cafd5a4b5e3e0ab6a641cd 2026-04-01 22:47:05,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:47:05,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafd5a4b5e3e0ab6a641cd HTTP/1.1" 200 None 2026-04-01 22:47:05,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:47:05,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-04-01 22:47:05,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:47:05,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cafd5a4b5e3e0ab6a641cd HTTP/1.1" 200 None 2026-04-01 22:47:05,089 - lava_callback - ERROR - Error processing callback for node 69cafd5a4b5e3e0ab6a641cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36102 - "GET / HTTP/1.0" 200 OK 2026-04-01 22:47:45,018 - lava_callback - INFO - Received callback for node 69cafd814b5e3e0ab6a641d5 INFO: 172.21.0.1:46410 - "POST /node/69cafd814b5e3e0ab6a641d5 HTTP/1.0" 202 Accepted 2026-04-01 22:47:45,024 - lava_callback - INFO - Starting async job submit for node 69cafd814b5e3e0ab6a641d5 2026-04-01 22:47:45,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:47:45,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafd814b5e3e0ab6a641d5 HTTP/1.1" 200 None 2026-04-01 22:47:45,040 - lava_callback - DEBUG - Processing node 69cafd814b5e3e0ab6a641d5: baseline-arm-clabbe 2026-04-01 22:47:45,040 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cafd814b5e3e0ab6a641d5 2026-04-01 22:47:45,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:47:45,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafd814b5e3e0ab6a641d5 HTTP/1.1" 200 None 2026-04-01 22:47:45,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:47:45,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-04-01 22:47:45,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:47:45,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cafd814b5e3e0ab6a641d5 HTTP/1.1" 200 None 2026-04-01 22:47:45,096 - lava_callback - ERROR - Error processing callback for node 69cafd814b5e3e0ab6a641d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46056 - "GET / HTTP/1.0" 200 OK 2026-04-01 22:48:25,318 - lava_callback - INFO - Received callback for node 69cafda84b5e3e0ab6a641e0 INFO: 172.21.0.1:46058 - "POST /node/69cafda84b5e3e0ab6a641e0 HTTP/1.0" 202 Accepted 2026-04-01 22:48:25,323 - lava_callback - INFO - Starting async job submit for node 69cafda84b5e3e0ab6a641e0 2026-04-01 22:48:25,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:48:25,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafda84b5e3e0ab6a641e0 HTTP/1.1" 200 None 2026-04-01 22:48:25,339 - lava_callback - DEBUG - Processing node 69cafda84b5e3e0ab6a641e0: baseline-arm-clabbe 2026-04-01 22:48:25,339 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cafda84b5e3e0ab6a641e0 2026-04-01 22:48:25,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:48:25,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafda84b5e3e0ab6a641e0 HTTP/1.1" 200 None 2026-04-01 22:48:25,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:48:25,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-04-01 22:48:25,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:48:25,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cafda84b5e3e0ab6a641e0 HTTP/1.1" 200 None 2026-04-01 22:48:25,420 - lava_callback - ERROR - Error processing callback for node 69cafda84b5e3e0ab6a641e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46336 - "GET / HTTP/1.0" 200 OK 2026-04-01 22:49:05,067 - lava_callback - INFO - Received callback for node 69cafdd04b5e3e0ab6a641ec INFO: 172.21.0.1:35736 - "POST /node/69cafdd04b5e3e0ab6a641ec HTTP/1.0" 202 Accepted 2026-04-01 22:49:05,074 - lava_callback - INFO - Starting async job submit for node 69cafdd04b5e3e0ab6a641ec 2026-04-01 22:49:05,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:49:05,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafdd04b5e3e0ab6a641ec HTTP/1.1" 200 None 2026-04-01 22:49:05,114 - lava_callback - DEBUG - Processing node 69cafdd04b5e3e0ab6a641ec: baseline-arm-clabbe 2026-04-01 22:49:05,114 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cafdd04b5e3e0ab6a641ec 2026-04-01 22:49:05,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:49:05,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cafdd04b5e3e0ab6a641ec HTTP/1.1" 200 None 2026-04-01 22:49:05,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:49:05,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-04-01 22:49:05,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:49:05,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cafdd04b5e3e0ab6a641ec HTTP/1.1" 200 None 2026-04-01 22:49:05,171 - lava_callback - ERROR - Error processing callback for node 69cafdd04b5e3e0ab6a641ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK 2026-04-01 22:55:10,551 - lava_callback - INFO - Received callback for node 69caff494b5e3e0ab6a6420c INFO: 172.21.0.1:59146 - "POST /node/69caff494b5e3e0ab6a6420c HTTP/1.0" 202 Accepted 2026-04-01 22:55:10,557 - lava_callback - INFO - Starting async job submit for node 69caff494b5e3e0ab6a6420c 2026-04-01 22:55:10,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:55:10,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caff494b5e3e0ab6a6420c HTTP/1.1" 200 None 2026-04-01 22:55:10,581 - lava_callback - DEBUG - Processing node 69caff494b5e3e0ab6a6420c: baseline-arm64-baylibre 2026-04-01 22:55:10,582 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caff494b5e3e0ab6a6420c 2026-04-01 22:55:10,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:55:10,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caff494b5e3e0ab6a6420c HTTP/1.1" 200 None 2026-04-01 22:55:10,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:55:10,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 22:55:10,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:55:10,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caff494b5e3e0ab6a6420c HTTP/1.1" 200 None 2026-04-01 22:55:10,665 - lava_callback - ERROR - Error processing callback for node 69caff494b5e3e0ab6a6420c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54904 - "GET / HTTP/1.0" 200 OK 2026-04-01 22:57:50,627 - lava_callback - INFO - Received callback for node 69caffe74b5e3e0ab6a64237 INFO: 172.21.0.1:34524 - "POST /node/69caffe74b5e3e0ab6a64237 HTTP/1.0" 202 Accepted 2026-04-01 22:57:50,632 - lava_callback - INFO - Starting async job submit for node 69caffe74b5e3e0ab6a64237 2026-04-01 22:57:50,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:57:50,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caffe74b5e3e0ab6a64237 HTTP/1.1" 200 None 2026-04-01 22:57:50,648 - lava_callback - DEBUG - Processing node 69caffe74b5e3e0ab6a64237: baseline-arm64-baylibre 2026-04-01 22:57:50,648 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caffe74b5e3e0ab6a64237 2026-04-01 22:57:50,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:57:50,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caffe74b5e3e0ab6a64237 HTTP/1.1" 200 None 2026-04-01 22:57:50,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:57:50,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-04-01 22:57:50,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 22:57:50,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caffe74b5e3e0ab6a64237 HTTP/1.1" 200 None 2026-04-01 22:57:50,722 - lava_callback - ERROR - Error processing callback for node 69caffe74b5e3e0ab6a64237: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:00:30,792 - lava_callback - INFO - Received callback for node 69cb00794b5e3e0ab6a64276 INFO: 172.21.0.1:42954 - "POST /node/69cb00794b5e3e0ab6a64276 HTTP/1.0" 202 Accepted 2026-04-01 23:00:30,798 - lava_callback - INFO - Starting async job submit for node 69cb00794b5e3e0ab6a64276 2026-04-01 23:00:30,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:00:30,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb00794b5e3e0ab6a64276 HTTP/1.1" 200 None 2026-04-01 23:00:30,814 - lava_callback - DEBUG - Processing node 69cb00794b5e3e0ab6a64276: baseline-arm-baylibre 2026-04-01 23:00:30,814 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb00794b5e3e0ab6a64276 2026-04-01 23:00:30,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:00:30,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb00794b5e3e0ab6a64276 HTTP/1.1" 200 None 2026-04-01 23:00:30,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:00:30,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 23:00:30,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:00:30,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb00794b5e3e0ab6a64276 HTTP/1.1" 200 None 2026-04-01 23:00:30,914 - lava_callback - ERROR - Error processing callback for node 69cb00794b5e3e0ab6a64276: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:00:50,750 - lava_callback - INFO - Received callback for node 69cb00a04b5e3e0ab6a64280 INFO: 172.21.0.1:60070 - "POST /node/69cb00a04b5e3e0ab6a64280 HTTP/1.0" 202 Accepted 2026-04-01 23:00:50,759 - lava_callback - INFO - Starting async job submit for node 69cb00a04b5e3e0ab6a64280 2026-04-01 23:00:50,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:00:50,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb00a04b5e3e0ab6a64280 HTTP/1.1" 200 None 2026-04-01 23:00:50,780 - lava_callback - DEBUG - Processing node 69cb00a04b5e3e0ab6a64280: baseline-arm-baylibre 2026-04-01 23:00:50,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb00a04b5e3e0ab6a64280 2026-04-01 23:00:50,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:00:50,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb00a04b5e3e0ab6a64280 HTTP/1.1" 200 None 2026-04-01 23:00:50,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:00:50,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 23:00:50,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:00:50,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb00a04b5e3e0ab6a64280 HTTP/1.1" 200 None 2026-04-01 23:00:50,841 - lava_callback - ERROR - Error processing callback for node 69cb00a04b5e3e0ab6a64280: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52432 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:01:50,839 - lava_callback - INFO - Received callback for node 69cb00cb4b5e3e0ab6a6428a INFO: 172.21.0.1:60578 - "POST /node/69cb00cb4b5e3e0ab6a6428a HTTP/1.0" 202 Accepted 2026-04-01 23:01:50,844 - lava_callback - INFO - Starting async job submit for node 69cb00cb4b5e3e0ab6a6428a 2026-04-01 23:01:50,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:01:50,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb00cb4b5e3e0ab6a6428a HTTP/1.1" 200 None 2026-04-01 23:01:50,866 - lava_callback - DEBUG - Processing node 69cb00cb4b5e3e0ab6a6428a: baseline-arm-baylibre 2026-04-01 23:01:50,866 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb00cb4b5e3e0ab6a6428a 2026-04-01 23:01:50,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:01:50,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb00cb4b5e3e0ab6a6428a HTTP/1.1" 200 None 2026-04-01 23:01:50,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:01:50,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 23:01:50,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:01:50,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb00cb4b5e3e0ab6a6428a HTTP/1.1" 200 None 2026-04-01 23:01:50,925 - lava_callback - ERROR - Error processing callback for node 69cb00cb4b5e3e0ab6a6428a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:02:30,834 - lava_callback - INFO - Received callback for node 69cb00f34b5e3e0ab6a64295 INFO: 172.21.0.1:34542 - "POST /node/69cb00f34b5e3e0ab6a64295 HTTP/1.0" 202 Accepted 2026-04-01 23:02:30,840 - lava_callback - INFO - Starting async job submit for node 69cb00f34b5e3e0ab6a64295 2026-04-01 23:02:30,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:02:30,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb00f34b5e3e0ab6a64295 HTTP/1.1" 200 None 2026-04-01 23:02:30,856 - lava_callback - DEBUG - Processing node 69cb00f34b5e3e0ab6a64295: baseline-arm-baylibre 2026-04-01 23:02:30,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb00f34b5e3e0ab6a64295 2026-04-01 23:02:30,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:02:30,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb00f34b5e3e0ab6a64295 HTTP/1.1" 200 None 2026-04-01 23:02:30,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:02:30,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 23:02:30,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:02:30,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb00f34b5e3e0ab6a64295 HTTP/1.1" 200 None 2026-04-01 23:02:30,919 - lava_callback - ERROR - Error processing callback for node 69cb00f34b5e3e0ab6a64295: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51322 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:03:10,875 - lava_callback - INFO - Received callback for node 69cb011b4b5e3e0ab6a642a3 INFO: 172.21.0.1:51852 - "POST /node/69cb011b4b5e3e0ab6a642a3 HTTP/1.0" 202 Accepted 2026-04-01 23:03:10,881 - lava_callback - INFO - Starting async job submit for node 69cb011b4b5e3e0ab6a642a3 2026-04-01 23:03:10,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:03:10,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb011b4b5e3e0ab6a642a3 HTTP/1.1" 200 None 2026-04-01 23:03:10,897 - lava_callback - DEBUG - Processing node 69cb011b4b5e3e0ab6a642a3: baseline-arm-baylibre 2026-04-01 23:03:10,897 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb011b4b5e3e0ab6a642a3 2026-04-01 23:03:10,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:03:10,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb011b4b5e3e0ab6a642a3 HTTP/1.1" 200 None 2026-04-01 23:03:10,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:03:10,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 23:03:10,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:03:10,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb011b4b5e3e0ab6a642a3 HTTP/1.1" 200 None 2026-04-01 23:03:10,963 - lava_callback - ERROR - Error processing callback for node 69cb011b4b5e3e0ab6a642a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41450 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:03:50,923 - lava_callback - INFO - Received callback for node 69cb014b4b5e3e0ab6a642ab INFO: 172.21.0.1:40236 - "POST /node/69cb014b4b5e3e0ab6a642ab HTTP/1.0" 202 Accepted 2026-04-01 23:03:50,928 - lava_callback - INFO - Starting async job submit for node 69cb014b4b5e3e0ab6a642ab 2026-04-01 23:03:50,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:03:50,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb014b4b5e3e0ab6a642ab HTTP/1.1" 200 None 2026-04-01 23:03:50,944 - lava_callback - DEBUG - Processing node 69cb014b4b5e3e0ab6a642ab: baseline-arm64-baylibre 2026-04-01 23:03:50,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb014b4b5e3e0ab6a642ab 2026-04-01 23:03:50,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:03:50,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb014b4b5e3e0ab6a642ab HTTP/1.1" 200 None 2026-04-01 23:03:50,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:03:50,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-04-01 23:03:50,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:03:50,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb014b4b5e3e0ab6a642ab HTTP/1.1" 200 None 2026-04-01 23:03:51,000 - lava_callback - ERROR - Error processing callback for node 69cb014b4b5e3e0ab6a642ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:05:11,035 - lava_callback - INFO - Received callback for node 69cb01954b5e3e0ab6a642bb INFO: 172.21.0.1:43622 - "POST /node/69cb01954b5e3e0ab6a642bb HTTP/1.0" 202 Accepted 2026-04-01 23:05:11,040 - lava_callback - INFO - Starting async job submit for node 69cb01954b5e3e0ab6a642bb 2026-04-01 23:05:11,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:05:11,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb01954b5e3e0ab6a642bb HTTP/1.1" 200 None 2026-04-01 23:05:11,056 - lava_callback - DEBUG - Processing node 69cb01954b5e3e0ab6a642bb: baseline-arm-baylibre 2026-04-01 23:05:11,056 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb01954b5e3e0ab6a642bb 2026-04-01 23:05:11,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:05:11,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb01954b5e3e0ab6a642bb HTTP/1.1" 200 None 2026-04-01 23:05:11,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:05:11,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 23:05:11,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:05:11,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb01954b5e3e0ab6a642bb HTTP/1.1" 200 None 2026-04-01 23:05:11,113 - lava_callback - ERROR - Error processing callback for node 69cb01954b5e3e0ab6a642bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40454 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:05:51,042 - lava_callback - INFO - Received callback for node 69cb01c64b5e3e0ab6a642c3 INFO: 172.21.0.1:57762 - "POST /node/69cb01c64b5e3e0ab6a642c3 HTTP/1.0" 202 Accepted 2026-04-01 23:05:51,048 - lava_callback - INFO - Starting async job submit for node 69cb01c64b5e3e0ab6a642c3 2026-04-01 23:05:51,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:05:51,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb01c64b5e3e0ab6a642c3 HTTP/1.1" 200 None 2026-04-01 23:05:51,065 - lava_callback - DEBUG - Processing node 69cb01c64b5e3e0ab6a642c3: baseline-arm64-baylibre 2026-04-01 23:05:51,066 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb01c64b5e3e0ab6a642c3 2026-04-01 23:05:51,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:05:51,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb01c64b5e3e0ab6a642c3 HTTP/1.1" 200 None 2026-04-01 23:05:51,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:05:51,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 23:05:51,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:05:51,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb01c64b5e3e0ab6a642c3 HTTP/1.1" 200 None 2026-04-01 23:05:51,132 - lava_callback - ERROR - Error processing callback for node 69cb01c64b5e3e0ab6a642c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47034 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:08:25,977 - lava_callback - INFO - Received callback for node 69cb025e4b5e3e0ab6a6430c INFO: 172.21.0.1:47046 - "POST /node/69cb025e4b5e3e0ab6a6430c HTTP/1.0" 202 Accepted 2026-04-01 23:08:25,983 - lava_callback - INFO - Starting async job submit for node 69cb025e4b5e3e0ab6a6430c 2026-04-01 23:08:25,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:08:25,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb025e4b5e3e0ab6a6430c HTTP/1.1" 200 None 2026-04-01 23:08:25,999 - lava_callback - DEBUG - Processing node 69cb025e4b5e3e0ab6a6430c: baseline-arm-clabbe 2026-04-01 23:08:25,999 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb025e4b5e3e0ab6a6430c 2026-04-01 23:08:26,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:08:26,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb025e4b5e3e0ab6a6430c HTTP/1.1" 200 None 2026-04-01 23:08:26,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:08:26,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 23:08:26,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:08:26,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb025e4b5e3e0ab6a6430c HTTP/1.1" 200 None 2026-04-01 23:08:26,062 - lava_callback - ERROR - Error processing callback for node 69cb025e4b5e3e0ab6a6430c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38606 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:09:05,904 - lava_callback - INFO - Received callback for node 69cb02874b5e3e0ab6a64319 INFO: 172.21.0.1:50626 - "POST /node/69cb02874b5e3e0ab6a64319 HTTP/1.0" 202 Accepted 2026-04-01 23:09:05,910 - lava_callback - INFO - Starting async job submit for node 69cb02874b5e3e0ab6a64319 2026-04-01 23:09:05,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:09:05,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb02874b5e3e0ab6a64319 HTTP/1.1" 200 None 2026-04-01 23:09:05,931 - lava_callback - DEBUG - Processing node 69cb02874b5e3e0ab6a64319: baseline-arm-clabbe 2026-04-01 23:09:05,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb02874b5e3e0ab6a64319 2026-04-01 23:09:05,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:09:05,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb02874b5e3e0ab6a64319 HTTP/1.1" 200 None 2026-04-01 23:09:05,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:09:05,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 23:09:05,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:09:06,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb02874b5e3e0ab6a64319 HTTP/1.1" 200 None 2026-04-01 23:09:06,156 - lava_callback - ERROR - Error processing callback for node 69cb02874b5e3e0ab6a64319: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44210 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:09:45,995 - lava_callback - INFO - Received callback for node 69cb02af4b5e3e0ab6a64322 INFO: 172.21.0.1:51668 - "POST /node/69cb02af4b5e3e0ab6a64322 HTTP/1.0" 202 Accepted 2026-04-01 23:09:46,001 - lava_callback - INFO - Starting async job submit for node 69cb02af4b5e3e0ab6a64322 2026-04-01 23:09:46,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:09:46,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb02af4b5e3e0ab6a64322 HTTP/1.1" 200 None 2026-04-01 23:09:46,017 - lava_callback - DEBUG - Processing node 69cb02af4b5e3e0ab6a64322: baseline-arm-clabbe 2026-04-01 23:09:46,017 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb02af4b5e3e0ab6a64322 2026-04-01 23:09:46,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:09:46,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb02af4b5e3e0ab6a64322 HTTP/1.1" 200 None 2026-04-01 23:09:46,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:09:46,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 23:09:46,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:09:46,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb02af4b5e3e0ab6a64322 HTTP/1.1" 200 None 2026-04-01 23:09:46,086 - lava_callback - ERROR - Error processing callback for node 69cb02af4b5e3e0ab6a64322: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43790 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:10:25,935 - lava_callback - INFO - Received callback for node 69cb02d64b5e3e0ab6a6432e INFO: 172.21.0.1:43804 - "POST /node/69cb02d64b5e3e0ab6a6432e HTTP/1.0" 202 Accepted 2026-04-01 23:10:25,941 - lava_callback - INFO - Starting async job submit for node 69cb02d64b5e3e0ab6a6432e 2026-04-01 23:10:25,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:10:25,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb02d64b5e3e0ab6a6432e HTTP/1.1" 200 None 2026-04-01 23:10:25,957 - lava_callback - DEBUG - Processing node 69cb02d64b5e3e0ab6a6432e: baseline-arm-clabbe 2026-04-01 23:10:25,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb02d64b5e3e0ab6a6432e 2026-04-01 23:10:25,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:10:25,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb02d64b5e3e0ab6a6432e HTTP/1.1" 200 None 2026-04-01 23:10:25,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:10:25,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 23:10:25,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:10:26,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb02d64b5e3e0ab6a6432e HTTP/1.1" 200 None 2026-04-01 23:10:26,012 - lava_callback - ERROR - Error processing callback for node 69cb02d64b5e3e0ab6a6432e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40032 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:11:05,987 - lava_callback - INFO - Received callback for node 69cb02fd4b5e3e0ab6a6433b INFO: 172.21.0.1:42600 - "POST /node/69cb02fd4b5e3e0ab6a6433b HTTP/1.0" 202 Accepted 2026-04-01 23:11:05,993 - lava_callback - INFO - Starting async job submit for node 69cb02fd4b5e3e0ab6a6433b 2026-04-01 23:11:05,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:11:06,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb02fd4b5e3e0ab6a6433b HTTP/1.1" 200 None 2026-04-01 23:11:06,009 - lava_callback - DEBUG - Processing node 69cb02fd4b5e3e0ab6a6433b: baseline-arm-clabbe 2026-04-01 23:11:06,009 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb02fd4b5e3e0ab6a6433b 2026-04-01 23:11:06,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:11:06,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb02fd4b5e3e0ab6a6433b HTTP/1.1" 200 None 2026-04-01 23:11:06,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:11:06,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-01 23:11:06,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:11:06,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb02fd4b5e3e0ab6a6433b HTTP/1.1" 200 None 2026-04-01 23:11:06,077 - lava_callback - ERROR - Error processing callback for node 69cb02fd4b5e3e0ab6a6433b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:12:06,112 - lava_callback - INFO - Received callback for node 69cb03354b5e3e0ab6a64342 INFO: 172.21.0.1:42410 - "POST /node/69cb03354b5e3e0ab6a64342 HTTP/1.0" 202 Accepted 2026-04-01 23:12:06,118 - lava_callback - INFO - Starting async job submit for node 69cb03354b5e3e0ab6a64342 2026-04-01 23:12:06,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:12:06,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb03354b5e3e0ab6a64342 HTTP/1.1" 200 None 2026-04-01 23:12:06,134 - lava_callback - DEBUG - Processing node 69cb03354b5e3e0ab6a64342: baseline-arm64-clabbe 2026-04-01 23:12:06,134 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb03354b5e3e0ab6a64342 2026-04-01 23:12:06,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:12:06,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb03354b5e3e0ab6a64342 HTTP/1.1" 200 None 2026-04-01 23:12:06,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:12:06,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 23:12:06,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:12:06,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb03354b5e3e0ab6a64342 HTTP/1.1" 200 None 2026-04-01 23:12:06,189 - lava_callback - ERROR - Error processing callback for node 69cb03354b5e3e0ab6a64342: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37432 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:13:11,532 - lava_callback - INFO - Received callback for node 69cb03814b5e3e0ab6a64354 INFO: 172.21.0.1:53918 - "POST /node/69cb03814b5e3e0ab6a64354 HTTP/1.0" 202 Accepted 2026-04-01 23:13:11,538 - lava_callback - INFO - Starting async job submit for node 69cb03814b5e3e0ab6a64354 2026-04-01 23:13:11,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:13:11,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb03814b5e3e0ab6a64354 HTTP/1.1" 200 None 2026-04-01 23:13:11,559 - lava_callback - DEBUG - Processing node 69cb03814b5e3e0ab6a64354: baseline-arm64-baylibre 2026-04-01 23:13:11,560 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb03814b5e3e0ab6a64354 2026-04-01 23:13:11,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:13:11,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb03814b5e3e0ab6a64354 HTTP/1.1" 200 None 2026-04-01 23:13:11,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:13:11,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-04-01 23:13:11,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:13:11,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb03814b5e3e0ab6a64354 HTTP/1.1" 200 None 2026-04-01 23:13:11,613 - lava_callback - ERROR - Error processing callback for node 69cb03814b5e3e0ab6a64354: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35836 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:14:46,202 - lava_callback - INFO - Received callback for node 69cb03db4b5e3e0ab6a64367 INFO: 172.21.0.1:46554 - "POST /node/69cb03db4b5e3e0ab6a64367 HTTP/1.0" 202 Accepted 2026-04-01 23:14:46,207 - lava_callback - INFO - Starting async job submit for node 69cb03db4b5e3e0ab6a64367 2026-04-01 23:14:46,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:14:46,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb03db4b5e3e0ab6a64367 HTTP/1.1" 200 None 2026-04-01 23:14:46,223 - lava_callback - DEBUG - Processing node 69cb03db4b5e3e0ab6a64367: baseline-arm64-clabbe 2026-04-01 23:14:46,224 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb03db4b5e3e0ab6a64367 2026-04-01 23:14:46,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:14:46,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb03db4b5e3e0ab6a64367 HTTP/1.1" 200 None 2026-04-01 23:14:46,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:14:46,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 23:14:46,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:14:46,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb03db4b5e3e0ab6a64367 HTTP/1.1" 200 None 2026-04-01 23:14:46,278 - lava_callback - ERROR - Error processing callback for node 69cb03db4b5e3e0ab6a64367: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:16:11,656 - lava_callback - INFO - Received callback for node 69cb04274b5e3e0ab6a6437b INFO: 172.21.0.1:47208 - "POST /node/69cb04274b5e3e0ab6a6437b HTTP/1.0" 202 Accepted 2026-04-01 23:16:11,662 - lava_callback - INFO - Starting async job submit for node 69cb04274b5e3e0ab6a6437b 2026-04-01 23:16:11,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:16:11,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb04274b5e3e0ab6a6437b HTTP/1.1" 200 None 2026-04-01 23:16:11,676 - lava_callback - DEBUG - Processing node 69cb04274b5e3e0ab6a6437b: baseline-arm64-baylibre 2026-04-01 23:16:11,677 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb04274b5e3e0ab6a6437b 2026-04-01 23:16:11,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:16:11,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb04274b5e3e0ab6a6437b HTTP/1.1" 200 None 2026-04-01 23:16:11,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:16:11,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-04-01 23:16:11,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:16:11,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb04274b5e3e0ab6a6437b HTTP/1.1" 200 None 2026-04-01 23:16:11,734 - lava_callback - ERROR - Error processing callback for node 69cb04274b5e3e0ab6a6437b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58808 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:17:26,296 - lava_callback - INFO - Received callback for node 69cb04814b5e3e0ab6a6438f INFO: 172.21.0.1:58814 - "POST /node/69cb04814b5e3e0ab6a6438f HTTP/1.0" 202 Accepted 2026-04-01 23:17:26,301 - lava_callback - INFO - Starting async job submit for node 69cb04814b5e3e0ab6a6438f 2026-04-01 23:17:26,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:17:26,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb04814b5e3e0ab6a6438f HTTP/1.1" 200 None 2026-04-01 23:17:26,328 - lava_callback - DEBUG - Processing node 69cb04814b5e3e0ab6a6438f: baseline-arm64-clabbe 2026-04-01 23:17:26,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb04814b5e3e0ab6a6438f 2026-04-01 23:17:26,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:17:26,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb04814b5e3e0ab6a6438f HTTP/1.1" 200 None 2026-04-01 23:17:26,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:17:26,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 23:17:26,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:17:26,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb04814b5e3e0ab6a6438f HTTP/1.1" 200 None 2026-04-01 23:17:26,388 - lava_callback - ERROR - Error processing callback for node 69cb04814b5e3e0ab6a6438f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49820 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:18:46,385 - lava_callback - INFO - Received callback for node 69cb04d34b5e3e0ab6a6439c INFO: 172.21.0.1:45354 - "POST /node/69cb04d34b5e3e0ab6a6439c HTTP/1.0" 202 Accepted 2026-04-01 23:18:46,391 - lava_callback - INFO - Starting async job submit for node 69cb04d34b5e3e0ab6a6439c 2026-04-01 23:18:46,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:18:46,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb04d34b5e3e0ab6a6439c HTTP/1.1" 200 None 2026-04-01 23:18:46,407 - lava_callback - DEBUG - Processing node 69cb04d34b5e3e0ab6a6439c: baseline-arm64-clabbe 2026-04-01 23:18:46,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb04d34b5e3e0ab6a6439c 2026-04-01 23:18:46,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:18:46,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb04d34b5e3e0ab6a6439c HTTP/1.1" 200 None 2026-04-01 23:18:46,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:18:46,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 23:18:46,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:18:46,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb04d34b5e3e0ab6a6439c HTTP/1.1" 200 None 2026-04-01 23:18:46,466 - lava_callback - ERROR - Error processing callback for node 69cb04d34b5e3e0ab6a6439c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57396 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:20:26,493 - lava_callback - INFO - Received callback for node 69cb05254b5e3e0ab6a643af INFO: 172.21.0.1:57402 - "POST /node/69cb05254b5e3e0ab6a643af HTTP/1.0" 202 Accepted 2026-04-01 23:20:26,498 - lava_callback - INFO - Starting async job submit for node 69cb05254b5e3e0ab6a643af 2026-04-01 23:20:26,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:57412 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:20:26,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb05254b5e3e0ab6a643af HTTP/1.1" 200 None 2026-04-01 23:20:26,515 - lava_callback - DEBUG - Processing node 69cb05254b5e3e0ab6a643af: baseline-arm64-clabbe 2026-04-01 23:20:26,515 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb05254b5e3e0ab6a643af 2026-04-01 23:20:26,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:20:26,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb05254b5e3e0ab6a643af HTTP/1.1" 200 None 2026-04-01 23:20:26,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:20:26,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 23:20:26,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:20:26,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb05254b5e3e0ab6a643af HTTP/1.1" 200 None 2026-04-01 23:20:26,589 - lava_callback - ERROR - Error processing callback for node 69cb05254b5e3e0ab6a643af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59548 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:21:46,506 - lava_callback - INFO - Received callback for node 69cb05764b5e3e0ab6a643c2 INFO: 172.21.0.1:43904 - "POST /node/69cb05764b5e3e0ab6a643c2 HTTP/1.0" 202 Accepted 2026-04-01 23:21:46,511 - lava_callback - INFO - Starting async job submit for node 69cb05764b5e3e0ab6a643c2 2026-04-01 23:21:46,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:43918 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:21:46,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb05764b5e3e0ab6a643c2 HTTP/1.1" 200 None 2026-04-01 23:21:46,527 - lava_callback - DEBUG - Processing node 69cb05764b5e3e0ab6a643c2: baseline-arm64-clabbe 2026-04-01 23:21:46,527 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb05764b5e3e0ab6a643c2 2026-04-01 23:21:46,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:21:46,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb05764b5e3e0ab6a643c2 HTTP/1.1" 200 None 2026-04-01 23:21:46,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:21:46,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 23:21:46,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:21:46,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb05764b5e3e0ab6a643c2 HTTP/1.1" 200 None 2026-04-01 23:21:46,578 - lava_callback - ERROR - Error processing callback for node 69cb05764b5e3e0ab6a643c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57290 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:28:12,476 - lava_callback - INFO - Received callback for node 69cb06fe4b5e3e0ab6a64402 INFO: 172.21.0.1:56514 - "POST /node/69cb06fe4b5e3e0ab6a64402 HTTP/1.0" 202 Accepted 2026-04-01 23:28:12,482 - lava_callback - INFO - Starting async job submit for node 69cb06fe4b5e3e0ab6a64402 2026-04-01 23:28:12,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:28:12,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb06fe4b5e3e0ab6a64402 HTTP/1.1" 200 None 2026-04-01 23:28:12,504 - lava_callback - DEBUG - Processing node 69cb06fe4b5e3e0ab6a64402: baseline-arm64-baylibre 2026-04-01 23:28:12,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb06fe4b5e3e0ab6a64402 2026-04-01 23:28:12,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:28:12,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb06fe4b5e3e0ab6a64402 HTTP/1.1" 200 None 2026-04-01 23:28:12,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:28:12,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 23:28:12,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:28:12,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb06fe4b5e3e0ab6a64402 HTTP/1.1" 200 None 2026-04-01 23:28:12,577 - lava_callback - ERROR - Error processing callback for node 69cb06fe4b5e3e0ab6a64402: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49814 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:29:32,342 - lava_callback - INFO - Received callback for node 69cb07514b5e3e0ab6a64414 INFO: 172.21.0.1:48152 - "POST /node/69cb07514b5e3e0ab6a64414 HTTP/1.0" 202 Accepted 2026-04-01 23:29:32,348 - lava_callback - INFO - Starting async job submit for node 69cb07514b5e3e0ab6a64414 2026-04-01 23:29:32,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:29:32,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb07514b5e3e0ab6a64414 HTTP/1.1" 200 None 2026-04-01 23:29:32,363 - lava_callback - DEBUG - Processing node 69cb07514b5e3e0ab6a64414: baseline-arm64-baylibre 2026-04-01 23:29:32,363 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb07514b5e3e0ab6a64414 2026-04-01 23:29:32,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:29:32,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb07514b5e3e0ab6a64414 HTTP/1.1" 200 None 2026-04-01 23:29:32,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:29:32,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 23:29:32,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:29:32,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb07514b5e3e0ab6a64414 HTTP/1.1" 200 None 2026-04-01 23:29:32,428 - lava_callback - ERROR - Error processing callback for node 69cb07514b5e3e0ab6a64414: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52364 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:30:52,493 - lava_callback - INFO - Received callback for node 69cb07a24b5e3e0ab6a6441f INFO: 172.21.0.1:42574 - "POST /node/69cb07a24b5e3e0ab6a6441f HTTP/1.0" 202 Accepted 2026-04-01 23:30:52,498 - lava_callback - INFO - Starting async job submit for node 69cb07a24b5e3e0ab6a6441f 2026-04-01 23:30:52,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:30:52,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb07a24b5e3e0ab6a6441f HTTP/1.1" 200 None 2026-04-01 23:30:52,514 - lava_callback - DEBUG - Processing node 69cb07a24b5e3e0ab6a6441f: baseline-arm64-baylibre 2026-04-01 23:30:52,514 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb07a24b5e3e0ab6a6441f 2026-04-01 23:30:52,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:30:52,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb07a24b5e3e0ab6a6441f HTTP/1.1" 200 None 2026-04-01 23:30:52,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:30:52,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 23:30:52,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:30:52,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb07a24b5e3e0ab6a6441f HTTP/1.1" 200 None 2026-04-01 23:30:52,574 - lava_callback - ERROR - Error processing callback for node 69cb07a24b5e3e0ab6a6441f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52146 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:32:26,991 - lava_callback - INFO - Received callback for node 69cb07f74b5e3e0ab6a64430 INFO: 172.21.0.1:52156 - "POST /node/69cb07f74b5e3e0ab6a64430 HTTP/1.0" 202 Accepted 2026-04-01 23:32:26,998 - lava_callback - INFO - Starting async job submit for node 69cb07f74b5e3e0ab6a64430 2026-04-01 23:32:26,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:32:27,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb07f74b5e3e0ab6a64430 HTTP/1.1" 200 None 2026-04-01 23:32:27,050 - lava_callback - DEBUG - Processing node 69cb07f74b5e3e0ab6a64430: baseline-arm64-clabbe 2026-04-01 23:32:27,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb07f74b5e3e0ab6a64430 2026-04-01 23:32:27,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:32:27,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb07f74b5e3e0ab6a64430 HTTP/1.1" 200 None 2026-04-01 23:32:27,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:32:27,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 23:32:27,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:32:27,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb07f74b5e3e0ab6a64430 HTTP/1.1" 200 None 2026-04-01 23:32:27,106 - lava_callback - ERROR - Error processing callback for node 69cb07f74b5e3e0ab6a64430: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49626 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:33:47,124 - lava_callback - INFO - Received callback for node 69cb08484b5e3e0ab6a64443 INFO: 172.21.0.1:49634 - "POST /node/69cb08484b5e3e0ab6a64443 HTTP/1.0" 202 Accepted 2026-04-01 23:33:47,129 - lava_callback - INFO - Starting async job submit for node 69cb08484b5e3e0ab6a64443 2026-04-01 23:33:47,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:33:47,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb08484b5e3e0ab6a64443 HTTP/1.1" 200 None 2026-04-01 23:33:47,146 - lava_callback - DEBUG - Processing node 69cb08484b5e3e0ab6a64443: baseline-arm64-clabbe 2026-04-01 23:33:47,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb08484b5e3e0ab6a64443 2026-04-01 23:33:47,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:33:47,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb08484b5e3e0ab6a64443 HTTP/1.1" 200 None 2026-04-01 23:33:47,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:33:47,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 23:33:47,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:33:47,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb08484b5e3e0ab6a64443 HTTP/1.1" 200 None 2026-04-01 23:33:47,236 - lava_callback - ERROR - Error processing callback for node 69cb08484b5e3e0ab6a64443: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35616 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:35:07,274 - lava_callback - INFO - Received callback for node 69cb089b4b5e3e0ab6a64452 INFO: 172.21.0.1:35632 - "POST /node/69cb089b4b5e3e0ab6a64452 HTTP/1.0" 202 Accepted 2026-04-01 23:35:07,279 - lava_callback - INFO - Starting async job submit for node 69cb089b4b5e3e0ab6a64452 2026-04-01 23:35:07,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:35:07,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb089b4b5e3e0ab6a64452 HTTP/1.1" 200 None 2026-04-01 23:35:07,300 - lava_callback - DEBUG - Processing node 69cb089b4b5e3e0ab6a64452: baseline-arm64-clabbe 2026-04-01 23:35:07,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb089b4b5e3e0ab6a64452 2026-04-01 23:35:07,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:35:07,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb089b4b5e3e0ab6a64452 HTTP/1.1" 200 None 2026-04-01 23:35:07,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:35:07,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 23:35:07,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:35:07,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb089b4b5e3e0ab6a64452 HTTP/1.1" 200 None 2026-04-01 23:35:07,356 - lava_callback - ERROR - Error processing callback for node 69cb089b4b5e3e0ab6a64452: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45786 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:36:27,214 - lava_callback - INFO - Received callback for node 69cb08ec4b5e3e0ab6a6445c INFO: 172.21.0.1:45788 - "POST /node/69cb08ec4b5e3e0ab6a6445c HTTP/1.0" 202 Accepted 2026-04-01 23:36:27,220 - lava_callback - INFO - Starting async job submit for node 69cb08ec4b5e3e0ab6a6445c 2026-04-01 23:36:27,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:36:27,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb08ec4b5e3e0ab6a6445c HTTP/1.1" 200 None 2026-04-01 23:36:27,241 - lava_callback - DEBUG - Processing node 69cb08ec4b5e3e0ab6a6445c: baseline-arm64-clabbe 2026-04-01 23:36:27,241 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb08ec4b5e3e0ab6a6445c 2026-04-01 23:36:27,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:36:27,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb08ec4b5e3e0ab6a6445c HTTP/1.1" 200 None 2026-04-01 23:36:27,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:36:27,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 23:36:27,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:36:27,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb08ec4b5e3e0ab6a6445c HTTP/1.1" 200 None 2026-04-01 23:36:27,300 - lava_callback - ERROR - Error processing callback for node 69cb08ec4b5e3e0ab6a6445c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40468 - "GET /node/69936dcccebe99dd8e0680cf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45392 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:37:47,254 - lava_callback - INFO - Received callback for node 69cb093c4b5e3e0ab6a6446e INFO: 172.21.0.1:45404 - "POST /node/69cb093c4b5e3e0ab6a6446e HTTP/1.0" 202 Accepted 2026-04-01 23:37:47,261 - lava_callback - INFO - Starting async job submit for node 69cb093c4b5e3e0ab6a6446e 2026-04-01 23:37:47,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:37:47,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb093c4b5e3e0ab6a6446e HTTP/1.1" 200 None 2026-04-01 23:37:47,276 - lava_callback - DEBUG - Processing node 69cb093c4b5e3e0ab6a6446e: baseline-arm64-clabbe 2026-04-01 23:37:47,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb093c4b5e3e0ab6a6446e 2026-04-01 23:37:47,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:37:47,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb093c4b5e3e0ab6a6446e HTTP/1.1" 200 None 2026-04-01 23:37:47,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:37:47,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 23:37:47,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:37:47,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb093c4b5e3e0ab6a6446e HTTP/1.1" 200 None 2026-04-01 23:37:47,334 - lava_callback - ERROR - Error processing callback for node 69cb093c4b5e3e0ab6a6446e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39326 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:39:07,353 - lava_callback - INFO - Received callback for node 69cb098c4b5e3e0ab6a64480 INFO: 172.21.0.1:39342 - "POST /node/69cb098c4b5e3e0ab6a64480 HTTP/1.0" 202 Accepted 2026-04-01 23:39:07,359 - lava_callback - INFO - Starting async job submit for node 69cb098c4b5e3e0ab6a64480 2026-04-01 23:39:07,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:39:07,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb098c4b5e3e0ab6a64480 HTTP/1.1" 200 None 2026-04-01 23:39:07,379 - lava_callback - DEBUG - Processing node 69cb098c4b5e3e0ab6a64480: baseline-arm64-clabbe 2026-04-01 23:39:07,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb098c4b5e3e0ab6a64480 2026-04-01 23:39:07,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:39:07,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb098c4b5e3e0ab6a64480 HTTP/1.1" 200 None 2026-04-01 23:39:07,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:39:07,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-01 23:39:07,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:39:07,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb098c4b5e3e0ab6a64480 HTTP/1.1" 200 None 2026-04-01 23:39:07,437 - lava_callback - ERROR - Error processing callback for node 69cb098c4b5e3e0ab6a64480: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44398 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:40:27,349 - lava_callback - INFO - Received callback for node 69cb09dc4b5e3e0ab6a64488 INFO: 172.21.0.1:44410 - "POST /node/69cb09dc4b5e3e0ab6a64488 HTTP/1.0" 202 Accepted 2026-04-01 23:40:27,355 - lava_callback - INFO - Starting async job submit for node 69cb09dc4b5e3e0ab6a64488 2026-04-01 23:40:27,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:40:27,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb09dc4b5e3e0ab6a64488 HTTP/1.1" 200 None 2026-04-01 23:40:27,371 - lava_callback - DEBUG - Processing node 69cb09dc4b5e3e0ab6a64488: baseline-arm64-clabbe 2026-04-01 23:40:27,371 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb09dc4b5e3e0ab6a64488 2026-04-01 23:40:27,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:40:27,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb09dc4b5e3e0ab6a64488 HTTP/1.1" 200 None 2026-04-01 23:40:27,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:40:27,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-04-01 23:40:27,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:40:27,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb09dc4b5e3e0ab6a64488 HTTP/1.1" 200 None 2026-04-01 23:40:27,440 - lava_callback - ERROR - Error processing callback for node 69cb09dc4b5e3e0ab6a64488: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:41:47,423 - lava_callback - INFO - Received callback for node 69cb0a2d4b5e3e0ab6a6449a INFO: 172.21.0.1:33024 - "POST /node/69cb0a2d4b5e3e0ab6a6449a HTTP/1.0" 202 Accepted 2026-04-01 23:41:47,429 - lava_callback - INFO - Starting async job submit for node 69cb0a2d4b5e3e0ab6a6449a 2026-04-01 23:41:47,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:41:47,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0a2d4b5e3e0ab6a6449a HTTP/1.1" 200 None 2026-04-01 23:41:47,449 - lava_callback - DEBUG - Processing node 69cb0a2d4b5e3e0ab6a6449a: baseline-arm64-clabbe 2026-04-01 23:41:47,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0a2d4b5e3e0ab6a6449a 2026-04-01 23:41:47,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:41:47,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0a2d4b5e3e0ab6a6449a HTTP/1.1" 200 None 2026-04-01 23:41:47,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:41:47,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-04-01 23:41:47,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:41:47,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0a2d4b5e3e0ab6a6449a HTTP/1.1" 200 None 2026-04-01 23:41:47,505 - lava_callback - ERROR - Error processing callback for node 69cb0a2d4b5e3e0ab6a6449a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40340 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:43:07,473 - lava_callback - INFO - Received callback for node 69cb0a7e4b5e3e0ab6a644ab INFO: 172.21.0.1:40356 - "POST /node/69cb0a7e4b5e3e0ab6a644ab HTTP/1.0" 202 Accepted 2026-04-01 23:43:07,478 - lava_callback - INFO - Starting async job submit for node 69cb0a7e4b5e3e0ab6a644ab 2026-04-01 23:43:07,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:43:07,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0a7e4b5e3e0ab6a644ab HTTP/1.1" 200 None 2026-04-01 23:43:07,494 - lava_callback - DEBUG - Processing node 69cb0a7e4b5e3e0ab6a644ab: baseline-arm64-clabbe 2026-04-01 23:43:07,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0a7e4b5e3e0ab6a644ab 2026-04-01 23:43:07,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:43:07,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0a7e4b5e3e0ab6a644ab HTTP/1.1" 200 None 2026-04-01 23:43:07,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:43:07,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-04-01 23:43:07,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:43:07,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0a7e4b5e3e0ab6a644ab HTTP/1.1" 200 None 2026-04-01 23:43:07,546 - lava_callback - ERROR - Error processing callback for node 69cb0a7e4b5e3e0ab6a644ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40050 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:44:13,174 - lava_callback - INFO - Received callback for node 69cb0abc4b5e3e0ab6a644b1 INFO: 172.21.0.1:43722 - "POST /node/69cb0abc4b5e3e0ab6a644b1 HTTP/1.0" 202 Accepted 2026-04-01 23:44:13,180 - lava_callback - INFO - Starting async job submit for node 69cb0abc4b5e3e0ab6a644b1 2026-04-01 23:44:13,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:44:13,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0abc4b5e3e0ab6a644b1 HTTP/1.1" 200 None 2026-04-01 23:44:13,197 - lava_callback - DEBUG - Processing node 69cb0abc4b5e3e0ab6a644b1: baseline-arm-baylibre 2026-04-01 23:44:13,197 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0abc4b5e3e0ab6a644b1 2026-04-01 23:44:13,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:44:13,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0abc4b5e3e0ab6a644b1 HTTP/1.1" 200 None 2026-04-01 23:44:13,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:44:13,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 23:44:13,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:44:13,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0abc4b5e3e0ab6a644b1 HTTP/1.1" 200 None 2026-04-01 23:44:13,261 - lava_callback - ERROR - Error processing callback for node 69cb0abc4b5e3e0ab6a644b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42404 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:45:07,721 - lava_callback - INFO - Received callback for node 69cb0af64b5e3e0ab6a644c2 INFO: 172.21.0.1:42416 - "POST /node/69cb0af64b5e3e0ab6a644c2 HTTP/1.0" 202 Accepted 2026-04-01 23:45:07,726 - lava_callback - INFO - Starting async job submit for node 69cb0af64b5e3e0ab6a644c2 2026-04-01 23:45:07,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:45:07,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0af64b5e3e0ab6a644c2 HTTP/1.1" 200 None 2026-04-01 23:45:07,743 - lava_callback - DEBUG - Processing node 69cb0af64b5e3e0ab6a644c2: baseline-arm64-clabbe 2026-04-01 23:45:07,743 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0af64b5e3e0ab6a644c2 2026-04-01 23:45:07,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:45:07,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0af64b5e3e0ab6a644c2 HTTP/1.1" 200 None 2026-04-01 23:45:07,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:45:07,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-04-01 23:45:07,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:45:07,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0af64b5e3e0ab6a644c2 HTTP/1.1" 200 None 2026-04-01 23:45:07,816 - lava_callback - ERROR - Error processing callback for node 69cb0af64b5e3e0ab6a644c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56128 - "GET /node/69a1babd1e6ce1d0b4747a25%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56140 - "GET /node/693fc967575bc060ce149c2c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51228 - "GET /node/6938c134e767fbc36e03e0f9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48288 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:46:47,661 - lava_callback - INFO - Received callback for node 69cb0b554b5e3e0ab6a644d6 INFO: 172.21.0.1:48300 - "POST /node/69cb0b554b5e3e0ab6a644d6 HTTP/1.0" 202 Accepted 2026-04-01 23:46:47,666 - lava_callback - INFO - Starting async job submit for node 69cb0b554b5e3e0ab6a644d6 2026-04-01 23:46:47,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:46:47,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0b554b5e3e0ab6a644d6 HTTP/1.1" 200 None 2026-04-01 23:46:47,682 - lava_callback - DEBUG - Processing node 69cb0b554b5e3e0ab6a644d6: baseline-arm64-clabbe 2026-04-01 23:46:47,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0b554b5e3e0ab6a644d6 2026-04-01 23:46:47,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:46:47,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0b554b5e3e0ab6a644d6 HTTP/1.1" 200 None 2026-04-01 23:46:47,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:46:47,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-04-01 23:46:47,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:46:47,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0b554b5e3e0ab6a644d6 HTTP/1.1" 200 None 2026-04-01 23:46:47,754 - lava_callback - ERROR - Error processing callback for node 69cb0b554b5e3e0ab6a644d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40790 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:47:33,284 - lava_callback - INFO - Received callback for node 69cb0b934b5e3e0ab6a644dc INFO: 172.21.0.1:60914 - "POST /node/69cb0b934b5e3e0ab6a644dc HTTP/1.0" 202 Accepted 2026-04-01 23:47:33,289 - lava_callback - INFO - Starting async job submit for node 69cb0b934b5e3e0ab6a644dc 2026-04-01 23:47:33,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:47:33,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0b934b5e3e0ab6a644dc HTTP/1.1" 200 None 2026-04-01 23:47:33,306 - lava_callback - DEBUG - Processing node 69cb0b934b5e3e0ab6a644dc: baseline-arm-baylibre 2026-04-01 23:47:33,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0b934b5e3e0ab6a644dc 2026-04-01 23:47:33,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:47:33,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0b934b5e3e0ab6a644dc HTTP/1.1" 200 None 2026-04-01 23:47:33,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:47:33,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 23:47:33,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:47:33,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0b934b5e3e0ab6a644dc HTTP/1.1" 200 None 2026-04-01 23:47:33,368 - lava_callback - ERROR - Error processing callback for node 69cb0b934b5e3e0ab6a644dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46966 - "GET /node/6910e4fc699dbc4cda8e506b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:48:47,641 - lava_callback - INFO - Received callback for node 69cb0bce4b5e3e0ab6a644ea INFO: 172.21.0.1:36558 - "POST /node/69cb0bce4b5e3e0ab6a644ea HTTP/1.0" 202 Accepted 2026-04-01 23:48:47,646 - lava_callback - INFO - Starting async job submit for node 69cb0bce4b5e3e0ab6a644ea 2026-04-01 23:48:47,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:48:47,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0bce4b5e3e0ab6a644ea HTTP/1.1" 200 None 2026-04-01 23:48:47,663 - lava_callback - DEBUG - Processing node 69cb0bce4b5e3e0ab6a644ea: baseline-arm64-clabbe 2026-04-01 23:48:47,663 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0bce4b5e3e0ab6a644ea 2026-04-01 23:48:47,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:48:47,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0bce4b5e3e0ab6a644ea HTTP/1.1" 200 None 2026-04-01 23:48:47,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:48:47,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-04-01 23:48:47,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:48:47,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0bce4b5e3e0ab6a644ea HTTP/1.1" 200 None 2026-04-01 23:48:47,722 - lava_callback - ERROR - Error processing callback for node 69cb0bce4b5e3e0ab6a644ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET /node/6991155185f550420785e212%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37400 - "GET /node/698523633ff18e47df61523a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37404 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:49:53,512 - lava_callback - INFO - Received callback for node 69cb0c0f4b5e3e0ab6a644f2 INFO: 172.21.0.1:57240 - "POST /node/69cb0c0f4b5e3e0ab6a644f2 HTTP/1.0" 202 Accepted 2026-04-01 23:49:53,518 - lava_callback - INFO - Starting async job submit for node 69cb0c0f4b5e3e0ab6a644f2 2026-04-01 23:49:53,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:49:53,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0c0f4b5e3e0ab6a644f2 HTTP/1.1" 200 None 2026-04-01 23:49:53,536 - lava_callback - DEBUG - Processing node 69cb0c0f4b5e3e0ab6a644f2: baseline-arm-baylibre 2026-04-01 23:49:53,536 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0c0f4b5e3e0ab6a644f2 2026-04-01 23:49:53,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:49:53,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0c0f4b5e3e0ab6a644f2 HTTP/1.1" 200 None 2026-04-01 23:49:53,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:49:53,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 23:49:53,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:49:53,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0c0f4b5e3e0ab6a644f2 HTTP/1.1" 200 None 2026-04-01 23:49:53,600 - lava_callback - ERROR - Error processing callback for node 69cb0c0f4b5e3e0ab6a644f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34216 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:50:33,409 - lava_callback - INFO - Received callback for node 69cb0c344b5e3e0ab6a644fb INFO: 172.21.0.1:49814 - "POST /node/69cb0c344b5e3e0ab6a644fb HTTP/1.0" 202 Accepted 2026-04-01 23:50:33,414 - lava_callback - INFO - Starting async job submit for node 69cb0c344b5e3e0ab6a644fb 2026-04-01 23:50:33,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:50:33,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0c344b5e3e0ab6a644fb HTTP/1.1" 200 None 2026-04-01 23:50:33,430 - lava_callback - DEBUG - Processing node 69cb0c344b5e3e0ab6a644fb: baseline-arm-baylibre 2026-04-01 23:50:33,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0c344b5e3e0ab6a644fb 2026-04-01 23:50:33,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:50:33,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0c344b5e3e0ab6a644fb HTTP/1.1" 200 None 2026-04-01 23:50:33,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:50:33,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 23:50:33,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:50:33,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0c344b5e3e0ab6a644fb HTTP/1.1" 200 None 2026-04-01 23:50:33,674 - lava_callback - ERROR - Error processing callback for node 69cb0c344b5e3e0ab6a644fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46360 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:51:13,481 - lava_callback - INFO - Received callback for node 69cb0c5f4b5e3e0ab6a64505 INFO: 172.21.0.1:53008 - "POST /node/69cb0c5f4b5e3e0ab6a64505 HTTP/1.0" 202 Accepted 2026-04-01 23:51:13,487 - lava_callback - INFO - Starting async job submit for node 69cb0c5f4b5e3e0ab6a64505 2026-04-01 23:51:13,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:51:13,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0c5f4b5e3e0ab6a64505 HTTP/1.1" 200 None 2026-04-01 23:51:13,507 - lava_callback - DEBUG - Processing node 69cb0c5f4b5e3e0ab6a64505: baseline-arm-baylibre 2026-04-01 23:51:13,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0c5f4b5e3e0ab6a64505 2026-04-01 23:51:13,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:51:13,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0c5f4b5e3e0ab6a64505 HTTP/1.1" 200 None 2026-04-01 23:51:13,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:51:13,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 23:51:13,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:51:13,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0c5f4b5e3e0ab6a64505 HTTP/1.1" 200 None 2026-04-01 23:51:13,574 - lava_callback - ERROR - Error processing callback for node 69cb0c5f4b5e3e0ab6a64505: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET /node/69a32ff614c84a8c43f988bb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37220 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:51:53,472 - lava_callback - INFO - Received callback for node 69cb0c864b5e3e0ab6a6450d INFO: 172.21.0.1:59682 - "POST /node/69cb0c864b5e3e0ab6a6450d HTTP/1.0" 202 Accepted 2026-04-01 23:51:53,477 - lava_callback - INFO - Starting async job submit for node 69cb0c864b5e3e0ab6a6450d 2026-04-01 23:51:53,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:51:53,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0c864b5e3e0ab6a6450d HTTP/1.1" 200 None 2026-04-01 23:51:53,500 - lava_callback - DEBUG - Processing node 69cb0c864b5e3e0ab6a6450d: baseline-arm-baylibre 2026-04-01 23:51:53,500 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0c864b5e3e0ab6a6450d 2026-04-01 23:51:53,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:51:53,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0c864b5e3e0ab6a6450d HTTP/1.1" 200 None 2026-04-01 23:51:53,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:51:53,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 23:51:53,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:51:53,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0c864b5e3e0ab6a6450d HTTP/1.1" 200 None 2026-04-01 23:51:53,750 - lava_callback - ERROR - Error processing callback for node 69cb0c864b5e3e0ab6a6450d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32872 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:52:27,876 - lava_callback - INFO - Received callback for node 69cb0cb04b5e3e0ab6a64518 INFO: 172.21.0.1:32888 - "POST /node/69cb0cb04b5e3e0ab6a64518 HTTP/1.0" 202 Accepted 2026-04-01 23:52:27,881 - lava_callback - INFO - Starting async job submit for node 69cb0cb04b5e3e0ab6a64518 2026-04-01 23:52:27,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:52:27,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0cb04b5e3e0ab6a64518 HTTP/1.1" 200 None 2026-04-01 23:52:27,899 - lava_callback - DEBUG - Processing node 69cb0cb04b5e3e0ab6a64518: baseline-arm-clabbe 2026-04-01 23:52:27,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0cb04b5e3e0ab6a64518 2026-04-01 23:52:27,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:52:27,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0cb04b5e3e0ab6a64518 HTTP/1.1" 200 None 2026-04-01 23:52:27,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:52:27,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 23:52:27,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:52:27,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0cb04b5e3e0ab6a64518 HTTP/1.1" 200 None 2026-04-01 23:52:27,952 - lava_callback - ERROR - Error processing callback for node 69cb0cb04b5e3e0ab6a64518: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32898 - "GET /node/69392f786e7b0b7f22e518cb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:32914 - "GET /node/694ce569cb0ae69445cb3923%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40718 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:53:07,932 - lava_callback - INFO - Received callback for node 69cb0cd84b5e3e0ab6a64523 INFO: 172.21.0.1:40720 - "POST /node/69cb0cd84b5e3e0ab6a64523 HTTP/1.0" 202 Accepted 2026-04-01 23:53:07,939 - lava_callback - INFO - Starting async job submit for node 69cb0cd84b5e3e0ab6a64523 2026-04-01 23:53:07,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:53:07,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0cd84b5e3e0ab6a64523 HTTP/1.1" 200 None 2026-04-01 23:53:07,953 - lava_callback - DEBUG - Processing node 69cb0cd84b5e3e0ab6a64523: baseline-arm-clabbe 2026-04-01 23:53:07,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0cd84b5e3e0ab6a64523 2026-04-01 23:53:07,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:53:07,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0cd84b5e3e0ab6a64523 HTTP/1.1" 200 None 2026-04-01 23:53:07,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:53:07,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 23:53:07,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:53:08,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0cd84b5e3e0ab6a64523 HTTP/1.1" 200 None 2026-04-01 23:53:08,025 - lava_callback - ERROR - Error processing callback for node 69cb0cd84b5e3e0ab6a64523: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET /node/69936fd3cebe99dd8e068b08%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45642 - "GET /node/698694692de8e2dea3665f6c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38184 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:53:48,004 - lava_callback - INFO - Received callback for node 69cb0d014b5e3e0ab6a6452b INFO: 172.21.0.1:38190 - "POST /node/69cb0d014b5e3e0ab6a6452b HTTP/1.0" 202 Accepted 2026-04-01 23:53:48,010 - lava_callback - INFO - Starting async job submit for node 69cb0d014b5e3e0ab6a6452b 2026-04-01 23:53:48,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:53:48,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0d014b5e3e0ab6a6452b HTTP/1.1" 200 None 2026-04-01 23:53:48,025 - lava_callback - DEBUG - Processing node 69cb0d014b5e3e0ab6a6452b: baseline-arm-clabbe 2026-04-01 23:53:48,026 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0d014b5e3e0ab6a6452b 2026-04-01 23:53:48,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:53:48,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0d014b5e3e0ab6a6452b HTTP/1.1" 200 None 2026-04-01 23:53:48,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:53:48,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 23:53:48,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:53:48,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0d014b5e3e0ab6a6452b HTTP/1.1" 200 None 2026-04-01 23:53:48,097 - lava_callback - ERROR - Error processing callback for node 69cb0d014b5e3e0ab6a6452b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:54:27,967 - lava_callback - INFO - Received callback for node 69cb0d294b5e3e0ab6a64536 INFO: 172.21.0.1:50478 - "POST /node/69cb0d294b5e3e0ab6a64536 HTTP/1.0" 202 Accepted 2026-04-01 23:54:27,973 - lava_callback - INFO - Starting async job submit for node 69cb0d294b5e3e0ab6a64536 2026-04-01 23:54:27,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:54:27,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0d294b5e3e0ab6a64536 HTTP/1.1" 200 None 2026-04-01 23:54:27,989 - lava_callback - DEBUG - Processing node 69cb0d294b5e3e0ab6a64536: baseline-arm-clabbe 2026-04-01 23:54:27,989 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0d294b5e3e0ab6a64536 2026-04-01 23:54:27,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:54:28,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0d294b5e3e0ab6a64536 HTTP/1.1" 200 None 2026-04-01 23:54:28,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:54:28,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 23:54:28,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:54:28,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0d294b5e3e0ab6a64536 HTTP/1.1" 200 None 2026-04-01 23:54:28,046 - lava_callback - ERROR - Error processing callback for node 69cb0d294b5e3e0ab6a64536: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:55:08,190 - lava_callback - INFO - Received callback for node 69cb0d534b5e3e0ab6a64542 INFO: 172.21.0.1:42288 - "POST /node/69cb0d534b5e3e0ab6a64542 HTTP/1.0" 202 Accepted 2026-04-01 23:55:08,196 - lava_callback - INFO - Starting async job submit for node 69cb0d534b5e3e0ab6a64542 2026-04-01 23:55:08,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:55:08,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0d534b5e3e0ab6a64542 HTTP/1.1" 200 None 2026-04-01 23:55:08,211 - lava_callback - DEBUG - Processing node 69cb0d534b5e3e0ab6a64542: baseline-arm-clabbe 2026-04-01 23:55:08,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0d534b5e3e0ab6a64542 2026-04-01 23:55:08,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:55:08,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0d534b5e3e0ab6a64542 HTTP/1.1" 200 None 2026-04-01 23:55:08,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:55:08,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-01 23:55:08,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:55:08,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0d534b5e3e0ab6a64542 HTTP/1.1" 200 None 2026-04-01 23:55:08,272 - lava_callback - ERROR - Error processing callback for node 69cb0d534b5e3e0ab6a64542: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49042 - "GET /node/69876fbfe31b58f834f1a63c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49050 - "GET /node/698a7f29d9a1cfa777a22994%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45724 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:55:53,819 - lava_callback - INFO - Received callback for node 69cb0d844b5e3e0ab6a6454a INFO: 172.21.0.1:43368 - "POST /node/69cb0d844b5e3e0ab6a6454a HTTP/1.0" 202 Accepted 2026-04-01 23:55:53,825 - lava_callback - INFO - Starting async job submit for node 69cb0d844b5e3e0ab6a6454a 2026-04-01 23:55:53,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:55:53,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0d844b5e3e0ab6a6454a HTTP/1.1" 200 None 2026-04-01 23:55:53,851 - lava_callback - DEBUG - Processing node 69cb0d844b5e3e0ab6a6454a: baseline-arm64-baylibre 2026-04-01 23:55:53,851 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0d844b5e3e0ab6a6454a 2026-04-01 23:55:53,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:55:53,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0d844b5e3e0ab6a6454a HTTP/1.1" 200 None 2026-04-01 23:55:53,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:55:53,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 23:55:53,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:55:53,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0d844b5e3e0ab6a6454a HTTP/1.1" 200 None 2026-04-01 23:55:53,905 - lava_callback - ERROR - Error processing callback for node 69cb0d844b5e3e0ab6a6454a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37016 - "GET /node/688cae1a262957198e43e2ba%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37032 - "GET /node/68826b4087dcced189497f10%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44984 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:57:28,227 - lava_callback - INFO - Received callback for node 69cb0ddb4b5e3e0ab6a64555 INFO: 172.21.0.1:45000 - "POST /node/69cb0ddb4b5e3e0ab6a64555 HTTP/1.0" 202 Accepted 2026-04-01 23:57:28,233 - lava_callback - INFO - Starting async job submit for node 69cb0ddb4b5e3e0ab6a64555 2026-04-01 23:57:28,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:57:28,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0ddb4b5e3e0ab6a64555 HTTP/1.1" 200 None 2026-04-01 23:57:28,248 - lava_callback - DEBUG - Processing node 69cb0ddb4b5e3e0ab6a64555: baseline-arm64-clabbe 2026-04-01 23:57:28,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0ddb4b5e3e0ab6a64555 2026-04-01 23:57:28,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:57:28,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0ddb4b5e3e0ab6a64555 HTTP/1.1" 200 None 2026-04-01 23:57:28,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:57:28,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 23:57:28,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:57:28,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0ddb4b5e3e0ab6a64555 HTTP/1.1" 200 None 2026-04-01 23:57:28,309 - lava_callback - ERROR - Error processing callback for node 69cb0ddb4b5e3e0ab6a64555: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET /node/69af1640ce46d8ec186acc72%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46676 - "GET / HTTP/1.0" 200 OK 2026-04-01 23:58:48,233 - lava_callback - INFO - Received callback for node 69cb0e2d4b5e3e0ab6a64563 INFO: 172.21.0.1:46680 - "POST /node/69cb0e2d4b5e3e0ab6a64563 HTTP/1.0" 202 Accepted 2026-04-01 23:58:48,239 - lava_callback - INFO - Starting async job submit for node 69cb0e2d4b5e3e0ab6a64563 2026-04-01 23:58:48,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:58:48,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0e2d4b5e3e0ab6a64563 HTTP/1.1" 200 None 2026-04-01 23:58:48,254 - lava_callback - DEBUG - Processing node 69cb0e2d4b5e3e0ab6a64563: baseline-arm64-clabbe 2026-04-01 23:58:48,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0e2d4b5e3e0ab6a64563 2026-04-01 23:58:48,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:58:48,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0e2d4b5e3e0ab6a64563 HTTP/1.1" 200 None 2026-04-01 23:58:48,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:58:48,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-01 23:58:48,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 23:58:48,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0e2d4b5e3e0ab6a64563 HTTP/1.1" 200 None 2026-04-01 23:58:48,310 - lava_callback - ERROR - Error processing callback for node 69cb0e2d4b5e3e0ab6a64563: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50932 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:00:08,544 - lava_callback - INFO - Received callback for node 69cb0e804b5e3e0ab6a64570 INFO: 172.21.0.1:50938 - "POST /node/69cb0e804b5e3e0ab6a64570 HTTP/1.0" 202 Accepted 2026-04-02 00:00:08,552 - lava_callback - INFO - Starting async job submit for node 69cb0e804b5e3e0ab6a64570 2026-04-02 00:00:08,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:00:08,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0e804b5e3e0ab6a64570 HTTP/1.1" 200 None 2026-04-02 00:00:08,573 - lava_callback - DEBUG - Processing node 69cb0e804b5e3e0ab6a64570: baseline-arm64-clabbe 2026-04-02 00:00:08,573 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0e804b5e3e0ab6a64570 2026-04-02 00:00:08,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:00:08,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0e804b5e3e0ab6a64570 HTTP/1.1" 200 None 2026-04-02 00:00:08,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:00:08,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-02 00:00:08,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:00:08,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0e804b5e3e0ab6a64570 HTTP/1.1" 200 None 2026-04-02 00:00:08,654 - lava_callback - ERROR - Error processing callback for node 69cb0e804b5e3e0ab6a64570: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54246 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:01:48,401 - lava_callback - INFO - Received callback for node 69cb0ed94b5e3e0ab6a6457e INFO: 172.21.0.1:54258 - "POST /node/69cb0ed94b5e3e0ab6a6457e HTTP/1.0" 202 Accepted 2026-04-02 00:01:48,409 - lava_callback - INFO - Starting async job submit for node 69cb0ed94b5e3e0ab6a6457e 2026-04-02 00:01:48,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:01:48,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0ed94b5e3e0ab6a6457e HTTP/1.1" 200 None 2026-04-02 00:01:48,431 - lava_callback - DEBUG - Processing node 69cb0ed94b5e3e0ab6a6457e: baseline-arm64-clabbe 2026-04-02 00:01:48,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0ed94b5e3e0ab6a6457e 2026-04-02 00:01:48,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:01:48,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0ed94b5e3e0ab6a6457e HTTP/1.1" 200 None 2026-04-02 00:01:48,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:01:48,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-02 00:01:48,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:01:48,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0ed94b5e3e0ab6a6457e HTTP/1.1" 200 None 2026-04-02 00:01:48,518 - lava_callback - ERROR - Error processing callback for node 69cb0ed94b5e3e0ab6a6457e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53560 - "GET /node/698b14b63b3beb19e76191a3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58730 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:03:08,655 - lava_callback - INFO - Received callback for node 69cb0f2c4b5e3e0ab6a64589 INFO: 172.21.0.1:58738 - "POST /node/69cb0f2c4b5e3e0ab6a64589 HTTP/1.0" 202 Accepted 2026-04-02 00:03:08,660 - lava_callback - INFO - Starting async job submit for node 69cb0f2c4b5e3e0ab6a64589 2026-04-02 00:03:08,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:03:08,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0f2c4b5e3e0ab6a64589 HTTP/1.1" 200 None 2026-04-02 00:03:08,676 - lava_callback - DEBUG - Processing node 69cb0f2c4b5e3e0ab6a64589: baseline-arm64-clabbe 2026-04-02 00:03:08,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0f2c4b5e3e0ab6a64589 2026-04-02 00:03:08,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:03:08,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0f2c4b5e3e0ab6a64589 HTTP/1.1" 200 None 2026-04-02 00:03:08,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:03:08,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-02 00:03:08,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:03:08,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0f2c4b5e3e0ab6a64589 HTTP/1.1" 200 None 2026-04-02 00:03:08,735 - lava_callback - ERROR - Error processing callback for node 69cb0f2c4b5e3e0ab6a64589: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48538 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:04:28,489 - lava_callback - INFO - Received callback for node 69cb0f7f4b5e3e0ab6a64592 INFO: 172.21.0.1:48546 - "POST /node/69cb0f7f4b5e3e0ab6a64592 HTTP/1.0" 202 Accepted 2026-04-02 00:04:28,495 - lava_callback - INFO - Starting async job submit for node 69cb0f7f4b5e3e0ab6a64592 2026-04-02 00:04:28,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:04:28,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0f7f4b5e3e0ab6a64592 HTTP/1.1" 200 None 2026-04-02 00:04:28,510 - lava_callback - DEBUG - Processing node 69cb0f7f4b5e3e0ab6a64592: baseline-arm64-clabbe 2026-04-02 00:04:28,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0f7f4b5e3e0ab6a64592 2026-04-02 00:04:28,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:04:28,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0f7f4b5e3e0ab6a64592 HTTP/1.1" 200 None 2026-04-02 00:04:28,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:04:28,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-04-02 00:04:28,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:04:28,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0f7f4b5e3e0ab6a64592 HTTP/1.1" 200 None 2026-04-02 00:04:28,574 - lava_callback - ERROR - Error processing callback for node 69cb0f7f4b5e3e0ab6a64592: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58410 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:05:34,319 - lava_callback - INFO - Received callback for node 69cb0fbe4b5e3e0ab6a6459b INFO: 172.21.0.1:42274 - "POST /node/69cb0fbe4b5e3e0ab6a6459b HTTP/1.0" 202 Accepted 2026-04-02 00:05:34,325 - lava_callback - INFO - Starting async job submit for node 69cb0fbe4b5e3e0ab6a6459b 2026-04-02 00:05:34,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:05:34,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0fbe4b5e3e0ab6a6459b HTTP/1.1" 200 None 2026-04-02 00:05:34,342 - lava_callback - DEBUG - Processing node 69cb0fbe4b5e3e0ab6a6459b: baseline-arm-baylibre 2026-04-02 00:05:34,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0fbe4b5e3e0ab6a6459b 2026-04-02 00:05:34,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:05:34,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0fbe4b5e3e0ab6a6459b HTTP/1.1" 200 None 2026-04-02 00:05:34,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:05:34,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-02 00:05:34,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:05:34,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0fbe4b5e3e0ab6a6459b HTTP/1.1" 200 None 2026-04-02 00:05:34,401 - lava_callback - ERROR - Error processing callback for node 69cb0fbe4b5e3e0ab6a6459b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:06:14,313 - lava_callback - INFO - Received callback for node 69cb0fe64b5e3e0ab6a645a6 INFO: 172.21.0.1:38274 - "POST /node/69cb0fe64b5e3e0ab6a645a6 HTTP/1.0" 202 Accepted 2026-04-02 00:06:14,319 - lava_callback - INFO - Starting async job submit for node 69cb0fe64b5e3e0ab6a645a6 2026-04-02 00:06:14,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:06:14,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0fe64b5e3e0ab6a645a6 HTTP/1.1" 200 None 2026-04-02 00:06:14,335 - lava_callback - DEBUG - Processing node 69cb0fe64b5e3e0ab6a645a6: baseline-arm-baylibre 2026-04-02 00:06:14,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb0fe64b5e3e0ab6a645a6 2026-04-02 00:06:14,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:06:14,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb0fe64b5e3e0ab6a645a6 HTTP/1.1" 200 None 2026-04-02 00:06:14,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:06:14,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-02 00:06:14,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:06:14,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb0fe64b5e3e0ab6a645a6 HTTP/1.1" 200 None 2026-04-02 00:06:14,409 - lava_callback - ERROR - Error processing callback for node 69cb0fe64b5e3e0ab6a645a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38794 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:06:54,389 - lava_callback - INFO - Received callback for node 69cb100f4b5e3e0ab6a645b1 INFO: 172.21.0.1:37924 - "POST /node/69cb100f4b5e3e0ab6a645b1 HTTP/1.0" 202 Accepted 2026-04-02 00:06:54,395 - lava_callback - INFO - Starting async job submit for node 69cb100f4b5e3e0ab6a645b1 2026-04-02 00:06:54,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:06:54,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb100f4b5e3e0ab6a645b1 HTTP/1.1" 200 None 2026-04-02 00:06:54,410 - lava_callback - DEBUG - Processing node 69cb100f4b5e3e0ab6a645b1: baseline-arm-baylibre 2026-04-02 00:06:54,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb100f4b5e3e0ab6a645b1 2026-04-02 00:06:54,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:06:54,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb100f4b5e3e0ab6a645b1 HTTP/1.1" 200 None 2026-04-02 00:06:54,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:06:54,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-02 00:06:54,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:06:54,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb100f4b5e3e0ab6a645b1 HTTP/1.1" 200 None 2026-04-02 00:06:54,497 - lava_callback - ERROR - Error processing callback for node 69cb100f4b5e3e0ab6a645b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52976 - "GET /node/6992680598a8bdb31c3920e7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52984 - "GET /node/693b318ced677bab79b2cdc3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40932 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:07:34,392 - lava_callback - INFO - Received callback for node 69cb10374b5e3e0ab6a645bd INFO: 172.21.0.1:51208 - "POST /node/69cb10374b5e3e0ab6a645bd HTTP/1.0" 202 Accepted 2026-04-02 00:07:34,398 - lava_callback - INFO - Starting async job submit for node 69cb10374b5e3e0ab6a645bd 2026-04-02 00:07:34,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:07:34,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb10374b5e3e0ab6a645bd HTTP/1.1" 200 None 2026-04-02 00:07:34,432 - lava_callback - DEBUG - Processing node 69cb10374b5e3e0ab6a645bd: baseline-arm-baylibre 2026-04-02 00:07:34,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb10374b5e3e0ab6a645bd 2026-04-02 00:07:34,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:07:34,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb10374b5e3e0ab6a645bd HTTP/1.1" 200 None 2026-04-02 00:07:34,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:07:34,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-02 00:07:34,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:07:34,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb10374b5e3e0ab6a645bd HTTP/1.1" 200 None 2026-04-02 00:07:34,495 - lava_callback - ERROR - Error processing callback for node 69cb10374b5e3e0ab6a645bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:08:14,460 - lava_callback - INFO - Received callback for node 69cb10604b5e3e0ab6a645c7 INFO: 172.21.0.1:48444 - "POST /node/69cb10604b5e3e0ab6a645c7 HTTP/1.0" 202 Accepted 2026-04-02 00:08:14,466 - lava_callback - INFO - Starting async job submit for node 69cb10604b5e3e0ab6a645c7 2026-04-02 00:08:14,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:08:14,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb10604b5e3e0ab6a645c7 HTTP/1.1" 200 None 2026-04-02 00:08:14,481 - lava_callback - DEBUG - Processing node 69cb10604b5e3e0ab6a645c7: baseline-arm-baylibre 2026-04-02 00:08:14,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb10604b5e3e0ab6a645c7 2026-04-02 00:08:14,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:08:14,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb10604b5e3e0ab6a645c7 HTTP/1.1" 200 None 2026-04-02 00:08:14,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:08:14,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-02 00:08:14,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:08:14,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb10604b5e3e0ab6a645c7 HTTP/1.1" 200 None 2026-04-02 00:08:14,542 - lava_callback - ERROR - Error processing callback for node 69cb10604b5e3e0ab6a645c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49382 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:08:54,470 - lava_callback - INFO - Received callback for node 69cb10834b5e3e0ab6a645d2 INFO: 172.21.0.1:35368 - "POST /node/69cb10834b5e3e0ab6a645d2 HTTP/1.0" 202 Accepted 2026-04-02 00:08:54,476 - lava_callback - INFO - Starting async job submit for node 69cb10834b5e3e0ab6a645d2 2026-04-02 00:08:54,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:08:54,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb10834b5e3e0ab6a645d2 HTTP/1.1" 200 None 2026-04-02 00:08:54,492 - lava_callback - DEBUG - Processing node 69cb10834b5e3e0ab6a645d2: baseline-arm-baylibre 2026-04-02 00:08:54,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb10834b5e3e0ab6a645d2 2026-04-02 00:08:54,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:08:54,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb10834b5e3e0ab6a645d2 HTTP/1.1" 200 None 2026-04-02 00:08:54,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:08:54,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-02 00:08:54,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:08:54,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb10834b5e3e0ab6a645d2 HTTP/1.1" 200 None 2026-04-02 00:08:54,580 - lava_callback - ERROR - Error processing callback for node 69cb10834b5e3e0ab6a645d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:09:34,526 - lava_callback - INFO - Received callback for node 69cb10af4b5e3e0ab6a645db INFO: 172.21.0.1:38748 - "POST /node/69cb10af4b5e3e0ab6a645db HTTP/1.0" 202 Accepted 2026-04-02 00:09:34,531 - lava_callback - INFO - Starting async job submit for node 69cb10af4b5e3e0ab6a645db 2026-04-02 00:09:34,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:09:34,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb10af4b5e3e0ab6a645db HTTP/1.1" 200 None 2026-04-02 00:09:34,547 - lava_callback - DEBUG - Processing node 69cb10af4b5e3e0ab6a645db: baseline-arm-baylibre 2026-04-02 00:09:34,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb10af4b5e3e0ab6a645db 2026-04-02 00:09:34,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:09:34,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb10af4b5e3e0ab6a645db HTTP/1.1" 200 None 2026-04-02 00:09:34,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:09:34,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-02 00:09:34,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:09:34,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb10af4b5e3e0ab6a645db HTTP/1.1" 200 None 2026-04-02 00:09:34,613 - lava_callback - ERROR - Error processing callback for node 69cb10af4b5e3e0ab6a645db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:10:14,533 - lava_callback - INFO - Received callback for node 69cb10d74b5e3e0ab6a645e6 INFO: 172.21.0.1:33772 - "POST /node/69cb10d74b5e3e0ab6a645e6 HTTP/1.0" 202 Accepted 2026-04-02 00:10:14,539 - lava_callback - INFO - Starting async job submit for node 69cb10d74b5e3e0ab6a645e6 2026-04-02 00:10:14,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:10:14,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb10d74b5e3e0ab6a645e6 HTTP/1.1" 200 None 2026-04-02 00:10:14,554 - lava_callback - DEBUG - Processing node 69cb10d74b5e3e0ab6a645e6: baseline-arm-baylibre 2026-04-02 00:10:14,554 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb10d74b5e3e0ab6a645e6 2026-04-02 00:10:14,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:10:14,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb10d74b5e3e0ab6a645e6 HTTP/1.1" 200 None 2026-04-02 00:10:14,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:10:14,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-02 00:10:14,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:10:14,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb10d74b5e3e0ab6a645e6 HTTP/1.1" 200 None 2026-04-02 00:10:14,604 - lava_callback - ERROR - Error processing callback for node 69cb10d74b5e3e0ab6a645e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57444 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:10:48,847 - lava_callback - INFO - Received callback for node 69cb11034b5e3e0ab6a645f0 INFO: 172.21.0.1:57450 - "POST /node/69cb11034b5e3e0ab6a645f0 HTTP/1.0" 202 Accepted 2026-04-02 00:10:48,852 - lava_callback - INFO - Starting async job submit for node 69cb11034b5e3e0ab6a645f0 2026-04-02 00:10:48,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:10:48,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb11034b5e3e0ab6a645f0 HTTP/1.1" 200 None 2026-04-02 00:10:48,872 - lava_callback - DEBUG - Processing node 69cb11034b5e3e0ab6a645f0: baseline-arm-clabbe 2026-04-02 00:10:48,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb11034b5e3e0ab6a645f0 2026-04-02 00:10:48,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:10:48,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb11034b5e3e0ab6a645f0 HTTP/1.1" 200 None 2026-04-02 00:10:48,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:10:48,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-02 00:10:48,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:10:48,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb11034b5e3e0ab6a645f0 HTTP/1.1" 200 None 2026-04-02 00:10:48,974 - lava_callback - ERROR - Error processing callback for node 69cb11034b5e3e0ab6a645f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39840 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:11:34,675 - lava_callback - INFO - Received callback for node 69cb11284b5e3e0ab6a645fa INFO: 172.21.0.1:48006 - "POST /node/69cb11284b5e3e0ab6a645fa HTTP/1.0" 202 Accepted 2026-04-02 00:11:34,682 - lava_callback - INFO - Starting async job submit for node 69cb11284b5e3e0ab6a645fa 2026-04-02 00:11:34,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:11:34,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb11284b5e3e0ab6a645fa HTTP/1.1" 200 None 2026-04-02 00:11:34,697 - lava_callback - DEBUG - Processing node 69cb11284b5e3e0ab6a645fa: baseline-arm-baylibre 2026-04-02 00:11:34,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb11284b5e3e0ab6a645fa 2026-04-02 00:11:34,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:11:34,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb11284b5e3e0ab6a645fa HTTP/1.1" 200 None 2026-04-02 00:11:34,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:11:34,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-02 00:11:34,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:11:34,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb11284b5e3e0ab6a645fa HTTP/1.1" 200 None 2026-04-02 00:11:34,775 - lava_callback - ERROR - Error processing callback for node 69cb11284b5e3e0ab6a645fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41938 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:12:08,915 - lava_callback - INFO - Received callback for node 69cb11544b5e3e0ab6a64604 INFO: 172.21.0.1:41942 - "POST /node/69cb11544b5e3e0ab6a64604 HTTP/1.0" 202 Accepted 2026-04-02 00:12:08,921 - lava_callback - INFO - Starting async job submit for node 69cb11544b5e3e0ab6a64604 2026-04-02 00:12:08,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:12:08,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb11544b5e3e0ab6a64604 HTTP/1.1" 200 None 2026-04-02 00:12:08,938 - lava_callback - DEBUG - Processing node 69cb11544b5e3e0ab6a64604: baseline-arm-clabbe 2026-04-02 00:12:08,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb11544b5e3e0ab6a64604 2026-04-02 00:12:08,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:12:08,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb11544b5e3e0ab6a64604 HTTP/1.1" 200 None 2026-04-02 00:12:08,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:12:08,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-02 00:12:08,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:12:08,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb11544b5e3e0ab6a64604 HTTP/1.1" 200 None 2026-04-02 00:12:08,992 - lava_callback - ERROR - Error processing callback for node 69cb11544b5e3e0ab6a64604: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49816 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:12:48,937 - lava_callback - INFO - Received callback for node 69cb117c4b5e3e0ab6a6460f INFO: 172.21.0.1:49828 - "POST /node/69cb117c4b5e3e0ab6a6460f HTTP/1.0" 202 Accepted 2026-04-02 00:12:48,942 - lava_callback - INFO - Starting async job submit for node 69cb117c4b5e3e0ab6a6460f 2026-04-02 00:12:48,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:12:48,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb117c4b5e3e0ab6a6460f HTTP/1.1" 200 None 2026-04-02 00:12:48,959 - lava_callback - DEBUG - Processing node 69cb117c4b5e3e0ab6a6460f: baseline-arm-clabbe 2026-04-02 00:12:48,959 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb117c4b5e3e0ab6a6460f 2026-04-02 00:12:48,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:12:48,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb117c4b5e3e0ab6a6460f HTTP/1.1" 200 None 2026-04-02 00:12:48,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:12:48,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-02 00:12:48,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:12:49,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb117c4b5e3e0ab6a6460f HTTP/1.1" 200 None 2026-04-02 00:12:49,022 - lava_callback - ERROR - Error processing callback for node 69cb117c4b5e3e0ab6a6460f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36810 - "GET / HTTP/1.0" 200 OK 2026-04-02 00:13:34,782 - lava_callback - INFO - Received callback for node 69cb11a34b5e3e0ab6a6461a INFO: 172.21.0.1:33162 - "POST /node/69cb11a34b5e3e0ab6a6461a HTTP/1.0" 202 Accepted 2026-04-02 00:13:34,788 - lava_callback - INFO - Starting async job submit for node 69cb11a34b5e3e0ab6a6461a 2026-04-02 00:13:34,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:13:34,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb11a34b5e3e0ab6a6461a HTTP/1.1" 200 None 2026-04-02 00:13:34,821 - lava_callback - DEBUG - Processing node 69cb11a34b5e3e0ab6a6461a: baseline-arm-baylibre 2026-04-02 00:13:34,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb11a34b5e3e0ab6a6461a 2026-04-02 00:13:34,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:13:34,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb11a34b5e3e0ab6a6461a HTTP/1.1" 200 None 2026-04-02 00:13:34,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:13:34,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-04-02 00:13:34,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 00:13:34,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb11a34b5e3e0ab6a6461a HTTP/1.1" 200 None 2026-04-02 00:13:34,890 - lava_callback - ERROR - Error processing callback for node 69cb11a34b5e3e0ab6a6461a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33172 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]