INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:57206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:30:27,073 - lava_callback - INFO - Received callback for node 69a85e1f440c1da21c2373f5 2026-03-06 16:30:27,079 - lava_callback - INFO - Starting async job submit for node 69a85e1f440c1da21c2373f5 INFO: 172.21.0.1:40508 - "POST /node/69a85e1f440c1da21c2373f5 HTTP/1.0" 202 Accepted 2026-03-06 16:30:27,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:30:27,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85e1f440c1da21c2373f5 HTTP/1.1" 200 None 2026-03-06 16:30:27,110 - lava_callback - DEBUG - Processing node 69a85e1f440c1da21c2373f5: baseline-arm64-baylibre 2026-03-06 16:30:27,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a85e1f440c1da21c2373f5 2026-03-06 16:30:27,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:30:27,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85e1f440c1da21c2373f5 HTTP/1.1" 200 None 2026-03-06 16:30:27,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:30:27,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a2a4938020dd22eabedb55 HTTP/1.1" 200 None 2026-03-06 16:30:27,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:30:27,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a85e1f440c1da21c2373f5 HTTP/1.1" 200 None 2026-03-06 16:30:27,177 - lava_callback - ERROR - Error processing callback for node 69a85e1f440c1da21c2373f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53828 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:39:47,567 - lava_callback - INFO - Received callback for node 69a8604a440c1da21c23797b INFO: 172.21.0.1:53834 - "POST /node/69a8604a440c1da21c23797b HTTP/1.0" 202 Accepted 2026-03-06 16:39:47,573 - lava_callback - INFO - Starting async job submit for node 69a8604a440c1da21c23797b 2026-03-06 16:39:47,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:39:47,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8604a440c1da21c23797b HTTP/1.1" 200 None 2026-03-06 16:39:47,589 - lava_callback - DEBUG - Processing node 69a8604a440c1da21c23797b: baseline-arm64-baylibre 2026-03-06 16:39:47,589 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8604a440c1da21c23797b 2026-03-06 16:39:47,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:39:47,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8604a440c1da21c23797b HTTP/1.1" 200 None 2026-03-06 16:39:47,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:39:47,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a744905a0c0e10c4819cd5 HTTP/1.1" 200 None 2026-03-06 16:39:47,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:39:47,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8604a440c1da21c23797b HTTP/1.1" 200 None 2026-03-06 16:39:47,678 - lava_callback - ERROR - Error processing callback for node 69a8604a440c1da21c23797b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43832 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:47:40,195 - lava_callback - INFO - Received callback for node 69ab04ba27cb11dcdfc75a56 INFO: 172.21.0.1:57492 - "POST /node/69ab04ba27cb11dcdfc75a56 HTTP/1.0" 202 Accepted 2026-03-06 16:47:40,201 - lava_callback - INFO - Starting async job submit for node 69ab04ba27cb11dcdfc75a56 2026-03-06 16:47:40,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:47:40,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab04ba27cb11dcdfc75a56 HTTP/1.1" 200 None 2026-03-06 16:47:40,265 - lava_callback - DEBUG - Processing node 69ab04ba27cb11dcdfc75a56: baseline-arm 2026-03-06 16:47:40,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:47:40,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:47:40,658 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab04ba27cb11dcdfc75a56/log.txt.gz 2026-03-06 16:47:40,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:47:40,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:47:40,999 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab04ba27cb11dcdfc75a56/lava-logs.yaml 2026-03-06 16:47:41,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:47:41,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:47:41,167 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab04ba27cb11dcdfc75a56/lava_callback.json.gz 2026-03-06 16:47:41,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:47:41,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab04ba27cb11dcdfc75a56 HTTP/1.1" 200 None 2026-03-06 16:47:41,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:47:41,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe9427cb11dcdfc758e6 HTTP/1.1" 200 None 2026-03-06 16:47:41,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:47:41,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab04ba27cb11dcdfc75a56 HTTP/1.1" 200 None 2026-03-06 16:47:41,255 - lava_callback - INFO - Completed processing callback for node 69ab04ba27cb11dcdfc75a56 INFO: 172.21.0.1:57498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33752 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:47:57,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:47:57,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42564 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:56:28,513 - lava_callback - INFO - Received callback for node 69a8642e440c1da21c237c0f INFO: 172.21.0.1:42570 - "POST /node/69a8642e440c1da21c237c0f HTTP/1.0" 202 Accepted 2026-03-06 16:56:28,519 - lava_callback - INFO - Starting async job submit for node 69a8642e440c1da21c237c0f 2026-03-06 16:56:28,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:56:28,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8642e440c1da21c237c0f HTTP/1.1" 200 None 2026-03-06 16:56:28,536 - lava_callback - DEBUG - Processing node 69a8642e440c1da21c237c0f: baseline-arm-baylibre 2026-03-06 16:56:28,536 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8642e440c1da21c237c0f 2026-03-06 16:56:28,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:56:28,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8642e440c1da21c237c0f HTTP/1.1" 200 None 2026-03-06 16:56:28,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:56:28,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-06 16:56:28,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:56:28,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8642e440c1da21c237c0f HTTP/1.1" 200 None 2026-03-06 16:56:28,588 - lava_callback - ERROR - Error processing callback for node 69a8642e440c1da21c237c0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52422 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:56:47,864 - lava_callback - INFO - Received callback for node 69ab073927cb11dcdfc75add INFO: 172.21.0.1:52426 - "POST /node/69ab073927cb11dcdfc75add HTTP/1.0" 202 Accepted 2026-03-06 16:56:47,870 - lava_callback - INFO - Starting async job submit for node 69ab073927cb11dcdfc75add 2026-03-06 16:56:47,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:56:47,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab073927cb11dcdfc75add HTTP/1.1" 200 None 2026-03-06 16:56:47,888 - lava_callback - DEBUG - Processing node 69ab073927cb11dcdfc75add: baseline-arm 2026-03-06 16:56:47,893 - lava_callback - WARNING - Failed to upload log 2026-03-06 16:56:47,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:56:48,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:56:48,024 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073927cb11dcdfc75add/lava-logs.yaml 2026-03-06 16:56:48,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:56:48,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:56:48,132 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073927cb11dcdfc75add/lava_callback.json.gz 2026-03-06 16:56:48,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:56:48,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab073927cb11dcdfc75add HTTP/1.1" 200 None 2026-03-06 16:56:48,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:56:48,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 16:56:48,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:56:48,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab073927cb11dcdfc75add HTTP/1.1" 200 None 2026-03-06 16:56:48,208 - lava_callback - INFO - Completed processing callback for node 69ab073927cb11dcdfc75add INFO: 172.21.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53350 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:56:57,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:56:57,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:57:08,432 - lava_callback - INFO - Received callback for node 69a8645b440c1da21c237cc0 INFO: 172.21.0.1:56564 - "POST /node/69a8645b440c1da21c237cc0 HTTP/1.0" 202 Accepted 2026-03-06 16:57:08,438 - lava_callback - INFO - Starting async job submit for node 69a8645b440c1da21c237cc0 2026-03-06 16:57:08,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:08,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8645b440c1da21c237cc0 HTTP/1.1" 200 None 2026-03-06 16:57:08,454 - lava_callback - DEBUG - Processing node 69a8645b440c1da21c237cc0: baseline-arm64-baylibre 2026-03-06 16:57:08,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8645b440c1da21c237cc0 2026-03-06 16:57:08,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:08,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8645b440c1da21c237cc0 HTTP/1.1" 200 None 2026-03-06 16:57:08,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:08,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85aff440c1da21c2371fe HTTP/1.1" 200 None 2026-03-06 16:57:08,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:08,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8645b440c1da21c237cc0 HTTP/1.1" 200 None 2026-03-06 16:57:08,519 - lava_callback - ERROR - Error processing callback for node 69a8645b440c1da21c237cc0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-06 16:57:13,145 - lava_callback - INFO - Received callback for node 69ab073a27cb11dcdfc75ae0 INFO: 172.21.0.1:47754 - "POST /node/69ab073a27cb11dcdfc75ae0 HTTP/1.0" 202 Accepted 2026-03-06 16:57:13,193 - lava_callback - INFO - Starting async job submit for node 69ab073a27cb11dcdfc75ae0 2026-03-06 16:57:13,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:13,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab073a27cb11dcdfc75ae0 HTTP/1.1" 200 None 2026-03-06 16:57:13,228 - lava_callback - DEBUG - Processing node 69ab073a27cb11dcdfc75ae0: baseline-arm 2026-03-06 16:57:13,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:57:13,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:57:13,506 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073a27cb11dcdfc75ae0/log.txt.gz 2026-03-06 16:57:13,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:57:13,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:57:13,736 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073a27cb11dcdfc75ae0/lava-logs.yaml 2026-03-06 16:57:13,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:57:13,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:57:13,853 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073a27cb11dcdfc75ae0/lava_callback.json.gz 2026-03-06 16:57:13,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:13,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab073a27cb11dcdfc75ae0 HTTP/1.1" 200 None 2026-03-06 16:57:13,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:13,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 16:57:13,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:13,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab073a27cb11dcdfc75ae0 HTTP/1.1" 200 None 2026-03-06 16:57:13,963 - lava_callback - INFO - Completed processing callback for node 69ab073a27cb11dcdfc75ae0 INFO: 172.21.0.1:47756 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-06 16:57:15,764 - lava_callback - INFO - Received callback for node 69a86464440c1da21c237cd4 INFO: 172.21.0.1:47772 - "POST /node/69a86464440c1da21c237cd4 HTTP/1.0" 202 Accepted 2026-03-06 16:57:15,770 - lava_callback - INFO - Starting async job submit for node 69a86464440c1da21c237cd4 2026-03-06 16:57:15,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:15,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86464440c1da21c237cd4 HTTP/1.1" 200 None 2026-03-06 16:57:15,785 - lava_callback - DEBUG - Processing node 69a86464440c1da21c237cd4: baseline-arm64-broonie 2026-03-06 16:57:15,785 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a86464440c1da21c237cd4 2026-03-06 16:57:15,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:15,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86464440c1da21c237cd4 HTTP/1.1" 200 None 2026-03-06 16:57:15,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:15,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85aff440c1da21c2371fe HTTP/1.1" 200 None 2026-03-06 16:57:15,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:15,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a86464440c1da21c237cd4 HTTP/1.1" 200 None 2026-03-06 16:57:15,843 - lava_callback - ERROR - Error processing callback for node 69a86464440c1da21c237cd4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:57:19,572 - lava_callback - INFO - Received callback for node 69ab073d27cb11dcdfc75aeb INFO: 172.21.0.1:47804 - "POST /node/69ab073d27cb11dcdfc75aeb HTTP/1.0" 202 Accepted 2026-03-06 16:57:19,622 - lava_callback - INFO - Starting async job submit for node 69ab073d27cb11dcdfc75aeb 2026-03-06 16:57:19,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:19,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab073d27cb11dcdfc75aeb HTTP/1.1" 200 None 2026-03-06 16:57:19,657 - lava_callback - DEBUG - Processing node 69ab073d27cb11dcdfc75aeb: baseline-arm 2026-03-06 16:57:19,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:57:20,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:57:20,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073d27cb11dcdfc75aeb/log.txt.gz 2026-03-06 16:57:20,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:57:20,927 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:57:20,929 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073d27cb11dcdfc75aeb/lava-logs.yaml 2026-03-06 16:57:20,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:57:21,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:57:21,050 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073d27cb11dcdfc75aeb/lava_callback.json.gz 2026-03-06 16:57:21,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:21,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab073d27cb11dcdfc75aeb HTTP/1.1" 200 None 2026-03-06 16:57:21,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:21,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 16:57:21,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:21,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab073d27cb11dcdfc75aeb HTTP/1.1" 200 None 2026-03-06 16:57:21,174 - lava_callback - INFO - Completed processing callback for node 69ab073d27cb11dcdfc75aeb INFO: 172.21.0.1:41374 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:57:27,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:27,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-06 16:57:28,418 - lava_callback - INFO - Received callback for node 69a86463440c1da21c237cd1 INFO: 172.21.0.1:41382 - "POST /node/69a86463440c1da21c237cd1 HTTP/1.0" 202 Accepted 2026-03-06 16:57:28,427 - lava_callback - INFO - Starting async job submit for node 69a86463440c1da21c237cd1 2026-03-06 16:57:28,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:28,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86463440c1da21c237cd1 HTTP/1.1" 200 None 2026-03-06 16:57:28,443 - lava_callback - DEBUG - Processing node 69a86463440c1da21c237cd1: baseline-arm-baylibre 2026-03-06 16:57:28,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a86463440c1da21c237cd1 2026-03-06 16:57:28,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:28,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86463440c1da21c237cd1 HTTP/1.1" 200 None 2026-03-06 16:57:28,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:28,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-06 16:57:28,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:28,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a86463440c1da21c237cd1 HTTP/1.1" 200 None 2026-03-06 16:57:28,506 - lava_callback - ERROR - Error processing callback for node 69a86463440c1da21c237cd1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56902 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:57:51,438 - lava_callback - INFO - Received callback for node 69ab073c27cb11dcdfc75ae6 INFO: 172.21.0.1:56916 - "POST /node/69ab073c27cb11dcdfc75ae6 HTTP/1.0" 202 Accepted 2026-03-06 16:57:51,444 - lava_callback - INFO - Starting async job submit for node 69ab073c27cb11dcdfc75ae6 2026-03-06 16:57:51,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:51,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab073c27cb11dcdfc75ae6 HTTP/1.1" 200 None 2026-03-06 16:57:51,479 - lava_callback - DEBUG - Processing node 69ab073c27cb11dcdfc75ae6: baseline-arm 2026-03-06 16:57:51,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:57:51,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:57:51,866 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073c27cb11dcdfc75ae6/log.txt.gz 2026-03-06 16:57:51,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:57:52,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:57:52,221 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073c27cb11dcdfc75ae6/lava-logs.yaml 2026-03-06 16:57:52,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:57:52,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:57:52,360 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073c27cb11dcdfc75ae6/lava_callback.json.gz 2026-03-06 16:57:52,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:52,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab073c27cb11dcdfc75ae6 HTTP/1.1" 200 None 2026-03-06 16:57:52,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:52,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 16:57:52,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:52,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab073c27cb11dcdfc75ae6 HTTP/1.1" 200 None 2026-03-06 16:57:52,455 - lava_callback - INFO - Completed processing callback for node 69ab073c27cb11dcdfc75ae6 2026-03-06 16:57:55,567 - lava_callback - INFO - Received callback for node 69ab073827cb11dcdfc75ada INFO: 172.21.0.1:56930 - "POST /node/69ab073827cb11dcdfc75ada HTTP/1.0" 202 Accepted 2026-03-06 16:57:55,573 - lava_callback - INFO - Starting async job submit for node 69ab073827cb11dcdfc75ada 2026-03-06 16:57:55,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:55,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab073827cb11dcdfc75ada HTTP/1.1" 200 None 2026-03-06 16:57:55,610 - lava_callback - DEBUG - Processing node 69ab073827cb11dcdfc75ada: baseline-arm 2026-03-06 16:57:55,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:57:55,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:57:55,925 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073827cb11dcdfc75ada/log.txt.gz 2026-03-06 16:57:56,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:57:56,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:57:56,228 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073827cb11dcdfc75ada/lava-logs.yaml 2026-03-06 16:57:56,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:57:56,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:57:56,429 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073827cb11dcdfc75ada/lava_callback.json.gz 2026-03-06 16:57:56,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:56,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab073827cb11dcdfc75ada HTTP/1.1" 200 None 2026-03-06 16:57:56,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:56946 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:57:56,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 16:57:56,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:56,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab073827cb11dcdfc75ada HTTP/1.1" 200 None 2026-03-06 16:57:56,576 - lava_callback - INFO - Completed processing callback for node 69ab073827cb11dcdfc75ada 2026-03-06 16:57:57,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:57,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-06 16:57:58,472 - lava_callback - INFO - Received callback for node 69ab075227cb11dcdfc75b30 INFO: 172.21.0.1:56962 - "POST /node/69ab075227cb11dcdfc75b30 HTTP/1.0" 202 Accepted 2026-03-06 16:57:58,478 - lava_callback - INFO - Starting async job submit for node 69ab075227cb11dcdfc75b30 2026-03-06 16:57:58,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:58,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab075227cb11dcdfc75b30 HTTP/1.1" 200 None 2026-03-06 16:57:58,514 - lava_callback - DEBUG - Processing node 69ab075227cb11dcdfc75b30: baseline-arm-clabbe 2026-03-06 16:57:58,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:57:58,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:57:58,834 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab075227cb11dcdfc75b30/log.txt.gz 2026-03-06 16:57:58,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:57:59,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:57:59,135 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab075227cb11dcdfc75b30/lava-logs.yaml 2026-03-06 16:57:59,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:57:59,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:57:59,287 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab075227cb11dcdfc75b30/lava_callback.json.gz 2026-03-06 16:57:59,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:59,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab075227cb11dcdfc75b30 HTTP/1.1" 200 None 2026-03-06 16:57:59,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:59,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 16:57:59,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:57:59,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab075227cb11dcdfc75b30 HTTP/1.1" 200 None 2026-03-06 16:57:59,395 - lava_callback - INFO - Completed processing callback for node 69ab075227cb11dcdfc75b30 2026-03-06 16:58:00,310 - lava_callback - INFO - Received callback for node 69ab074727cb11dcdfc75b0c INFO: 172.21.0.1:41708 - "POST /node/69ab074727cb11dcdfc75b0c HTTP/1.0" 202 Accepted 2026-03-06 16:58:00,316 - lava_callback - INFO - Starting async job submit for node 69ab074727cb11dcdfc75b0c 2026-03-06 16:58:00,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:00,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab074727cb11dcdfc75b0c HTTP/1.1" 200 None 2026-03-06 16:58:00,356 - lava_callback - DEBUG - Processing node 69ab074727cb11dcdfc75b0c: baseline-arm-broonie 2026-03-06 16:58:00,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:00,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:00,722 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab074727cb11dcdfc75b0c/log.txt.gz 2026-03-06 16:58:00,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:01,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:01,038 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab074727cb11dcdfc75b0c/lava-logs.yaml 2026-03-06 16:58:01,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:01,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:01,206 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab074727cb11dcdfc75b0c/lava_callback.json.gz 2026-03-06 16:58:01,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:01,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab074727cb11dcdfc75b0c HTTP/1.1" 200 None 2026-03-06 16:58:01,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:01,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 16:58:01,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:01,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab074727cb11dcdfc75b0c HTTP/1.1" 200 None 2026-03-06 16:58:01,288 - lava_callback - INFO - Completed processing callback for node 69ab074727cb11dcdfc75b0c 2026-03-06 16:58:01,768 - lava_callback - INFO - Received callback for node 69ab074827cb11dcdfc75b0f INFO: 172.21.0.1:41716 - "POST /node/69ab074827cb11dcdfc75b0f HTTP/1.0" 202 Accepted 2026-03-06 16:58:01,778 - lava_callback - INFO - Starting async job submit for node 69ab074827cb11dcdfc75b0f 2026-03-06 16:58:01,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:01,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab074827cb11dcdfc75b0f HTTP/1.1" 200 None 2026-03-06 16:58:01,862 - lava_callback - DEBUG - Processing node 69ab074827cb11dcdfc75b0f: baseline-arm-broonie 2026-03-06 16:58:02,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:02,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:02,358 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab074827cb11dcdfc75b0f/log.txt.gz 2026-03-06 16:58:02,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:02,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:02,724 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab074827cb11dcdfc75b0f/lava-logs.yaml 2026-03-06 16:58:02,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:02,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:02,875 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab074827cb11dcdfc75b0f/lava_callback.json.gz 2026-03-06 16:58:02,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:02,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab074827cb11dcdfc75b0f HTTP/1.1" 200 None 2026-03-06 16:58:02,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:02,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 16:58:02,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:02,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab074827cb11dcdfc75b0f HTTP/1.1" 200 None 2026-03-06 16:58:02,975 - lava_callback - INFO - Completed processing callback for node 69ab074827cb11dcdfc75b0f INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:58:07,658 - lava_callback - INFO - Received callback for node 69ab075e27cb11dcdfc75b7e INFO: 172.21.0.1:41744 - "POST /node/69ab075e27cb11dcdfc75b7e HTTP/1.0" 202 Accepted 2026-03-06 16:58:07,709 - lava_callback - INFO - Starting async job submit for node 69ab075e27cb11dcdfc75b7e 2026-03-06 16:58:07,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:07,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab075e27cb11dcdfc75b7e HTTP/1.1" 200 None 2026-03-06 16:58:07,766 - lava_callback - DEBUG - Processing node 69ab075e27cb11dcdfc75b7e: baseline-arm-pengutronix 2026-03-06 16:58:07,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:08,091 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:08,092 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab075e27cb11dcdfc75b7e/log.txt.gz 2026-03-06 16:58:08,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:08,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:08,301 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab075e27cb11dcdfc75b7e/lava-logs.yaml 2026-03-06 16:58:08,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:08,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:08,413 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab075e27cb11dcdfc75b7e/lava_callback.json.gz 2026-03-06 16:58:08,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:08,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab075e27cb11dcdfc75b7e HTTP/1.1" 200 None 2026-03-06 16:58:08,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:08,470 - lava_callback - INFO - Received callback for node 69a86497440c1da21c237d4d 2026-03-06 16:58:08,479 - lava_callback - INFO - Starting async job submit for node 69a86497440c1da21c237d4d INFO: 172.21.0.1:41750 - "POST /node/69a86497440c1da21c237d4d HTTP/1.0" 202 Accepted 2026-03-06 16:58:08,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:08,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 16:58:08,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:08,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86497440c1da21c237d4d HTTP/1.1" 200 None 2026-03-06 16:58:08,498 - lava_callback - DEBUG - Processing node 69a86497440c1da21c237d4d: baseline-arm-baylibre 2026-03-06 16:58:08,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a86497440c1da21c237d4d 2026-03-06 16:58:08,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:08,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab075e27cb11dcdfc75b7e HTTP/1.1" 200 None 2026-03-06 16:58:08,518 - lava_callback - INFO - Completed processing callback for node 69ab075e27cb11dcdfc75b7e 2026-03-06 16:58:08,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86497440c1da21c237d4d HTTP/1.1" 200 None 2026-03-06 16:58:08,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:08,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-06 16:58:08,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:08,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a86497440c1da21c237d4d HTTP/1.1" 200 None 2026-03-06 16:58:08,614 - lava_callback - ERROR - Error processing callback for node 69a86497440c1da21c237d4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-06 16:58:12,686 - lava_callback - INFO - Received callback for node 69ab075a27cb11dcdfc75b49 INFO: 172.21.0.1:45026 - "POST /node/69ab075a27cb11dcdfc75b49 HTTP/1.0" 202 Accepted 2026-03-06 16:58:12,692 - lava_callback - INFO - Starting async job submit for node 69ab075a27cb11dcdfc75b49 2026-03-06 16:58:12,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:12,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab075a27cb11dcdfc75b49 HTTP/1.1" 200 None 2026-03-06 16:58:12,727 - lava_callback - DEBUG - Processing node 69ab075a27cb11dcdfc75b49: baseline-arm-pengutronix 2026-03-06 16:58:12,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:12,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:12,981 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab075a27cb11dcdfc75b49/log.txt.gz 2026-03-06 16:58:13,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:13,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:13,238 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab075a27cb11dcdfc75b49/lava-logs.yaml 2026-03-06 16:58:13,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:13,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:13,388 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab075a27cb11dcdfc75b49/lava_callback.json.gz 2026-03-06 16:58:13,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:13,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab075a27cb11dcdfc75b49 HTTP/1.1" 200 None 2026-03-06 16:58:13,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:13,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 16:58:13,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:13,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab075a27cb11dcdfc75b49 HTTP/1.1" 200 None 2026-03-06 16:58:13,471 - lava_callback - INFO - Completed processing callback for node 69ab075a27cb11dcdfc75b49 2026-03-06 16:58:14,355 - lava_callback - INFO - Received callback for node 69ab075b27cb11dcdfc75b4c INFO: 172.21.0.1:45042 - "POST /node/69ab075b27cb11dcdfc75b4c HTTP/1.0" 202 Accepted 2026-03-06 16:58:14,361 - lava_callback - INFO - Starting async job submit for node 69ab075b27cb11dcdfc75b4c 2026-03-06 16:58:14,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:14,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab075b27cb11dcdfc75b4c HTTP/1.1" 200 None 2026-03-06 16:58:14,413 - lava_callback - DEBUG - Processing node 69ab075b27cb11dcdfc75b4c: baseline-arm-pengutronix 2026-03-06 16:58:14,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:14,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:14,673 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab075b27cb11dcdfc75b4c/log.txt.gz 2026-03-06 16:58:14,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:14,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:14,932 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab075b27cb11dcdfc75b4c/lava-logs.yaml 2026-03-06 16:58:14,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:15,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:15,092 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab075b27cb11dcdfc75b4c/lava_callback.json.gz 2026-03-06 16:58:15,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:15,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab075b27cb11dcdfc75b4c HTTP/1.1" 200 None 2026-03-06 16:58:15,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:15,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 16:58:15,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:45050 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-06 16:58:15,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab075b27cb11dcdfc75b4c HTTP/1.1" 200 None 2026-03-06 16:58:15,175 - lava_callback - INFO - Completed processing callback for node 69ab075b27cb11dcdfc75b4c INFO: 172.21.0.1:45062 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:58:17,748 - lava_callback - INFO - Received callback for node 69ab074e27cb11dcdfc75b21 INFO: 172.21.0.1:45070 - "POST /node/69ab074e27cb11dcdfc75b21 HTTP/1.0" 202 Accepted 2026-03-06 16:58:17,754 - lava_callback - INFO - Starting async job submit for node 69ab074e27cb11dcdfc75b21 2026-03-06 16:58:17,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:17,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab074e27cb11dcdfc75b21 HTTP/1.1" 200 None 2026-03-06 16:58:17,790 - lava_callback - DEBUG - Processing node 69ab074e27cb11dcdfc75b21: baseline-arm-clabbe 2026-03-06 16:58:18,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:18,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:18,109 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab074e27cb11dcdfc75b21/log.txt.gz 2026-03-06 16:58:18,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:18,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:18,427 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab074e27cb11dcdfc75b21/lava-logs.yaml 2026-03-06 16:58:18,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:18,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:18,556 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab074e27cb11dcdfc75b21/lava_callback.json.gz 2026-03-06 16:58:18,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:18,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab074e27cb11dcdfc75b21 HTTP/1.1" 200 None 2026-03-06 16:58:18,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:18,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 16:58:18,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:18,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab074e27cb11dcdfc75b21 HTTP/1.1" 200 None 2026-03-06 16:58:18,641 - lava_callback - INFO - Completed processing callback for node 69ab074e27cb11dcdfc75b21 INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:58:27,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:27,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-06 16:58:31,147 - lava_callback - INFO - Received callback for node 69ab074927cb11dcdfc75b12 INFO: 172.21.0.1:57906 - "POST /node/69ab074927cb11dcdfc75b12 HTTP/1.0" 202 Accepted 2026-03-06 16:58:31,153 - lava_callback - INFO - Starting async job submit for node 69ab074927cb11dcdfc75b12 2026-03-06 16:58:31,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:31,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab074927cb11dcdfc75b12 HTTP/1.1" 200 None 2026-03-06 16:58:31,190 - lava_callback - DEBUG - Processing node 69ab074927cb11dcdfc75b12: baseline-arm-broonie 2026-03-06 16:58:31,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:31,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:31,548 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab074927cb11dcdfc75b12/log.txt.gz 2026-03-06 16:58:31,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:31,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:31,914 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab074927cb11dcdfc75b12/lava-logs.yaml 2026-03-06 16:58:31,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:32,091 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:32,093 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab074927cb11dcdfc75b12/lava_callback.json.gz 2026-03-06 16:58:32,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:32,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab074927cb11dcdfc75b12 HTTP/1.1" 200 None 2026-03-06 16:58:32,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:32,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 16:58:32,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:32,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab074927cb11dcdfc75b12 HTTP/1.1" 200 None 2026-03-06 16:58:32,175 - lava_callback - INFO - Completed processing callback for node 69ab074927cb11dcdfc75b12 INFO: 172.21.0.1:57912 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:58:44,363 - lava_callback - INFO - Received callback for node 69ab075727cb11dcdfc75b3d INFO: 172.21.0.1:44694 - "POST /node/69ab075727cb11dcdfc75b3d HTTP/1.0" 202 Accepted 2026-03-06 16:58:44,374 - lava_callback - INFO - Starting async job submit for node 69ab075727cb11dcdfc75b3d 2026-03-06 16:58:44,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:44,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab075727cb11dcdfc75b3d HTTP/1.1" 200 None 2026-03-06 16:58:44,447 - lava_callback - DEBUG - Processing node 69ab075727cb11dcdfc75b3d: baseline-arm-kontron 2026-03-06 16:58:44,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:45,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:45,023 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ab075727cb11dcdfc75b3d/log.txt.gz 2026-03-06 16:58:45,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:45,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:45,529 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ab075727cb11dcdfc75b3d/lava-logs.yaml 2026-03-06 16:58:45,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:58:45,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:58:45,881 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ab075727cb11dcdfc75b3d/lava_callback.json.gz 2026-03-06 16:58:45,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:45,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab075727cb11dcdfc75b3d HTTP/1.1" 200 None 2026-03-06 16:58:45,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:45,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 16:58:45,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:45,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab075727cb11dcdfc75b3d HTTP/1.1" 200 None 2026-03-06 16:58:45,989 - lava_callback - INFO - Completed processing callback for node 69ab075727cb11dcdfc75b3d INFO: 172.21.0.1:44698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58644 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:58:57,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:58:57,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49700 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:59:08,479 - lava_callback - INFO - Received callback for node 69a864cb440c1da21c237d9e INFO: 172.21.0.1:49716 - "POST /node/69a864cb440c1da21c237d9e HTTP/1.0" 202 Accepted 2026-03-06 16:59:08,488 - lava_callback - INFO - Starting async job submit for node 69a864cb440c1da21c237d9e 2026-03-06 16:59:08,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:08,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a864cb440c1da21c237d9e HTTP/1.1" 200 None 2026-03-06 16:59:08,513 - lava_callback - DEBUG - Processing node 69a864cb440c1da21c237d9e: baseline-arm-baylibre 2026-03-06 16:59:08,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a864cb440c1da21c237d9e 2026-03-06 16:59:08,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:08,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a864cb440c1da21c237d9e HTTP/1.1" 200 None 2026-03-06 16:59:08,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:08,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-06 16:59:08,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:08,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a864cb440c1da21c237d9e HTTP/1.1" 200 None 2026-03-06 16:59:08,635 - lava_callback - ERROR - Error processing callback for node 69a864cb440c1da21c237d9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-06 16:59:12,187 - lava_callback - INFO - Received callback for node 69ab077727cb11dcdfc75bab INFO: 172.21.0.1:40504 - "POST /node/69ab077727cb11dcdfc75bab HTTP/1.0" 202 Accepted 2026-03-06 16:59:12,197 - lava_callback - INFO - Starting async job submit for node 69ab077727cb11dcdfc75bab 2026-03-06 16:59:12,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:12,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077727cb11dcdfc75bab HTTP/1.1" 200 None 2026-03-06 16:59:12,268 - lava_callback - DEBUG - Processing node 69ab077727cb11dcdfc75bab: ltp-dio 2026-03-06 16:59:12,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:59:13,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:59:13,258 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69ab077727cb11dcdfc75bab/log.txt.gz 2026-03-06 16:59:13,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:59:14,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:59:14,138 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69ab077727cb11dcdfc75bab/lava-logs.yaml 2026-03-06 16:59:14,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:59:14,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:59:14,612 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69ab077727cb11dcdfc75bab/lava_callback.json.gz 2026-03-06 16:59:14,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:14,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077727cb11dcdfc75bab HTTP/1.1" 200 None 2026-03-06 16:59:14,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:14,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 16:59:14,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:14,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab077727cb11dcdfc75bab HTTP/1.1" 200 None 2026-03-06 16:59:14,740 - lava_callback - INFO - Completed processing callback for node 69ab077727cb11dcdfc75bab INFO: 172.21.0.1:40520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:59:27,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:27,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-06 16:59:28,907 - lava_callback - INFO - Received callback for node 69ab07db27cb11dcdfc75c78 INFO: 172.21.0.1:53228 - "POST /node/69ab07db27cb11dcdfc75c78 HTTP/1.0" 202 Accepted 2026-03-06 16:59:28,916 - lava_callback - INFO - Starting async job submit for node 69ab07db27cb11dcdfc75c78 2026-03-06 16:59:28,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:28,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab07db27cb11dcdfc75c78 HTTP/1.1" 200 None 2026-03-06 16:59:28,948 - lava_callback - DEBUG - Processing node 69ab07db27cb11dcdfc75c78: baseline-arm 2026-03-06 16:59:28,954 - lava_callback - WARNING - Failed to upload log 2026-03-06 16:59:28,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:59:29,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:59:29,496 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab07db27cb11dcdfc75c78/lava-logs.yaml 2026-03-06 16:59:29,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 16:59:30,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 16:59:30,033 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab07db27cb11dcdfc75c78/lava_callback.json.gz 2026-03-06 16:59:30,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:30,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab07db27cb11dcdfc75c78 HTTP/1.1" 200 None 2026-03-06 16:59:30,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:30,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 16:59:30,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:30,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab07db27cb11dcdfc75c78 HTTP/1.1" 200 None 2026-03-06 16:59:30,134 - lava_callback - INFO - Completed processing callback for node 69ab07db27cb11dcdfc75c78 INFO: 172.21.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:59:48,759 - lava_callback - INFO - Received callback for node 69a864fe440c1da21c237df8 INFO: 172.21.0.1:46198 - "POST /node/69a864fe440c1da21c237df8 HTTP/1.0" 202 Accepted 2026-03-06 16:59:48,767 - lava_callback - INFO - Starting async job submit for node 69a864fe440c1da21c237df8 2026-03-06 16:59:48,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:48,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a864fe440c1da21c237df8 HTTP/1.1" 200 None 2026-03-06 16:59:48,786 - lava_callback - DEBUG - Processing node 69a864fe440c1da21c237df8: baseline-arm-baylibre 2026-03-06 16:59:48,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a864fe440c1da21c237df8 2026-03-06 16:59:48,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:48,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a864fe440c1da21c237df8 HTTP/1.1" 200 None 2026-03-06 16:59:48,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:48,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-06 16:59:48,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:48,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a864fe440c1da21c237df8 HTTP/1.1" 200 None 2026-03-06 16:59:48,848 - lava_callback - ERROR - Error processing callback for node 69a864fe440c1da21c237df8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40118 - "GET / HTTP/1.0" 200 OK 2026-03-06 16:59:57,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 16:59:57,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-06 17:00:05,204 - lava_callback - INFO - Received callback for node 69ab074f27cb11dcdfc75b25 INFO: 172.21.0.1:33974 - "POST /node/69ab074f27cb11dcdfc75b25 HTTP/1.0" 202 Accepted 2026-03-06 17:00:05,210 - lava_callback - INFO - Starting async job submit for node 69ab074f27cb11dcdfc75b25 2026-03-06 17:00:05,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:00:05,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab074f27cb11dcdfc75b25 HTTP/1.1" 200 None 2026-03-06 17:00:05,247 - lava_callback - DEBUG - Processing node 69ab074f27cb11dcdfc75b25: baseline-arm-clabbe 2026-03-06 17:00:05,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:00:05,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:00:05,801 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab074f27cb11dcdfc75b25/log.txt.gz 2026-03-06 17:00:05,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:00:06,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:00:06,139 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab074f27cb11dcdfc75b25/lava-logs.yaml 2026-03-06 17:00:06,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:00:06,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:00:06,289 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab074f27cb11dcdfc75b25/lava_callback.json.gz 2026-03-06 17:00:06,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:00:06,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab074f27cb11dcdfc75b25 HTTP/1.1" 200 None 2026-03-06 17:00:06,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:00:06,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:00:06,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:00:06,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab074f27cb11dcdfc75b25 HTTP/1.1" 200 None 2026-03-06 17:00:06,368 - lava_callback - INFO - Completed processing callback for node 69ab074f27cb11dcdfc75b25 INFO: 172.21.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:00:27,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:00:27,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:00:48,575 - lava_callback - INFO - Received callback for node 69a86532440c1da21c237e42 INFO: 172.21.0.1:55860 - "POST /node/69a86532440c1da21c237e42 HTTP/1.0" 202 Accepted 2026-03-06 17:00:48,581 - lava_callback - INFO - Starting async job submit for node 69a86532440c1da21c237e42 2026-03-06 17:00:48,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:00:48,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86532440c1da21c237e42 HTTP/1.1" 200 None 2026-03-06 17:00:48,599 - lava_callback - DEBUG - Processing node 69a86532440c1da21c237e42: baseline-arm-baylibre 2026-03-06 17:00:48,599 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a86532440c1da21c237e42 2026-03-06 17:00:48,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:00:48,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86532440c1da21c237e42 HTTP/1.1" 200 None 2026-03-06 17:00:48,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:00:48,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-06 17:00:48,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:00:48,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a86532440c1da21c237e42 HTTP/1.1" 200 None 2026-03-06 17:00:48,654 - lava_callback - ERROR - Error processing callback for node 69a86532440c1da21c237e42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:01:44,006 - lava_callback - INFO - Received callback for node 69ab075327cb11dcdfc75b33 INFO: 172.21.0.1:50248 - "POST /node/69ab075327cb11dcdfc75b33 HTTP/1.0" 202 Accepted 2026-03-06 17:01:44,012 - lava_callback - INFO - Starting async job submit for node 69ab075327cb11dcdfc75b33 2026-03-06 17:01:44,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:01:44,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab075327cb11dcdfc75b33 HTTP/1.1" 200 None 2026-03-06 17:01:44,052 - lava_callback - DEBUG - Processing node 69ab075327cb11dcdfc75b33: baseline-arm-clabbe 2026-03-06 17:01:44,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:01:44,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:01:44,437 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab075327cb11dcdfc75b33/log.txt.gz 2026-03-06 17:01:44,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:01:44,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:01:44,777 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab075327cb11dcdfc75b33/lava-logs.yaml 2026-03-06 17:01:44,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:01:44,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:01:44,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab075327cb11dcdfc75b33/lava_callback.json.gz 2026-03-06 17:01:44,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:01:44,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab075327cb11dcdfc75b33 HTTP/1.1" 200 None 2026-03-06 17:01:44,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:01:45,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:01:45,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:01:45,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab075327cb11dcdfc75b33 HTTP/1.1" 200 None 2026-03-06 17:01:45,038 - lava_callback - INFO - Completed processing callback for node 69ab075327cb11dcdfc75b33 INFO: 172.21.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35954 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:01:51,604 - lava_callback - INFO - Received callback for node 69ab078527cb11dcdfc75be1 INFO: 172.21.0.1:35958 - "POST /node/69ab078527cb11dcdfc75be1 HTTP/1.0" 202 Accepted 2026-03-06 17:01:51,611 - lava_callback - INFO - Starting async job submit for node 69ab078527cb11dcdfc75be1 2026-03-06 17:01:51,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:01:51,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab078527cb11dcdfc75be1 HTTP/1.1" 200 None 2026-03-06 17:01:51,652 - lava_callback - DEBUG - Processing node 69ab078527cb11dcdfc75be1: ltp-syscalls 2026-03-06 17:01:52,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:01:52,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:01:52,675 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ab078527cb11dcdfc75be1/log.txt.gz 2026-03-06 17:01:53,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:01:53,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:01:53,346 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ab078527cb11dcdfc75be1/lava-logs.yaml 2026-03-06 17:01:53,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:01:53,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:01:53,544 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ab078527cb11dcdfc75be1/lava_callback.json.gz 2026-03-06 17:01:53,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:01:53,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab078527cb11dcdfc75be1 HTTP/1.1" 200 None 2026-03-06 17:01:53,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:01:53,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:01:53,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:01:53,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab078527cb11dcdfc75be1 HTTP/1.1" 200 None 2026-03-06 17:01:53,644 - lava_callback - INFO - Completed processing callback for node 69ab078527cb11dcdfc75be1 INFO: 172.21.0.1:35968 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:01:57,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:01:57,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40232 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:03:23,179 - lava_callback - INFO - Received callback for node 69ab075427cb11dcdfc75b36 INFO: 172.21.0.1:45590 - "POST /node/69ab075427cb11dcdfc75b36 HTTP/1.0" 202 Accepted 2026-03-06 17:03:23,186 - lava_callback - INFO - Starting async job submit for node 69ab075427cb11dcdfc75b36 2026-03-06 17:03:23,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:03:23,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab075427cb11dcdfc75b36 HTTP/1.1" 200 None 2026-03-06 17:03:23,222 - lava_callback - DEBUG - Processing node 69ab075427cb11dcdfc75b36: baseline-arm-clabbe 2026-03-06 17:03:23,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:03:23,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:03:23,598 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab075427cb11dcdfc75b36/log.txt.gz 2026-03-06 17:03:23,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:03:23,933 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:03:23,935 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab075427cb11dcdfc75b36/lava-logs.yaml 2026-03-06 17:03:23,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:03:24,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:03:24,097 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab075427cb11dcdfc75b36/lava_callback.json.gz 2026-03-06 17:03:24,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:03:24,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab075427cb11dcdfc75b36 HTTP/1.1" 200 None 2026-03-06 17:03:24,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:03:24,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:03:24,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:03:24,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab075427cb11dcdfc75b36 HTTP/1.1" 200 None 2026-03-06 17:03:24,184 - lava_callback - INFO - Completed processing callback for node 69ab075427cb11dcdfc75b36 INFO: 172.21.0.1:45606 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:03:27,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:03:27,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:05:21,240 - lava_callback - INFO - Received callback for node 69ab04bb27cb11dcdfc75a5b INFO: 172.21.0.1:36412 - "POST /node/69ab04bb27cb11dcdfc75a5b HTTP/1.0" 202 Accepted 2026-03-06 17:05:21,251 - lava_callback - INFO - Starting async job submit for node 69ab04bb27cb11dcdfc75a5b 2026-03-06 17:05:21,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:05:21,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab04bb27cb11dcdfc75a5b HTTP/1.1" 200 None 2026-03-06 17:05:21,407 - lava_callback - DEBUG - Processing node 69ab04bb27cb11dcdfc75a5b: ltp-smoke 2026-03-06 17:05:22,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:05:22,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:05:22,660 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab04bb27cb11dcdfc75a5b/log.txt.gz 2026-03-06 17:05:23,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:05:23,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:05:23,777 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab04bb27cb11dcdfc75a5b/lava-logs.yaml 2026-03-06 17:05:23,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:05:24,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:05:24,212 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab04bb27cb11dcdfc75a5b/lava_callback.json.gz 2026-03-06 17:05:24,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:05:24,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab04bb27cb11dcdfc75a5b HTTP/1.1" 200 None 2026-03-06 17:05:24,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:05:24,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe9427cb11dcdfc758e6 HTTP/1.1" 200 None 2026-03-06 17:05:24,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:05:24,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab04bb27cb11dcdfc75a5b HTTP/1.1" 200 None 2026-03-06 17:05:24,705 - lava_callback - INFO - Completed processing callback for node 69ab04bb27cb11dcdfc75a5b INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:05:27,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:05:27,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:08:36,677 - lava_callback - INFO - Received callback for node 69ab09fb27cb11dcdfc75dbd INFO: 172.21.0.1:46266 - "POST /node/69ab09fb27cb11dcdfc75dbd HTTP/1.0" 202 Accepted 2026-03-06 17:08:36,688 - lava_callback - INFO - Starting async job submit for node 69ab09fb27cb11dcdfc75dbd 2026-03-06 17:08:36,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:08:36,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab09fb27cb11dcdfc75dbd HTTP/1.1" 200 None 2026-03-06 17:08:36,723 - lava_callback - DEBUG - Processing node 69ab09fb27cb11dcdfc75dbd: baseline-arm 2026-03-06 17:08:36,731 - lava_callback - WARNING - Failed to upload log 2026-03-06 17:08:36,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:08:37,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:08:37,194 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab09fb27cb11dcdfc75dbd/lava-logs.yaml 2026-03-06 17:08:37,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:08:37,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:08:37,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab09fb27cb11dcdfc75dbd/lava_callback.json.gz 2026-03-06 17:08:37,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:08:37,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab09fb27cb11dcdfc75dbd HTTP/1.1" 200 None 2026-03-06 17:08:37,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:08:37,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:08:37,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:08:37,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab09fb27cb11dcdfc75dbd HTTP/1.1" 200 None 2026-03-06 17:08:37,776 - lava_callback - INFO - Completed processing callback for node 69ab09fb27cb11dcdfc75dbd INFO: 172.21.0.1:54984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37922 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:08:57,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:08:57,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50690 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:14:16,598 - lava_callback - INFO - Received callback for node 69ab0b5c27cb11dcdfc75e97 INFO: 172.21.0.1:50694 - "POST /node/69ab0b5c27cb11dcdfc75e97 HTTP/1.0" 202 Accepted 2026-03-06 17:14:16,604 - lava_callback - INFO - Starting async job submit for node 69ab0b5c27cb11dcdfc75e97 2026-03-06 17:14:16,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:14:16,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab0b5c27cb11dcdfc75e97 HTTP/1.1" 200 None 2026-03-06 17:14:16,622 - lava_callback - DEBUG - Processing node 69ab0b5c27cb11dcdfc75e97: baseline-arm 2026-03-06 17:14:16,627 - lava_callback - WARNING - Failed to upload log 2026-03-06 17:14:16,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:14:16,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:14:16,783 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab0b5c27cb11dcdfc75e97/lava-logs.yaml 2026-03-06 17:14:16,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:14:16,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:14:16,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab0b5c27cb11dcdfc75e97/lava_callback.json.gz 2026-03-06 17:14:16,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:14:16,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab0b5c27cb11dcdfc75e97 HTTP/1.1" 200 None 2026-03-06 17:14:16,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:14:16,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:14:16,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:14:16,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab0b5c27cb11dcdfc75e97 HTTP/1.1" 200 None 2026-03-06 17:14:16,993 - lava_callback - INFO - Completed processing callback for node 69ab0b5c27cb11dcdfc75e97 2026-03-06 17:14:22,326 - lava_callback - INFO - Received callback for node 69ab073a27cb11dcdfc75ae3 INFO: 172.21.0.1:40862 - "POST /node/69ab073a27cb11dcdfc75ae3 HTTP/1.0" 202 Accepted 2026-03-06 17:14:22,333 - lava_callback - INFO - Starting async job submit for node 69ab073a27cb11dcdfc75ae3 2026-03-06 17:14:22,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:14:22,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab073a27cb11dcdfc75ae3 HTTP/1.1" 200 None 2026-03-06 17:14:22,404 - lava_callback - DEBUG - Processing node 69ab073a27cb11dcdfc75ae3: baseline-arm 2026-03-06 17:14:22,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:14:23,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:14:23,138 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073a27cb11dcdfc75ae3/log.txt.gz 2026-03-06 17:14:23,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:14:23,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:14:23,732 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073a27cb11dcdfc75ae3/lava-logs.yaml 2026-03-06 17:14:23,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:14:23,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:14:23,899 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab073a27cb11dcdfc75ae3/lava_callback.json.gz DEBUG: Setup failed for 69ab073a27cb11dcdfc75ae3. Transitting job node result: incomplete -> fail 2026-03-06 17:14:24,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:14:24,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab073a27cb11dcdfc75ae3 HTTP/1.1" 200 None 2026-03-06 17:14:24,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:14:24,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:14:24,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:14:24,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab073a27cb11dcdfc75ae3 HTTP/1.1" 200 None 2026-03-06 17:14:24,193 - lava_callback - INFO - Completed processing callback for node 69ab073a27cb11dcdfc75ae3 INFO: 172.21.0.1:40878 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:14:27,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:14:27,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41466 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:15:53,402 - lava_callback - INFO - Received callback for node 69ab074b27cb11dcdfc75b1b INFO: 172.21.0.1:41478 - "POST /node/69ab074b27cb11dcdfc75b1b HTTP/1.0" 202 Accepted 2026-03-06 17:15:53,408 - lava_callback - INFO - Starting async job submit for node 69ab074b27cb11dcdfc75b1b 2026-03-06 17:15:53,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:15:53,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab074b27cb11dcdfc75b1b HTTP/1.1" 200 None 2026-03-06 17:15:53,454 - lava_callback - DEBUG - Processing node 69ab074b27cb11dcdfc75b1b: baseline-arm-clabbe 2026-03-06 17:15:53,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:15:53,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:15:53,794 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab074b27cb11dcdfc75b1b/log.txt.gz 2026-03-06 17:15:53,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:15:54,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:15:54,105 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab074b27cb11dcdfc75b1b/lava-logs.yaml 2026-03-06 17:15:54,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:15:54,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:15:54,241 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab074b27cb11dcdfc75b1b/lava_callback.json.gz DEBUG: Setup failed for 69ab074b27cb11dcdfc75b1b. Transitting job node result: incomplete -> fail 2026-03-06 17:15:54,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:15:54,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab074b27cb11dcdfc75b1b HTTP/1.1" 200 None 2026-03-06 17:15:54,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:15:54,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:15:54,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:15:54,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab074b27cb11dcdfc75b1b HTTP/1.1" 200 None 2026-03-06 17:15:54,460 - lava_callback - INFO - Completed processing callback for node 69ab074b27cb11dcdfc75b1b INFO: 172.21.0.1:41484 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:15:57,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:15:57,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35014 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:23:52,038 - lava_callback - INFO - Received callback for node 69ab074527cb11dcdfc75b09 INFO: 172.21.0.1:35028 - "POST /node/69ab074527cb11dcdfc75b09 HTTP/1.0" 202 Accepted 2026-03-06 17:23:52,049 - lava_callback - INFO - Starting async job submit for node 69ab074527cb11dcdfc75b09 2026-03-06 17:23:52,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:23:52,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab074527cb11dcdfc75b09 HTTP/1.1" 200 None 2026-03-06 17:23:52,096 - lava_callback - DEBUG - Processing node 69ab074527cb11dcdfc75b09: baseline-arm-broonie 2026-03-06 17:23:52,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:23:52,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:23:52,445 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab074527cb11dcdfc75b09/log.txt.gz 2026-03-06 17:23:52,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:23:52,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:23:52,835 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab074527cb11dcdfc75b09/lava-logs.yaml 2026-03-06 17:23:52,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:23:52,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:23:53,000 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab074527cb11dcdfc75b09/lava_callback.json.gz 2026-03-06 17:23:53,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:23:53,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab074527cb11dcdfc75b09 HTTP/1.1" 200 None 2026-03-06 17:23:53,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:23:53,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:23:53,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:23:53,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab074527cb11dcdfc75b09 HTTP/1.1" 200 None 2026-03-06 17:23:53,101 - lava_callback - INFO - Completed processing callback for node 69ab074527cb11dcdfc75b09 INFO: 172.21.0.1:35032 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:23:57,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:23:57,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57912 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:27:41,788 - lava_callback - INFO - Received callback for node 69ab077327cb11dcdfc75b9f INFO: 172.21.0.1:39870 - "POST /node/69ab077327cb11dcdfc75b9f HTTP/1.0" 202 Accepted 2026-03-06 17:27:41,794 - lava_callback - INFO - Starting async job submit for node 69ab077327cb11dcdfc75b9f 2026-03-06 17:27:41,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:27:41,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077327cb11dcdfc75b9f HTTP/1.1" 200 None 2026-03-06 17:27:41,834 - lava_callback - DEBUG - Processing node 69ab077327cb11dcdfc75b9f: ltp-controllers 2026-03-06 17:27:42,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:27:42,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:27:42,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69ab077327cb11dcdfc75b9f/log.txt.gz 2026-03-06 17:27:42,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:27:42,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:27:42,947 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69ab077327cb11dcdfc75b9f/lava-logs.yaml 2026-03-06 17:27:42,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:27:43,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:27:43,137 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69ab077327cb11dcdfc75b9f/lava_callback.json.gz 2026-03-06 17:27:43,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:27:43,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077327cb11dcdfc75b9f HTTP/1.1" 200 None 2026-03-06 17:27:43,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:27:43,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:27:43,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:27:43,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab077327cb11dcdfc75b9f HTTP/1.1" 200 None 2026-03-06 17:27:43,237 - lava_callback - INFO - Completed processing callback for node 69ab077327cb11dcdfc75b9f INFO: 172.21.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45172 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:27:52,165 - lava_callback - INFO - Received callback for node 69ab077227cb11dcdfc75b9c INFO: 172.21.0.1:45186 - "POST /node/69ab077227cb11dcdfc75b9c HTTP/1.0" 202 Accepted 2026-03-06 17:27:52,172 - lava_callback - INFO - Starting async job submit for node 69ab077227cb11dcdfc75b9c 2026-03-06 17:27:52,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:27:52,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077227cb11dcdfc75b9c HTTP/1.1" 200 None 2026-03-06 17:27:52,211 - lava_callback - DEBUG - Processing node 69ab077227cb11dcdfc75b9c: ltp-containers 2026-03-06 17:27:52,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:27:52,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:27:52,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69ab077227cb11dcdfc75b9c/log.txt.gz 2026-03-06 17:27:52,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:27:53,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:27:53,183 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69ab077227cb11dcdfc75b9c/lava-logs.yaml 2026-03-06 17:27:53,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:27:53,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:27:53,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69ab077227cb11dcdfc75b9c/lava_callback.json.gz 2026-03-06 17:27:53,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:27:53,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077227cb11dcdfc75b9c HTTP/1.1" 200 None 2026-03-06 17:27:53,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:27:53,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:27:53,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:27:53,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab077227cb11dcdfc75b9c HTTP/1.1" 200 None 2026-03-06 17:27:53,482 - lava_callback - INFO - Completed processing callback for node 69ab077227cb11dcdfc75b9c INFO: 172.21.0.1:45196 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:27:57,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:27:57,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36100 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:28:12,326 - lava_callback - INFO - Received callback for node 69ab076f27cb11dcdfc75b95 INFO: 172.21.0.1:45096 - "POST /node/69ab076f27cb11dcdfc75b95 HTTP/1.0" 202 Accepted 2026-03-06 17:28:12,336 - lava_callback - INFO - Starting async job submit for node 69ab076f27cb11dcdfc75b95 2026-03-06 17:28:12,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:28:12,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab076f27cb11dcdfc75b95 HTTP/1.1" 200 None 2026-03-06 17:28:12,406 - lava_callback - DEBUG - Processing node 69ab076f27cb11dcdfc75b95: ltp-cap_bounds 2026-03-06 17:28:12,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:28:12,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:28:12,997 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ab076f27cb11dcdfc75b95/log.txt.gz 2026-03-06 17:28:13,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:28:13,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:28:13,428 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ab076f27cb11dcdfc75b95/lava-logs.yaml 2026-03-06 17:28:13,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:28:13,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:28:13,604 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ab076f27cb11dcdfc75b95/lava_callback.json.gz 2026-03-06 17:28:13,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:28:13,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab076f27cb11dcdfc75b95 HTTP/1.1" 200 None 2026-03-06 17:28:13,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:28:13,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:28:13,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:28:13,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab076f27cb11dcdfc75b95 HTTP/1.1" 200 None 2026-03-06 17:28:13,695 - lava_callback - INFO - Completed processing callback for node 69ab076f27cb11dcdfc75b95 INFO: 172.21.0.1:45102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60902 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:28:27,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:28:27,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-06 17:28:30,323 - lava_callback - INFO - Received callback for node 69a86baf440c1da21c23816b INFO: 172.21.0.1:57578 - "POST /node/69a86baf440c1da21c23816b HTTP/1.0" 202 Accepted 2026-03-06 17:28:30,329 - lava_callback - INFO - Starting async job submit for node 69a86baf440c1da21c23816b 2026-03-06 17:28:30,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:28:30,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86baf440c1da21c23816b HTTP/1.1" 200 None 2026-03-06 17:28:30,346 - lava_callback - DEBUG - Processing node 69a86baf440c1da21c23816b: baseline-arm64-baylibre 2026-03-06 17:28:30,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a86baf440c1da21c23816b 2026-03-06 17:28:30,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:28:30,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86baf440c1da21c23816b HTTP/1.1" 200 None 2026-03-06 17:28:30,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:28:30,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 17:28:30,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:28:30,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a86baf440c1da21c23816b HTTP/1.1" 200 None 2026-03-06 17:28:30,407 - lava_callback - ERROR - Error processing callback for node 69a86baf440c1da21c23816b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-06 17:28:32,419 - lava_callback - INFO - Received callback for node 69ab077627cb11dcdfc75ba2 INFO: 172.21.0.1:57590 - "POST /node/69ab077627cb11dcdfc75ba2 HTTP/1.0" 202 Accepted 2026-03-06 17:28:32,426 - lava_callback - INFO - Starting async job submit for node 69ab077627cb11dcdfc75ba2 2026-03-06 17:28:32,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:28:32,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077627cb11dcdfc75ba2 HTTP/1.1" 200 None 2026-03-06 17:28:32,473 - lava_callback - DEBUG - Processing node 69ab077627cb11dcdfc75ba2: ltp-cve 2026-03-06 17:28:32,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:28:33,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:28:33,035 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69ab077627cb11dcdfc75ba2/log.txt.gz 2026-03-06 17:28:33,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:28:33,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:28:33,476 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69ab077627cb11dcdfc75ba2/lava-logs.yaml 2026-03-06 17:28:33,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:28:33,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:28:33,632 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69ab077627cb11dcdfc75ba2/lava_callback.json.gz 2026-03-06 17:28:33,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:28:33,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077627cb11dcdfc75ba2 HTTP/1.1" 200 None 2026-03-06 17:28:33,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:28:33,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:28:33,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:28:33,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab077627cb11dcdfc75ba2 HTTP/1.1" 200 None 2026-03-06 17:28:33,719 - lava_callback - INFO - Completed processing callback for node 69ab077627cb11dcdfc75ba2 INFO: 172.21.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37500 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:28:57,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:28:57,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34374 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:30:23,053 - lava_callback - INFO - Received callback for node 69ab0b0e27cb11dcdfc75e68 INFO: 172.21.0.1:35246 - "POST /node/69ab0b0e27cb11dcdfc75e68 HTTP/1.0" 202 Accepted 2026-03-06 17:30:23,061 - lava_callback - INFO - Starting async job submit for node 69ab0b0e27cb11dcdfc75e68 2026-03-06 17:30:23,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:30:23,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab0b0e27cb11dcdfc75e68 HTTP/1.1" 200 None 2026-03-06 17:30:23,136 - lava_callback - DEBUG - Processing node 69ab0b0e27cb11dcdfc75e68: ltp-smoke 2026-03-06 17:30:23,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:30:23,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:30:23,751 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab0b0e27cb11dcdfc75e68/log.txt.gz 2026-03-06 17:30:24,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:30:24,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:30:24,402 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab0b0e27cb11dcdfc75e68/lava-logs.yaml 2026-03-06 17:30:24,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:30:24,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:30:24,613 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab0b0e27cb11dcdfc75e68/lava_callback.json.gz 2026-03-06 17:30:24,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:30:24,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab0b0e27cb11dcdfc75e68 HTTP/1.1" 200 None 2026-03-06 17:30:24,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:30:24,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe9427cb11dcdfc758e6 HTTP/1.1" 200 None 2026-03-06 17:30:24,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:30:24,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab0b0e27cb11dcdfc75e68 HTTP/1.1" 200 None 2026-03-06 17:30:24,978 - lava_callback - INFO - Completed processing callback for node 69ab0b0e27cb11dcdfc75e68 INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:30:27,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:30:27,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57344 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:31:41,692 - lava_callback - INFO - Received callback for node 69ab077a27cb11dcdfc75bcd INFO: 172.21.0.1:37270 - "POST /node/69ab077a27cb11dcdfc75bcd HTTP/1.0" 202 Accepted 2026-03-06 17:31:41,699 - lava_callback - INFO - Starting async job submit for node 69ab077a27cb11dcdfc75bcd 2026-03-06 17:31:41,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:31:41,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077a27cb11dcdfc75bcd HTTP/1.1" 200 None 2026-03-06 17:31:41,748 - lava_callback - DEBUG - Processing node 69ab077a27cb11dcdfc75bcd: ltp-fsx 2026-03-06 17:31:42,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:31:42,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:31:42,314 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69ab077a27cb11dcdfc75bcd/log.txt.gz 2026-03-06 17:31:42,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:31:42,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:31:42,747 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69ab077a27cb11dcdfc75bcd/lava-logs.yaml 2026-03-06 17:31:42,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:31:42,927 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:31:42,929 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69ab077a27cb11dcdfc75bcd/lava_callback.json.gz 2026-03-06 17:31:42,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:31:42,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077a27cb11dcdfc75bcd HTTP/1.1" 200 None 2026-03-06 17:31:42,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:31:42,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:31:42,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:31:43,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab077a27cb11dcdfc75bcd HTTP/1.1" 200 None 2026-03-06 17:31:43,018 - lava_callback - INFO - Completed processing callback for node 69ab077a27cb11dcdfc75bcd INFO: 172.21.0.1:37272 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:31:50,371 - lava_callback - INFO - Received callback for node 69a86c7d440c1da21c2381b0 INFO: 172.21.0.1:60886 - "POST /node/69a86c7d440c1da21c2381b0 HTTP/1.0" 202 Accepted 2026-03-06 17:31:50,376 - lava_callback - INFO - Starting async job submit for node 69a86c7d440c1da21c2381b0 2026-03-06 17:31:50,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:31:50,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86c7d440c1da21c2381b0 HTTP/1.1" 200 None 2026-03-06 17:31:50,393 - lava_callback - DEBUG - Processing node 69a86c7d440c1da21c2381b0: baseline-arm64-baylibre 2026-03-06 17:31:50,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a86c7d440c1da21c2381b0 2026-03-06 17:31:50,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:31:50,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86c7d440c1da21c2381b0 HTTP/1.1" 200 None 2026-03-06 17:31:50,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:31:50,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 17:31:50,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:31:50,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a86c7d440c1da21c2381b0 HTTP/1.1" 200 None 2026-03-06 17:31:50,457 - lava_callback - ERROR - Error processing callback for node 69a86c7d440c1da21c2381b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60894 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:31:52,275 - lava_callback - INFO - Received callback for node 69ab077927cb11dcdfc75bb0 INFO: 172.21.0.1:60906 - "POST /node/69ab077927cb11dcdfc75bb0 HTTP/1.0" 202 Accepted 2026-03-06 17:31:52,281 - lava_callback - INFO - Starting async job submit for node 69ab077927cb11dcdfc75bb0 2026-03-06 17:31:52,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:31:52,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077927cb11dcdfc75bb0 HTTP/1.1" 200 None 2026-03-06 17:31:52,326 - lava_callback - DEBUG - Processing node 69ab077927cb11dcdfc75bb0: ltp-fs_bind 2026-03-06 17:31:52,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:31:52,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:31:52,877 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ab077927cb11dcdfc75bb0/log.txt.gz 2026-03-06 17:31:53,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:31:53,291 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:31:53,293 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ab077927cb11dcdfc75bb0/lava-logs.yaml 2026-03-06 17:31:53,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:31:53,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:31:53,499 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ab077927cb11dcdfc75bb0/lava_callback.json.gz 2026-03-06 17:31:53,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:31:53,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077927cb11dcdfc75bb0 HTTP/1.1" 200 None 2026-03-06 17:31:53,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:31:53,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:31:53,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:31:53,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab077927cb11dcdfc75bb0 HTTP/1.1" 200 None 2026-03-06 17:31:53,591 - lava_callback - INFO - Completed processing callback for node 69ab077927cb11dcdfc75bb0 INFO: 172.21.0.1:60918 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:31:57,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:31:57,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56408 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:32:32,330 - lava_callback - INFO - Received callback for node 69ab077d27cb11dcdfc75bd3 INFO: 172.21.0.1:56588 - "POST /node/69ab077d27cb11dcdfc75bd3 HTTP/1.0" 202 Accepted 2026-03-06 17:32:32,336 - lava_callback - INFO - Starting async job submit for node 69ab077d27cb11dcdfc75bd3 2026-03-06 17:32:32,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:32:32,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077d27cb11dcdfc75bd3 HTTP/1.1" 200 None 2026-03-06 17:32:32,401 - lava_callback - DEBUG - Processing node 69ab077d27cb11dcdfc75bd3: ltp-ipc 2026-03-06 17:32:32,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:32:32,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:32:32,853 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69ab077d27cb11dcdfc75bd3/log.txt.gz 2026-03-06 17:32:33,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:32:33,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:32:33,246 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69ab077d27cb11dcdfc75bd3/lava-logs.yaml 2026-03-06 17:32:33,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:32:33,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:32:33,437 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69ab077d27cb11dcdfc75bd3/lava_callback.json.gz 2026-03-06 17:32:33,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:32:33,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077d27cb11dcdfc75bd3 HTTP/1.1" 200 None 2026-03-06 17:32:33,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:32:33,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:32:33,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:32:33,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab077d27cb11dcdfc75bd3 HTTP/1.1" 200 None 2026-03-06 17:32:33,519 - lava_callback - INFO - Completed processing callback for node 69ab077d27cb11dcdfc75bd3 INFO: 172.21.0.1:56598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41918 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:32:57,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:32:57,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45874 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:33:20,787 - lava_callback - INFO - Received callback for node 69ab0bf527cb11dcdfc75f09 INFO: 172.21.0.1:52048 - "POST /node/69ab0bf527cb11dcdfc75f09 HTTP/1.0" 202 Accepted 2026-03-06 17:33:20,796 - lava_callback - INFO - Starting async job submit for node 69ab0bf527cb11dcdfc75f09 2026-03-06 17:33:20,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:33:20,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab0bf527cb11dcdfc75f09 HTTP/1.1" 200 None 2026-03-06 17:33:20,871 - lava_callback - DEBUG - Processing node 69ab0bf527cb11dcdfc75f09: baseline-arm 2026-03-06 17:33:21,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:33:21,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:33:21,918 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab0bf527cb11dcdfc75f09/log.txt.gz 2026-03-06 17:33:22,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:33:22,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:33:22,534 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab0bf527cb11dcdfc75f09/lava-logs.yaml 2026-03-06 17:33:22,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:33:22,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:33:22,695 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab0bf527cb11dcdfc75f09/lava_callback.json.gz DEBUG: Setup failed for 69ab0bf527cb11dcdfc75f09. Transitting job node result: incomplete -> fail 2026-03-06 17:33:22,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:33:22,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab0bf527cb11dcdfc75f09 HTTP/1.1" 200 None 2026-03-06 17:33:22,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:33:22,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:33:22,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:33:22,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab0bf527cb11dcdfc75f09 HTTP/1.1" 200 None 2026-03-06 17:33:22,983 - lava_callback - INFO - Completed processing callback for node 69ab0bf527cb11dcdfc75f09 INFO: 172.21.0.1:52062 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:33:27,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:33:27,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-06 17:33:30,412 - lava_callback - INFO - Received callback for node 69a86cd8440c1da21c2381ce INFO: 172.21.0.1:34250 - "POST /node/69a86cd8440c1da21c2381ce HTTP/1.0" 202 Accepted 2026-03-06 17:33:30,418 - lava_callback - INFO - Starting async job submit for node 69a86cd8440c1da21c2381ce 2026-03-06 17:33:30,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:33:30,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86cd8440c1da21c2381ce HTTP/1.1" 200 None 2026-03-06 17:33:30,451 - lava_callback - DEBUG - Processing node 69a86cd8440c1da21c2381ce: baseline-arm64-baylibre 2026-03-06 17:33:30,451 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a86cd8440c1da21c2381ce 2026-03-06 17:33:30,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:33:30,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86cd8440c1da21c2381ce HTTP/1.1" 200 None 2026-03-06 17:33:30,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:33:30,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 17:33:30,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:33:30,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a86cd8440c1da21c2381ce HTTP/1.1" 200 None 2026-03-06 17:33:30,502 - lava_callback - ERROR - Error processing callback for node 69a86cd8440c1da21c2381ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35324 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:34:50,545 - lava_callback - INFO - Received callback for node 69a86d34440c1da21c2381e1 INFO: 172.21.0.1:38478 - "POST /node/69a86d34440c1da21c2381e1 HTTP/1.0" 202 Accepted 2026-03-06 17:34:50,550 - lava_callback - INFO - Starting async job submit for node 69a86d34440c1da21c2381e1 2026-03-06 17:34:50,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:34:50,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86d34440c1da21c2381e1 HTTP/1.1" 200 None 2026-03-06 17:34:50,567 - lava_callback - DEBUG - Processing node 69a86d34440c1da21c2381e1: baseline-arm64-baylibre 2026-03-06 17:34:50,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a86d34440c1da21c2381e1 2026-03-06 17:34:50,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:34:50,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86d34440c1da21c2381e1 HTTP/1.1" 200 None 2026-03-06 17:34:50,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:34:50,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 17:34:50,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:34:50,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a86d34440c1da21c2381e1 HTTP/1.1" 200 None 2026-03-06 17:34:50,641 - lava_callback - ERROR - Error processing callback for node 69a86d34440c1da21c2381e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53476 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:35:42,103 - lava_callback - INFO - Received callback for node 69ab077f27cb11dcdfc75bd6 INFO: 172.21.0.1:53376 - "POST /node/69ab077f27cb11dcdfc75bd6 HTTP/1.0" 202 Accepted 2026-03-06 17:35:42,109 - lava_callback - INFO - Starting async job submit for node 69ab077f27cb11dcdfc75bd6 2026-03-06 17:35:42,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:35:42,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077f27cb11dcdfc75bd6 HTTP/1.1" 200 None 2026-03-06 17:35:42,152 - lava_callback - DEBUG - Processing node 69ab077f27cb11dcdfc75bd6: ltp-pty 2026-03-06 17:35:42,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:35:42,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:35:42,635 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69ab077f27cb11dcdfc75bd6/log.txt.gz 2026-03-06 17:35:42,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:35:43,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:35:43,070 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69ab077f27cb11dcdfc75bd6/lava-logs.yaml 2026-03-06 17:35:43,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:35:43,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:35:43,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69ab077f27cb11dcdfc75bd6/lava_callback.json.gz 2026-03-06 17:35:43,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:35:43,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077f27cb11dcdfc75bd6 HTTP/1.1" 200 None 2026-03-06 17:35:43,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:35:43,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:35:43,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:35:43,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab077f27cb11dcdfc75bd6 HTTP/1.1" 200 None 2026-03-06 17:35:43,351 - lava_callback - INFO - Completed processing callback for node 69ab077f27cb11dcdfc75bd6 INFO: 172.21.0.1:53384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50748 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:35:57,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:35:57,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60610 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:36:32,471 - lava_callback - INFO - Received callback for node 69ab077c27cb11dcdfc75bd0 INFO: 172.21.0.1:39684 - "POST /node/69ab077c27cb11dcdfc75bd0 HTTP/1.0" 202 Accepted 2026-03-06 17:36:32,479 - lava_callback - INFO - Starting async job submit for node 69ab077c27cb11dcdfc75bd0 2026-03-06 17:36:32,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:32,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077c27cb11dcdfc75bd0 HTTP/1.1" 200 None 2026-03-06 17:36:32,530 - lava_callback - DEBUG - Processing node 69ab077c27cb11dcdfc75bd0: ltp-input 2026-03-06 17:36:33,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:36:33,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:36:33,489 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69ab077c27cb11dcdfc75bd0/log.txt.gz 2026-03-06 17:36:33,860 - lava_callback - INFO - Received callback for node 69ab0c2327cb11dcdfc75f1e INFO: 172.21.0.1:39696 - "POST /node/69ab0c2327cb11dcdfc75f1e HTTP/1.0" 202 Accepted 2026-03-06 17:36:33,909 - lava_callback - INFO - Starting async job submit for node 69ab0c2327cb11dcdfc75f1e 2026-03-06 17:36:34,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:34,125 - lava_callback - INFO - Received callback for node 69ab078427cb11dcdfc75bdd 2026-03-06 17:36:34,146 - lava_callback - INFO - Starting async job submit for node 69ab078427cb11dcdfc75bdd INFO: 172.21.0.1:39710 - "POST /node/69ab078427cb11dcdfc75bdd HTTP/1.0" 202 Accepted 2026-03-06 17:36:34,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:36:34,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab0c2327cb11dcdfc75f1e HTTP/1.1" 200 None 2026-03-06 17:36:34,174 - lava_callback - DEBUG - Processing node 69ab0c2327cb11dcdfc75f1e: baseline-arm-clabbe 2026-03-06 17:36:34,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:34,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab078427cb11dcdfc75bdd HTTP/1.1" 200 None 2026-03-06 17:36:34,342 - lava_callback - DEBUG - Processing node 69ab078427cb11dcdfc75bdd: ltp-smoke 2026-03-06 17:36:34,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:36:34,752 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69ab077c27cb11dcdfc75bd0/lava-logs.yaml 2026-03-06 17:36:34,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:36:34,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:36:35,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:36:35,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:36:35,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab0c2327cb11dcdfc75f1e/log.txt.gz 2026-03-06 17:36:35,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:36:35,313 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69ab077c27cb11dcdfc75bd0/lava_callback.json.gz 2026-03-06 17:36:35,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:36:35,402 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab078427cb11dcdfc75bdd/log.txt.gz 2026-03-06 17:36:35,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:35,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab077c27cb11dcdfc75bd0 HTTP/1.1" 200 None 2026-03-06 17:36:35,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:36:35,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:35,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:36:35,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:35,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab077c27cb11dcdfc75bd0 HTTP/1.1" 200 None 2026-03-06 17:36:35,806 - lava_callback - INFO - Completed processing callback for node 69ab077c27cb11dcdfc75bd0 2026-03-06 17:36:35,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:36:36,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:36:36,311 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab0c2327cb11dcdfc75f1e/lava-logs.yaml 2026-03-06 17:36:36,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:36:36,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:36:36,357 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab078427cb11dcdfc75bdd/lava-logs.yaml 2026-03-06 17:36:36,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:36:36,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:36:36,494 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab0c2327cb11dcdfc75f1e/lava_callback.json.gz INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:36:36,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 DEBUG: Setup failed for 69ab0c2327cb11dcdfc75f1e. Transitting job node result: incomplete -> fail 2026-03-06 17:36:36,569 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab078427cb11dcdfc75bdd/lava_callback.json.gz 2026-03-06 17:36:36,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:36,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:36,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab0c2327cb11dcdfc75f1e HTTP/1.1" 200 None 2026-03-06 17:36:36,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:36,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab078427cb11dcdfc75bdd HTTP/1.1" 200 None 2026-03-06 17:36:36,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:36,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:36:36,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:36,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:36:36,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:36,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab078427cb11dcdfc75bdd HTTP/1.1" 200 None 2026-03-06 17:36:36,698 - lava_callback - INFO - Completed processing callback for node 69ab078427cb11dcdfc75bdd 2026-03-06 17:36:36,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab0c2327cb11dcdfc75f1e HTTP/1.1" 200 None 2026-03-06 17:36:36,853 - lava_callback - INFO - Completed processing callback for node 69ab0c2327cb11dcdfc75f1e INFO: 172.21.0.1:42698 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:36:50,625 - lava_callback - INFO - Received callback for node 69a86dab440c1da21c23821c INFO: 172.21.0.1:53644 - "POST /node/69a86dab440c1da21c23821c HTTP/1.0" 202 Accepted 2026-03-06 17:36:50,636 - lava_callback - INFO - Starting async job submit for node 69a86dab440c1da21c23821c 2026-03-06 17:36:50,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:50,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86dab440c1da21c23821c HTTP/1.1" 200 None 2026-03-06 17:36:50,663 - lava_callback - DEBUG - Processing node 69a86dab440c1da21c23821c: baseline-arm64-baylibre 2026-03-06 17:36:50,663 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a86dab440c1da21c23821c 2026-03-06 17:36:50,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:50,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86dab440c1da21c23821c HTTP/1.1" 200 None 2026-03-06 17:36:50,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:50,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 17:36:50,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:50,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a86dab440c1da21c23821c HTTP/1.1" 200 None 2026-03-06 17:36:50,760 - lava_callback - ERROR - Error processing callback for node 69a86dab440c1da21c23821c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53654 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:36:57,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:36:57,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37300 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:38:30,696 - lava_callback - INFO - Received callback for node 69a86e05440c1da21c238247 INFO: 172.21.0.1:42186 - "POST /node/69a86e05440c1da21c238247 HTTP/1.0" 202 Accepted 2026-03-06 17:38:30,702 - lava_callback - INFO - Starting async job submit for node 69a86e05440c1da21c238247 2026-03-06 17:38:30,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:38:30,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86e05440c1da21c238247 HTTP/1.1" 200 None 2026-03-06 17:38:30,717 - lava_callback - DEBUG - Processing node 69a86e05440c1da21c238247: baseline-arm64-baylibre 2026-03-06 17:38:30,717 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a86e05440c1da21c238247 2026-03-06 17:38:30,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:38:30,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86e05440c1da21c238247 HTTP/1.1" 200 None 2026-03-06 17:38:30,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:38:30,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 17:38:30,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:38:30,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a86e05440c1da21c238247 HTTP/1.1" 200 None 2026-03-06 17:38:30,772 - lava_callback - ERROR - Error processing callback for node 69a86e05440c1da21c238247: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:39:12,803 - lava_callback - INFO - Received callback for node 69ab078227cb11dcdfc75bd9 INFO: 172.21.0.1:53628 - "POST /node/69ab078227cb11dcdfc75bd9 HTTP/1.0" 202 Accepted 2026-03-06 17:39:12,809 - lava_callback - INFO - Starting async job submit for node 69ab078227cb11dcdfc75bd9 2026-03-06 17:39:12,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:39:12,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab078227cb11dcdfc75bd9 HTTP/1.1" 200 None 2026-03-06 17:39:12,876 - lava_callback - DEBUG - Processing node 69ab078227cb11dcdfc75bd9: ltp-sched 2026-03-06 17:39:13,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:39:13,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:39:13,423 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69ab078227cb11dcdfc75bd9/log.txt.gz 2026-03-06 17:39:13,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:39:13,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:39:13,883 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69ab078227cb11dcdfc75bd9/lava-logs.yaml 2026-03-06 17:39:13,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:39:14,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:39:14,067 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69ab078227cb11dcdfc75bd9/lava_callback.json.gz 2026-03-06 17:39:14,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:39:14,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab078227cb11dcdfc75bd9 HTTP/1.1" 200 None 2026-03-06 17:39:14,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:39:14,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:39:14,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:39:14,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab078227cb11dcdfc75bd9 HTTP/1.1" 200 None 2026-03-06 17:39:14,183 - lava_callback - INFO - Completed processing callback for node 69ab078227cb11dcdfc75bd9 INFO: 172.21.0.1:53640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43412 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:39:27,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:39:27,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46972 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:39:42,071 - lava_callback - INFO - Received callback for node 69ab078827cb11dcdfc75be8 INFO: 172.21.0.1:59786 - "POST /node/69ab078827cb11dcdfc75be8 HTTP/1.0" 202 Accepted 2026-03-06 17:39:42,077 - lava_callback - INFO - Starting async job submit for node 69ab078827cb11dcdfc75be8 2026-03-06 17:39:42,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:39:42,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab078827cb11dcdfc75be8 HTTP/1.1" 200 None 2026-03-06 17:39:42,117 - lava_callback - DEBUG - Processing node 69ab078827cb11dcdfc75be8: ltp-timers 2026-03-06 17:39:42,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:39:42,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:39:42,602 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69ab078827cb11dcdfc75be8/log.txt.gz 2026-03-06 17:39:42,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:39:43,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:39:43,036 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69ab078827cb11dcdfc75be8/lava-logs.yaml 2026-03-06 17:39:43,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:39:43,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:39:43,198 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69ab078827cb11dcdfc75be8/lava_callback.json.gz 2026-03-06 17:39:43,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:39:43,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab078827cb11dcdfc75be8 HTTP/1.1" 200 None 2026-03-06 17:39:43,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:39:43,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:39:43,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:39:43,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab078827cb11dcdfc75be8 HTTP/1.1" 200 None 2026-03-06 17:39:43,297 - lava_callback - INFO - Completed processing callback for node 69ab078827cb11dcdfc75be8 INFO: 172.21.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44640 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:39:57,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:39:57,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52300 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:40:32,649 - lava_callback - INFO - Received callback for node 69ab078a27cb11dcdfc75beb INFO: 172.21.0.1:60316 - "POST /node/69ab078a27cb11dcdfc75beb HTTP/1.0" 202 Accepted 2026-03-06 17:40:32,656 - lava_callback - INFO - Starting async job submit for node 69ab078a27cb11dcdfc75beb 2026-03-06 17:40:32,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:40:32,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab078a27cb11dcdfc75beb HTTP/1.1" 200 None 2026-03-06 17:40:32,696 - lava_callback - DEBUG - Processing node 69ab078a27cb11dcdfc75beb: ltp-watchqueue 2026-03-06 17:40:33,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:40:33,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:40:33,317 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ab078a27cb11dcdfc75beb/log.txt.gz 2026-03-06 17:40:33,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:40:33,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:40:33,795 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ab078a27cb11dcdfc75beb/lava-logs.yaml 2026-03-06 17:40:33,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:40:34,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:40:34,030 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ab078a27cb11dcdfc75beb/lava_callback.json.gz 2026-03-06 17:40:34,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:40:34,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab078a27cb11dcdfc75beb HTTP/1.1" 200 None 2026-03-06 17:40:34,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:40:34,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:40:34,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:40:34,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab078a27cb11dcdfc75beb HTTP/1.1" 200 None 2026-03-06 17:40:34,122 - lava_callback - INFO - Completed processing callback for node 69ab078a27cb11dcdfc75beb INFO: 172.21.0.1:60318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59950 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:40:57,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:40:57,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:48:02,598 - lava_callback - INFO - Received callback for node 69ab0f3127cb11dcdfc7601a INFO: 172.21.0.1:47216 - "POST /node/69ab0f3127cb11dcdfc7601a HTTP/1.0" 202 Accepted 2026-03-06 17:48:02,604 - lava_callback - INFO - Starting async job submit for node 69ab0f3127cb11dcdfc7601a 2026-03-06 17:48:02,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:48:02,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab0f3127cb11dcdfc7601a HTTP/1.1" 200 None 2026-03-06 17:48:02,682 - lava_callback - DEBUG - Processing node 69ab0f3127cb11dcdfc7601a: ltp-smoke 2026-03-06 17:48:03,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:48:03,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:48:03,339 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab0f3127cb11dcdfc7601a/log.txt.gz 2026-03-06 17:48:03,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:48:03,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:48:03,856 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab0f3127cb11dcdfc7601a/lava-logs.yaml 2026-03-06 17:48:03,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:48:04,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:48:04,050 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab0f3127cb11dcdfc7601a/lava_callback.json.gz 2026-03-06 17:48:04,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:48:04,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab0f3127cb11dcdfc7601a HTTP/1.1" 200 None 2026-03-06 17:48:04,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:48:04,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe9427cb11dcdfc758e6 HTTP/1.1" 200 None 2026-03-06 17:48:04,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:48:04,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab0f3127cb11dcdfc7601a HTTP/1.1" 200 None 2026-03-06 17:48:04,342 - lava_callback - INFO - Completed processing callback for node 69ab0f3127cb11dcdfc7601a INFO: 172.21.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58206 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:48:27,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:48:27,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54852 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:50:01,137 - lava_callback - INFO - Received callback for node 69ab0fe327cb11dcdfc76064 INFO: 172.21.0.1:47246 - "POST /node/69ab0fe327cb11dcdfc76064 HTTP/1.0" 202 Accepted 2026-03-06 17:50:01,144 - lava_callback - INFO - Starting async job submit for node 69ab0fe327cb11dcdfc76064 2026-03-06 17:50:01,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:50:01,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab0fe327cb11dcdfc76064 HTTP/1.1" 200 None 2026-03-06 17:50:01,213 - lava_callback - DEBUG - Processing node 69ab0fe327cb11dcdfc76064: baseline-arm 2026-03-06 17:50:01,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:50:01,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:50:01,973 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab0fe327cb11dcdfc76064/log.txt.gz 2026-03-06 17:50:02,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:50:02,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:50:02,591 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab0fe327cb11dcdfc76064/lava-logs.yaml 2026-03-06 17:50:02,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:50:02,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:50:02,792 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab0fe327cb11dcdfc76064/lava_callback.json.gz DEBUG: Setup failed for 69ab0fe327cb11dcdfc76064. Transitting job node result: incomplete -> fail 2026-03-06 17:50:02,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:50:02,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab0fe327cb11dcdfc76064 HTTP/1.1" 200 None 2026-03-06 17:50:02,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:50:02,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:50:02,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:50:02,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab0fe327cb11dcdfc76064 HTTP/1.1" 200 None 2026-03-06 17:50:03,074 - lava_callback - INFO - Completed processing callback for node 69ab0fe327cb11dcdfc76064 INFO: 172.21.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:50:27,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:50:27,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47948 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:53:32,308 - lava_callback - INFO - Received callback for node 69ab075c27cb11dcdfc75b79 INFO: 172.21.0.1:37090 - "POST /node/69ab075c27cb11dcdfc75b79 HTTP/1.0" 202 Accepted 2026-03-06 17:53:32,357 - lava_callback - INFO - Starting async job submit for node 69ab075c27cb11dcdfc75b79 2026-03-06 17:53:32,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:53:32,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab075c27cb11dcdfc75b79 HTTP/1.1" 200 None 2026-03-06 17:53:32,434 - lava_callback - DEBUG - Processing node 69ab075c27cb11dcdfc75b79: baseline-arm-pengutronix 2026-03-06 17:53:32,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:53:32,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:53:32,689 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab075c27cb11dcdfc75b79/log.txt.gz 2026-03-06 17:53:32,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:53:32,933 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:53:32,935 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab075c27cb11dcdfc75b79/lava-logs.yaml 2026-03-06 17:53:32,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:53:33,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:53:33,081 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab075c27cb11dcdfc75b79/lava_callback.json.gz DEBUG: Setup failed for 69ab075c27cb11dcdfc75b79. Transitting job node result: incomplete -> fail 2026-03-06 17:53:33,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:53:33,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab075c27cb11dcdfc75b79 HTTP/1.1" 200 None 2026-03-06 17:53:33,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:53:33,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:53:33,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:53:33,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab075c27cb11dcdfc75b79 HTTP/1.1" 200 None 2026-03-06 17:53:33,231 - lava_callback - INFO - Completed processing callback for node 69ab075c27cb11dcdfc75b79 INFO: 172.21.0.1:37106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39892 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:53:57,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:53:57,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:54:32,757 - lava_callback - INFO - Received callback for node 69ab078727cb11dcdfc75be4 INFO: 172.21.0.1:37620 - "POST /node/69ab078727cb11dcdfc75be4 HTTP/1.0" 202 Accepted 2026-03-06 17:54:32,805 - lava_callback - INFO - Starting async job submit for node 69ab078727cb11dcdfc75be4 2026-03-06 17:54:32,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:54:32,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab078727cb11dcdfc75be4 HTTP/1.1" 200 None 2026-03-06 17:54:32,862 - lava_callback - DEBUG - Processing node 69ab078727cb11dcdfc75be4: ltp-syscalls-ipc 2026-03-06 17:54:32,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:54:33,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:54:33,079 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ab078727cb11dcdfc75be4/log.txt.gz 2026-03-06 17:54:33,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:54:33,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:54:33,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ab078727cb11dcdfc75be4/lava-logs.yaml 2026-03-06 17:54:33,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:54:33,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:54:33,438 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ab078727cb11dcdfc75be4/lava_callback.json.gz 2026-03-06 17:54:33,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:54:33,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab078727cb11dcdfc75be4 HTTP/1.1" 200 None 2026-03-06 17:54:33,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:54:33,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:54:33,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:54:33,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab078727cb11dcdfc75be4 HTTP/1.1" 200 None 2026-03-06 17:54:33,588 - lava_callback - INFO - Completed processing callback for node 69ab078727cb11dcdfc75be4 INFO: 172.21.0.1:37624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36166 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:54:57,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:54:57,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44702 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:56:34,001 - lava_callback - INFO - Received callback for node 69ab10b427cb11dcdfc760d1 INFO: 172.21.0.1:55108 - "POST /node/69ab10b427cb11dcdfc760d1 HTTP/1.0" 202 Accepted 2026-03-06 17:56:34,007 - lava_callback - INFO - Starting async job submit for node 69ab10b427cb11dcdfc760d1 2026-03-06 17:56:34,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:56:34,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab10b427cb11dcdfc760d1 HTTP/1.1" 200 None 2026-03-06 17:56:34,055 - lava_callback - DEBUG - Processing node 69ab10b427cb11dcdfc760d1: baseline-arm-clabbe 2026-03-06 17:56:34,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:56:34,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:56:34,421 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab10b427cb11dcdfc760d1/log.txt.gz 2026-03-06 17:56:34,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:56:34,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:56:34,734 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab10b427cb11dcdfc760d1/lava-logs.yaml 2026-03-06 17:56:34,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:56:34,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:56:34,861 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab10b427cb11dcdfc760d1/lava_callback.json.gz DEBUG: Setup failed for 69ab10b427cb11dcdfc760d1. Transitting job node result: incomplete -> fail 2026-03-06 17:56:34,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:56:34,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab10b427cb11dcdfc760d1 HTTP/1.1" 200 None 2026-03-06 17:56:34,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:56:34,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:56:34,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:56:35,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab10b427cb11dcdfc760d1 HTTP/1.1" 200 None 2026-03-06 17:56:35,073 - lava_callback - INFO - Completed processing callback for node 69ab10b427cb11dcdfc760d1 INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:56:57,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:56:57,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:59:42,945 - lava_callback - INFO - Received callback for node 69ab14fb27cb11dcdfc765d6 INFO: 172.21.0.1:54946 - "POST /node/69ab14fb27cb11dcdfc765d6 HTTP/1.0" 202 Accepted 2026-03-06 17:59:42,952 - lava_callback - INFO - Starting async job submit for node 69ab14fb27cb11dcdfc765d6 2026-03-06 17:59:42,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:59:42,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab14fb27cb11dcdfc765d6 HTTP/1.1" 200 None 2026-03-06 17:59:42,993 - lava_callback - DEBUG - Processing node 69ab14fb27cb11dcdfc765d6: ltp-syscalls-ipc 2026-03-06 17:59:43,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:59:43,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:59:43,634 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ab14fb27cb11dcdfc765d6/log.txt.gz 2026-03-06 17:59:43,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:59:44,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:59:44,052 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ab14fb27cb11dcdfc765d6/lava-logs.yaml 2026-03-06 17:59:44,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 17:59:44,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 17:59:44,230 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ab14fb27cb11dcdfc765d6/lava_callback.json.gz 2026-03-06 17:59:44,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:59:44,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab14fb27cb11dcdfc765d6 HTTP/1.1" 200 None 2026-03-06 17:59:44,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:59:44,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 17:59:44,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:59:44,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab14fb27cb11dcdfc765d6 HTTP/1.1" 200 None 2026-03-06 17:59:44,325 - lava_callback - INFO - Completed processing callback for node 69ab14fb27cb11dcdfc765d6 INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44408 - "GET / HTTP/1.0" 200 OK 2026-03-06 17:59:57,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 17:59:58,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33650 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:03:11,952 - lava_callback - INFO - Received callback for node 69a873d3440c1da21c23849d INFO: 172.21.0.1:55600 - "POST /node/69a873d3440c1da21c23849d HTTP/1.0" 202 Accepted 2026-03-06 18:03:11,958 - lava_callback - INFO - Starting async job submit for node 69a873d3440c1da21c23849d 2026-03-06 18:03:11,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:03:11,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a873d3440c1da21c23849d HTTP/1.1" 200 None 2026-03-06 18:03:11,974 - lava_callback - DEBUG - Processing node 69a873d3440c1da21c23849d: baseline-arm64-baylibre 2026-03-06 18:03:11,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a873d3440c1da21c23849d 2026-03-06 18:03:11,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:03:11,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a873d3440c1da21c23849d HTTP/1.1" 200 None 2026-03-06 18:03:11,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:03:12,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750ca5a0c0e10c481a7c4 HTTP/1.1" 200 None 2026-03-06 18:03:12,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:03:12,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a873d3440c1da21c23849d HTTP/1.1" 200 None 2026-03-06 18:03:12,050 - lava_callback - ERROR - Error processing callback for node 69a873d3440c1da21c23849d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60516 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:05:23,121 - lava_callback - INFO - Received callback for node 69ab135527cb11dcdfc76553 INFO: 172.21.0.1:50956 - "POST /node/69ab135527cb11dcdfc76553 HTTP/1.0" 202 Accepted 2026-03-06 18:05:23,127 - lava_callback - INFO - Starting async job submit for node 69ab135527cb11dcdfc76553 2026-03-06 18:05:23,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:05:23,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab135527cb11dcdfc76553 HTTP/1.1" 200 None 2026-03-06 18:05:23,219 - lava_callback - DEBUG - Processing node 69ab135527cb11dcdfc76553: ltp-smoke 2026-03-06 18:05:23,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:05:23,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:05:23,826 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab135527cb11dcdfc76553/log.txt.gz 2026-03-06 18:05:24,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:05:24,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:05:24,377 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab135527cb11dcdfc76553/lava-logs.yaml 2026-03-06 18:05:24,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:05:24,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:05:24,563 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab135527cb11dcdfc76553/lava_callback.json.gz 2026-03-06 18:05:24,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:05:24,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab135527cb11dcdfc76553 HTTP/1.1" 200 None 2026-03-06 18:05:24,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:05:24,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe9427cb11dcdfc758e6 HTTP/1.1" 200 None 2026-03-06 18:05:24,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:05:24,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab135527cb11dcdfc76553 HTTP/1.1" 200 None 2026-03-06 18:05:24,858 - lava_callback - INFO - Completed processing callback for node 69ab135527cb11dcdfc76553 INFO: 172.21.0.1:50966 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:05:28,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:05:28,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:06:30,243 - lava_callback - INFO - Received callback for node 69ab13cc27cb11dcdfc7656f INFO: 172.21.0.1:51102 - "POST /node/69ab13cc27cb11dcdfc7656f HTTP/1.0" 202 Accepted 2026-03-06 18:06:30,250 - lava_callback - INFO - Starting async job submit for node 69ab13cc27cb11dcdfc7656f 2026-03-06 18:06:30,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:06:30,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab13cc27cb11dcdfc7656f HTTP/1.1" 200 None 2026-03-06 18:06:30,319 - lava_callback - DEBUG - Processing node 69ab13cc27cb11dcdfc7656f: baseline-arm 2026-03-06 18:06:30,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:06:31,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:06:31,037 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab13cc27cb11dcdfc7656f/log.txt.gz 2026-03-06 18:06:31,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:06:31,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:06:31,820 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab13cc27cb11dcdfc7656f/lava-logs.yaml 2026-03-06 18:06:31,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:06:32,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:06:32,004 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab13cc27cb11dcdfc7656f/lava_callback.json.gz DEBUG: Setup failed for 69ab13cc27cb11dcdfc7656f. Transitting job node result: incomplete -> fail 2026-03-06 18:06:32,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:06:32,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab13cc27cb11dcdfc7656f HTTP/1.1" 200 None 2026-03-06 18:06:32,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:06:32,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 18:06:32,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:06:32,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab13cc27cb11dcdfc7656f HTTP/1.1" 200 None 2026-03-06 18:06:32,289 - lava_callback - INFO - Completed processing callback for node 69ab13cc27cb11dcdfc7656f INFO: 172.21.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:06:58,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:06:58,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54928 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:07:52,160 - lava_callback - INFO - Received callback for node 69a874e9440c1da21c2384f7 INFO: 172.21.0.1:54944 - "POST /node/69a874e9440c1da21c2384f7 HTTP/1.0" 202 Accepted 2026-03-06 18:07:52,165 - lava_callback - INFO - Starting async job submit for node 69a874e9440c1da21c2384f7 2026-03-06 18:07:52,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:07:52,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a874e9440c1da21c2384f7 HTTP/1.1" 200 None 2026-03-06 18:07:52,182 - lava_callback - DEBUG - Processing node 69a874e9440c1da21c2384f7: baseline-arm64-baylibre 2026-03-06 18:07:52,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a874e9440c1da21c2384f7 2026-03-06 18:07:52,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:07:52,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a874e9440c1da21c2384f7 HTTP/1.1" 200 None 2026-03-06 18:07:52,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:07:52,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750ca5a0c0e10c481a7c4 HTTP/1.1" 200 None 2026-03-06 18:07:52,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:07:52,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a874e9440c1da21c2384f7 HTTP/1.1" 200 None 2026-03-06 18:07:52,239 - lava_callback - ERROR - Error processing callback for node 69a874e9440c1da21c2384f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33992 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:10:12,261 - lava_callback - INFO - Received callback for node 69a87573440c1da21c238529 INFO: 172.21.0.1:32996 - "POST /node/69a87573440c1da21c238529 HTTP/1.0" 202 Accepted 2026-03-06 18:10:12,266 - lava_callback - INFO - Starting async job submit for node 69a87573440c1da21c238529 2026-03-06 18:10:12,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:10:12,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a87573440c1da21c238529 HTTP/1.1" 200 None 2026-03-06 18:10:12,283 - lava_callback - DEBUG - Processing node 69a87573440c1da21c238529: baseline-arm64-baylibre 2026-03-06 18:10:12,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a87573440c1da21c238529 2026-03-06 18:10:12,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:10:12,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a87573440c1da21c238529 HTTP/1.1" 200 None 2026-03-06 18:10:12,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:10:12,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750ca5a0c0e10c481a7c4 HTTP/1.1" 200 None 2026-03-06 18:10:12,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:10:12,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a87573440c1da21c238529 HTTP/1.1" 200 None 2026-03-06 18:10:12,366 - lava_callback - ERROR - Error processing callback for node 69a87573440c1da21c238529: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44950 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:13:13,232 - lava_callback - INFO - Received callback for node 69ab14a927cb11dcdfc76599 INFO: 172.21.0.1:44690 - "POST /node/69ab14a927cb11dcdfc76599 HTTP/1.0" 202 Accepted 2026-03-06 18:13:13,281 - lava_callback - INFO - Starting async job submit for node 69ab14a927cb11dcdfc76599 2026-03-06 18:13:13,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:13:13,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab14a927cb11dcdfc76599 HTTP/1.1" 200 None 2026-03-06 18:13:13,322 - lava_callback - DEBUG - Processing node 69ab14a927cb11dcdfc76599: baseline-arm-pengutronix 2026-03-06 18:13:13,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:13:13,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:13:13,596 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab14a927cb11dcdfc76599/log.txt.gz 2026-03-06 18:13:13,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:13:13,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:13:13,866 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab14a927cb11dcdfc76599/lava-logs.yaml 2026-03-06 18:13:13,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:13:14,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:13:14,025 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab14a927cb11dcdfc76599/lava_callback.json.gz DEBUG: Setup failed for 69ab14a927cb11dcdfc76599. Transitting job node result: incomplete -> fail 2026-03-06 18:13:14,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:13:14,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab14a927cb11dcdfc76599 HTTP/1.1" 200 None 2026-03-06 18:13:14,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:13:14,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 18:13:14,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:13:14,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab14a927cb11dcdfc76599 HTTP/1.1" 200 None 2026-03-06 18:13:14,274 - lava_callback - INFO - Completed processing callback for node 69ab14a927cb11dcdfc76599 INFO: 172.21.0.1:44706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53440 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:13:28,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:13:28,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50992 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:16:13,955 - lava_callback - INFO - Received callback for node 69ab155b27cb11dcdfc765e4 INFO: 172.21.0.1:58884 - "POST /node/69ab155b27cb11dcdfc765e4 HTTP/1.0" 202 Accepted 2026-03-06 18:16:13,961 - lava_callback - INFO - Starting async job submit for node 69ab155b27cb11dcdfc765e4 2026-03-06 18:16:13,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:16:14,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab155b27cb11dcdfc765e4 HTTP/1.1" 200 None 2026-03-06 18:16:14,009 - lava_callback - DEBUG - Processing node 69ab155b27cb11dcdfc765e4: baseline-arm-clabbe 2026-03-06 18:16:14,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:16:14,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:16:14,364 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab155b27cb11dcdfc765e4/log.txt.gz 2026-03-06 18:16:14,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:16:14,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:16:14,691 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab155b27cb11dcdfc765e4/lava-logs.yaml 2026-03-06 18:16:14,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:16:14,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:16:14,845 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab155b27cb11dcdfc765e4/lava_callback.json.gz DEBUG: Setup failed for 69ab155b27cb11dcdfc765e4. Transitting job node result: incomplete -> fail 2026-03-06 18:16:14,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:16:14,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab155b27cb11dcdfc765e4 HTTP/1.1" 200 None 2026-03-06 18:16:14,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:16:14,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 18:16:14,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:16:14,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab155b27cb11dcdfc765e4 HTTP/1.1" 200 None 2026-03-06 18:16:15,053 - lava_callback - INFO - Completed processing callback for node 69ab155b27cb11dcdfc765e4 INFO: 172.21.0.1:58892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37034 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:16:28,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:16:28,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43264 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:26:13,276 - lava_callback - INFO - Received callback for node 69a8793a440c1da21c23868c INFO: 172.21.0.1:52120 - "POST /node/69a8793a440c1da21c23868c HTTP/1.0" 202 Accepted 2026-03-06 18:26:13,282 - lava_callback - INFO - Starting async job submit for node 69a8793a440c1da21c23868c 2026-03-06 18:26:13,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:26:13,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8793a440c1da21c23868c HTTP/1.1" 200 None 2026-03-06 18:26:13,298 - lava_callback - DEBUG - Processing node 69a8793a440c1da21c23868c: baseline-arm64-baylibre 2026-03-06 18:26:13,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8793a440c1da21c23868c 2026-03-06 18:26:13,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:26:13,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8793a440c1da21c23868c HTTP/1.1" 200 None 2026-03-06 18:26:13,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:26:13,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-06 18:26:13,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:26:13,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8793a440c1da21c23868c HTTP/1.1" 200 None 2026-03-06 18:26:13,379 - lava_callback - ERROR - Error processing callback for node 69a8793a440c1da21c23868c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33524 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:32:55,009 - lava_callback - INFO - Received callback for node 69ab194927cb11dcdfc766f1 INFO: 172.21.0.1:33536 - "POST /node/69ab194927cb11dcdfc766f1 HTTP/1.0" 202 Accepted 2026-03-06 18:32:55,057 - lava_callback - INFO - Starting async job submit for node 69ab194927cb11dcdfc766f1 2026-03-06 18:32:55,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:32:55,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab194927cb11dcdfc766f1 HTTP/1.1" 200 None 2026-03-06 18:32:55,097 - lava_callback - DEBUG - Processing node 69ab194927cb11dcdfc766f1: baseline-arm-pengutronix 2026-03-06 18:32:55,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:32:55,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:32:55,343 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab194927cb11dcdfc766f1/log.txt.gz 2026-03-06 18:32:55,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:32:55,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:32:55,582 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab194927cb11dcdfc766f1/lava-logs.yaml 2026-03-06 18:32:55,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:32:55,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:32:55,730 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab194927cb11dcdfc766f1/lava_callback.json.gz DEBUG: Setup failed for 69ab194927cb11dcdfc766f1. Transitting job node result: incomplete -> fail 2026-03-06 18:32:55,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:32:55,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab194927cb11dcdfc766f1 HTTP/1.1" 200 None 2026-03-06 18:32:55,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:32:55,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 18:32:55,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:32:55,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab194927cb11dcdfc766f1 HTTP/1.1" 200 None 2026-03-06 18:32:55,901 - lava_callback - INFO - Completed processing callback for node 69ab194927cb11dcdfc766f1 INFO: 172.21.0.1:33546 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:32:58,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:32:58,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:37:54,094 - lava_callback - INFO - Received callback for node 69a87bee440c1da21c238786 INFO: 172.21.0.1:57006 - "POST /node/69a87bee440c1da21c238786 HTTP/1.0" 202 Accepted 2026-03-06 18:37:54,100 - lava_callback - INFO - Starting async job submit for node 69a87bee440c1da21c238786 2026-03-06 18:37:54,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:37:54,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a87bee440c1da21c238786 HTTP/1.1" 200 None 2026-03-06 18:37:54,116 - lava_callback - DEBUG - Processing node 69a87bee440c1da21c238786: baseline-arm64-baylibre 2026-03-06 18:37:54,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a87bee440c1da21c238786 2026-03-06 18:37:54,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:37:54,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a87bee440c1da21c238786 HTTP/1.1" 200 None 2026-03-06 18:37:54,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:37:54,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-06 18:37:54,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:37:54,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a87bee440c1da21c238786 HTTP/1.1" 200 None 2026-03-06 18:37:54,166 - lava_callback - ERROR - Error processing callback for node 69a87bee440c1da21c238786: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49616 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:40:53,967 - lava_callback - INFO - Received callback for node 69a87ca0440c1da21c2387cf INFO: 172.21.0.1:49624 - "POST /node/69a87ca0440c1da21c2387cf HTTP/1.0" 202 Accepted 2026-03-06 18:40:53,973 - lava_callback - INFO - Starting async job submit for node 69a87ca0440c1da21c2387cf 2026-03-06 18:40:53,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:40:53,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a87ca0440c1da21c2387cf HTTP/1.1" 200 None 2026-03-06 18:40:53,989 - lava_callback - DEBUG - Processing node 69a87ca0440c1da21c2387cf: baseline-arm64-baylibre 2026-03-06 18:40:53,989 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a87ca0440c1da21c2387cf 2026-03-06 18:40:53,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:40:54,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a87ca0440c1da21c2387cf HTTP/1.1" 200 None 2026-03-06 18:40:54,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:40:54,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-06 18:40:54,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:40:54,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a87ca0440c1da21c2387cf HTTP/1.1" 200 None 2026-03-06 18:40:54,047 - lava_callback - ERROR - Error processing callback for node 69a87ca0440c1da21c2387cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:48:14,400 - lava_callback - INFO - Received callback for node 69a87e5f440c1da21c238865 INFO: 172.21.0.1:38674 - "POST /node/69a87e5f440c1da21c238865 HTTP/1.0" 202 Accepted 2026-03-06 18:48:14,406 - lava_callback - INFO - Starting async job submit for node 69a87e5f440c1da21c238865 2026-03-06 18:48:14,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:48:14,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a87e5f440c1da21c238865 HTTP/1.1" 200 None 2026-03-06 18:48:14,432 - lava_callback - DEBUG - Processing node 69a87e5f440c1da21c238865: baseline-arm64-baylibre 2026-03-06 18:48:14,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a87e5f440c1da21c238865 2026-03-06 18:48:14,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:48:14,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a87e5f440c1da21c238865 HTTP/1.1" 200 None 2026-03-06 18:48:14,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:48:14,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-06 18:48:14,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:48:14,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a87e5f440c1da21c238865 HTTP/1.1" 200 None 2026-03-06 18:48:14,492 - lava_callback - ERROR - Error processing callback for node 69a87e5f440c1da21c238865: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37114 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:52:35,514 - lava_callback - INFO - Received callback for node 69ab1de527cb11dcdfc767f3 INFO: 172.21.0.1:60910 - "POST /node/69ab1de527cb11dcdfc767f3 HTTP/1.0" 202 Accepted 2026-03-06 18:52:35,561 - lava_callback - INFO - Starting async job submit for node 69ab1de527cb11dcdfc767f3 2026-03-06 18:52:35,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:52:35,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab1de527cb11dcdfc767f3 HTTP/1.1" 200 None 2026-03-06 18:52:35,600 - lava_callback - DEBUG - Processing node 69ab1de527cb11dcdfc767f3: baseline-arm-pengutronix 2026-03-06 18:52:35,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:52:35,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:52:35,850 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab1de527cb11dcdfc767f3/log.txt.gz 2026-03-06 18:52:35,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:52:36,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:52:36,085 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab1de527cb11dcdfc767f3/lava-logs.yaml 2026-03-06 18:52:36,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 18:52:36,218 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 18:52:36,219 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab1de527cb11dcdfc767f3/lava_callback.json.gz DEBUG: Setup failed for 69ab1de527cb11dcdfc767f3. Transitting job node result: incomplete -> fail 2026-03-06 18:52:36,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:52:36,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab1de527cb11dcdfc767f3 HTTP/1.1" 200 None 2026-03-06 18:52:36,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:52:36,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafe8b27cb11dcdfc758da HTTP/1.1" 200 None 2026-03-06 18:52:36,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:52:36,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab1de527cb11dcdfc767f3 HTTP/1.1" 200 None 2026-03-06 18:52:36,389 - lava_callback - INFO - Completed processing callback for node 69ab1de527cb11dcdfc767f3 INFO: 172.21.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49736 - "GET / HTTP/1.0" 200 OK 2026-03-06 18:52:58,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 18:52:58,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37152 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:01:18,089 - lava_callback - INFO - Received callback for node 69ab245e27cb11dcdfc76a35 INFO: 172.21.0.1:37168 - "POST /node/69ab245e27cb11dcdfc76a35 HTTP/1.0" 202 Accepted 2026-03-06 19:01:18,095 - lava_callback - INFO - Starting async job submit for node 69ab245e27cb11dcdfc76a35 2026-03-06 19:01:18,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:01:18,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab245e27cb11dcdfc76a35 HTTP/1.1" 200 None 2026-03-06 19:01:18,114 - lava_callback - DEBUG - Processing node 69ab245e27cb11dcdfc76a35: baseline-x86 2026-03-06 19:01:18,119 - lava_callback - WARNING - Failed to upload log 2026-03-06 19:01:18,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:01:18,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:01:18,356 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab245e27cb11dcdfc76a35/lava-logs.yaml 2026-03-06 19:01:18,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:01:18,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:01:18,494 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab245e27cb11dcdfc76a35/lava_callback.json.gz 2026-03-06 19:01:18,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:01:18,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab245e27cb11dcdfc76a35 HTTP/1.1" 200 None 2026-03-06 19:01:18,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:01:18,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafec027cb11dcdfc75912 HTTP/1.1" 200 None 2026-03-06 19:01:18,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:01:18,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab245e27cb11dcdfc76a35 HTTP/1.1" 200 None 2026-03-06 19:01:18,562 - lava_callback - INFO - Completed processing callback for node 69ab245e27cb11dcdfc76a35 2026-03-06 19:01:21,352 - lava_callback - INFO - Received callback for node 69ab245b27cb11dcdfc76a2b INFO: 172.21.0.1:36316 - "POST /node/69ab245b27cb11dcdfc76a2b HTTP/1.0" 202 Accepted 2026-03-06 19:01:21,358 - lava_callback - INFO - Starting async job submit for node 69ab245b27cb11dcdfc76a2b 2026-03-06 19:01:21,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:01:21,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab245b27cb11dcdfc76a2b HTTP/1.1" 200 None 2026-03-06 19:01:21,395 - lava_callback - DEBUG - Processing node 69ab245b27cb11dcdfc76a2b: baseline-x86 2026-03-06 19:01:21,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:01:21,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:01:21,738 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab245b27cb11dcdfc76a2b/log.txt.gz 2026-03-06 19:01:21,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:01:22,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:01:22,073 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab245b27cb11dcdfc76a2b/lava-logs.yaml 2026-03-06 19:01:22,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:01:22,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:01:22,209 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab245b27cb11dcdfc76a2b/lava_callback.json.gz 2026-03-06 19:01:22,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:01:22,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab245b27cb11dcdfc76a2b HTTP/1.1" 200 None 2026-03-06 19:01:22,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:01:22,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafec027cb11dcdfc75912 HTTP/1.1" 200 None 2026-03-06 19:01:22,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:01:22,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab245b27cb11dcdfc76a2b HTTP/1.1" 200 None 2026-03-06 19:01:22,321 - lava_callback - INFO - Completed processing callback for node 69ab245b27cb11dcdfc76a2b INFO: 172.21.0.1:36318 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:01:28,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:01:28,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37526 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:02:24,456 - lava_callback - INFO - Received callback for node 69ab245d27cb11dcdfc76a32 INFO: 172.21.0.1:47060 - "POST /node/69ab245d27cb11dcdfc76a32 HTTP/1.0" 202 Accepted 2026-03-06 19:02:24,462 - lava_callback - INFO - Starting async job submit for node 69ab245d27cb11dcdfc76a32 2026-03-06 19:02:24,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:02:24,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab245d27cb11dcdfc76a32 HTTP/1.1" 200 None 2026-03-06 19:02:24,495 - lava_callback - DEBUG - Processing node 69ab245d27cb11dcdfc76a32: baseline-x86 2026-03-06 19:02:24,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:02:24,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:02:24,971 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab245d27cb11dcdfc76a32/log.txt.gz 2026-03-06 19:02:25,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:02:25,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:02:25,356 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab245d27cb11dcdfc76a32/lava-logs.yaml 2026-03-06 19:02:25,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:02:25,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:02:25,511 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab245d27cb11dcdfc76a32/lava_callback.json.gz 2026-03-06 19:02:25,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:02:25,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab245d27cb11dcdfc76a32 HTTP/1.1" 200 None 2026-03-06 19:02:25,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:02:25,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafec027cb11dcdfc75912 HTTP/1.1" 200 None 2026-03-06 19:02:25,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:02:25,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab245d27cb11dcdfc76a32 HTTP/1.1" 200 None 2026-03-06 19:02:25,606 - lava_callback - INFO - Completed processing callback for node 69ab245d27cb11dcdfc76a32 INFO: 172.21.0.1:47072 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:02:28,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:02:28,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59850 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:02:56,840 - lava_callback - INFO - Received callback for node 69ab245c27cb11dcdfc76a2e INFO: 172.21.0.1:59858 - "POST /node/69ab245c27cb11dcdfc76a2e HTTP/1.0" 202 Accepted 2026-03-06 19:02:56,846 - lava_callback - INFO - Starting async job submit for node 69ab245c27cb11dcdfc76a2e 2026-03-06 19:02:56,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:02:56,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab245c27cb11dcdfc76a2e HTTP/1.1" 200 None 2026-03-06 19:02:56,882 - lava_callback - DEBUG - Processing node 69ab245c27cb11dcdfc76a2e: baseline-x86 2026-03-06 19:02:57,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:02:57,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:02:57,319 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab245c27cb11dcdfc76a2e/log.txt.gz 2026-03-06 19:02:57,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:02:57,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:02:57,712 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab245c27cb11dcdfc76a2e/lava-logs.yaml 2026-03-06 19:02:57,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:02:57,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:02:57,900 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab245c27cb11dcdfc76a2e/lava_callback.json.gz 2026-03-06 19:02:57,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:02:57,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab245c27cb11dcdfc76a2e HTTP/1.1" 200 None 2026-03-06 19:02:57,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:02:57,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafec027cb11dcdfc75912 HTTP/1.1" 200 None 2026-03-06 19:02:57,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:02:57,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab245c27cb11dcdfc76a2e HTTP/1.1" 200 None 2026-03-06 19:02:57,996 - lava_callback - INFO - Completed processing callback for node 69ab245c27cb11dcdfc76a2e 2026-03-06 19:02:58,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:02:58,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:03:39,799 - lava_callback - INFO - Received callback for node 69ab24de27cb11dcdfc76a72 INFO: 172.21.0.1:45080 - "POST /node/69ab24de27cb11dcdfc76a72 HTTP/1.0" 202 Accepted 2026-03-06 19:03:39,805 - lava_callback - INFO - Starting async job submit for node 69ab24de27cb11dcdfc76a72 2026-03-06 19:03:39,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:03:39,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab24de27cb11dcdfc76a72 HTTP/1.1" 200 None 2026-03-06 19:03:39,839 - lava_callback - DEBUG - Processing node 69ab24de27cb11dcdfc76a72: baseline-x86 2026-03-06 19:03:40,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:03:40,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:03:40,152 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab24de27cb11dcdfc76a72/log.txt.gz 2026-03-06 19:03:40,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:03:40,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:03:40,471 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab24de27cb11dcdfc76a72/lava-logs.yaml 2026-03-06 19:03:40,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:03:40,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:03:40,604 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab24de27cb11dcdfc76a72/lava_callback.json.gz 2026-03-06 19:03:40,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:03:40,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab24de27cb11dcdfc76a72 HTTP/1.1" 200 None 2026-03-06 19:03:40,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:03:40,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafec027cb11dcdfc75912 HTTP/1.1" 200 None 2026-03-06 19:03:40,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:03:40,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab24de27cb11dcdfc76a72 HTTP/1.1" 200 None 2026-03-06 19:03:40,694 - lava_callback - INFO - Completed processing callback for node 69ab24de27cb11dcdfc76a72 2026-03-06 19:03:43,080 - lava_callback - INFO - Received callback for node 69ab24df27cb11dcdfc76a75 INFO: 172.21.0.1:45084 - "POST /node/69ab24df27cb11dcdfc76a75 HTTP/1.0" 202 Accepted 2026-03-06 19:03:43,086 - lava_callback - INFO - Starting async job submit for node 69ab24df27cb11dcdfc76a75 2026-03-06 19:03:43,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:03:43,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab24df27cb11dcdfc76a75 HTTP/1.1" 200 None 2026-03-06 19:03:43,121 - lava_callback - DEBUG - Processing node 69ab24df27cb11dcdfc76a75: baseline-x86 2026-03-06 19:03:43,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:03:43,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:03:43,430 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab24df27cb11dcdfc76a75/log.txt.gz 2026-03-06 19:03:43,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:03:43,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:03:43,715 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab24df27cb11dcdfc76a75/lava-logs.yaml 2026-03-06 19:03:43,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 19:03:43,928 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 19:03:43,930 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab24df27cb11dcdfc76a75/lava_callback.json.gz 2026-03-06 19:03:43,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:03:43,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab24df27cb11dcdfc76a75 HTTP/1.1" 200 None 2026-03-06 19:03:43,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:03:43,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafec027cb11dcdfc75912 HTTP/1.1" 200 None 2026-03-06 19:03:43,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:03:44,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab24df27cb11dcdfc76a75 HTTP/1.1" 200 None 2026-03-06 19:03:44,008 - lava_callback - INFO - Completed processing callback for node 69ab24df27cb11dcdfc76a75 INFO: 172.21.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:03:58,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:03:58,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38144 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-06 19:15:15,969 - lava_callback - INFO - Received callback for node 69a884ae440c1da21c238ae7 INFO: 172.21.0.1:38152 - "POST /node/69a884ae440c1da21c238ae7 HTTP/1.0" 202 Accepted 2026-03-06 19:15:15,975 - lava_callback - INFO - Starting async job submit for node 69a884ae440c1da21c238ae7 2026-03-06 19:15:15,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:15:15,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a884ae440c1da21c238ae7 HTTP/1.1" 200 None 2026-03-06 19:15:15,991 - lava_callback - DEBUG - Processing node 69a884ae440c1da21c238ae7: baseline-arm-baylibre 2026-03-06 19:15:15,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a884ae440c1da21c238ae7 2026-03-06 19:15:15,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:15:16,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a884ae440c1da21c238ae7 HTTP/1.1" 200 None 2026-03-06 19:15:16,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:15:16,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-06 19:15:16,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:15:16,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a884ae440c1da21c238ae7 HTTP/1.1" 200 None 2026-03-06 19:15:16,047 - lava_callback - ERROR - Error processing callback for node 69a884ae440c1da21c238ae7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58174 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:15:55,866 - lava_callback - INFO - Received callback for node 69a884e0440c1da21c238b01 INFO: 172.21.0.1:58176 - "POST /node/69a884e0440c1da21c238b01 HTTP/1.0" 202 Accepted 2026-03-06 19:15:55,871 - lava_callback - INFO - Starting async job submit for node 69a884e0440c1da21c238b01 2026-03-06 19:15:55,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:15:55,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a884e0440c1da21c238b01 HTTP/1.1" 200 None 2026-03-06 19:15:55,888 - lava_callback - DEBUG - Processing node 69a884e0440c1da21c238b01: baseline-arm-baylibre 2026-03-06 19:15:55,888 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a884e0440c1da21c238b01 2026-03-06 19:15:55,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:15:55,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a884e0440c1da21c238b01 HTTP/1.1" 200 None 2026-03-06 19:15:55,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:15:55,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-06 19:15:55,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:15:55,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a884e0440c1da21c238b01 HTTP/1.1" 200 None 2026-03-06 19:15:55,971 - lava_callback - ERROR - Error processing callback for node 69a884e0440c1da21c238b01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:16:35,961 - lava_callback - INFO - Received callback for node 69a88511440c1da21c238b1b INFO: 172.21.0.1:34536 - "POST /node/69a88511440c1da21c238b1b HTTP/1.0" 202 Accepted 2026-03-06 19:16:35,966 - lava_callback - INFO - Starting async job submit for node 69a88511440c1da21c238b1b 2026-03-06 19:16:35,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:16:35,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88511440c1da21c238b1b HTTP/1.1" 200 None 2026-03-06 19:16:35,982 - lava_callback - DEBUG - Processing node 69a88511440c1da21c238b1b: baseline-arm-baylibre 2026-03-06 19:16:35,982 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a88511440c1da21c238b1b 2026-03-06 19:16:35,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:16:35,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88511440c1da21c238b1b HTTP/1.1" 200 None 2026-03-06 19:16:35,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:16:36,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-06 19:16:36,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:16:36,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a88511440c1da21c238b1b HTTP/1.1" 200 None 2026-03-06 19:16:36,060 - lava_callback - ERROR - Error processing callback for node 69a88511440c1da21c238b1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:17:35,983 - lava_callback - INFO - Received callback for node 69a88542440c1da21c238b32 INFO: 172.21.0.1:58172 - "POST /node/69a88542440c1da21c238b32 HTTP/1.0" 202 Accepted 2026-03-06 19:17:35,989 - lava_callback - INFO - Starting async job submit for node 69a88542440c1da21c238b32 2026-03-06 19:17:35,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:17:36,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88542440c1da21c238b32 HTTP/1.1" 200 None 2026-03-06 19:17:36,025 - lava_callback - DEBUG - Processing node 69a88542440c1da21c238b32: baseline-arm-baylibre 2026-03-06 19:17:36,025 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a88542440c1da21c238b32 2026-03-06 19:17:36,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:17:36,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88542440c1da21c238b32 HTTP/1.1" 200 None 2026-03-06 19:17:36,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:17:36,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-06 19:17:36,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:17:36,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a88542440c1da21c238b32 HTTP/1.1" 200 None 2026-03-06 19:17:36,089 - lava_callback - ERROR - Error processing callback for node 69a88542440c1da21c238b32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-06 19:18:16,048 - lava_callback - INFO - Received callback for node 69a88572440c1da21c238b4c INFO: 172.21.0.1:59992 - "POST /node/69a88572440c1da21c238b4c HTTP/1.0" 202 Accepted 2026-03-06 19:18:16,053 - lava_callback - INFO - Starting async job submit for node 69a88572440c1da21c238b4c 2026-03-06 19:18:16,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:18:16,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88572440c1da21c238b4c HTTP/1.1" 200 None 2026-03-06 19:18:16,071 - lava_callback - DEBUG - Processing node 69a88572440c1da21c238b4c: baseline-arm-baylibre 2026-03-06 19:18:16,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a88572440c1da21c238b4c 2026-03-06 19:18:16,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:18:16,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88572440c1da21c238b4c HTTP/1.1" 200 None 2026-03-06 19:18:16,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:18:16,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-06 19:18:16,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:18:16,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a88572440c1da21c238b4c HTTP/1.1" 200 None 2026-03-06 19:18:16,135 - lava_callback - ERROR - Error processing callback for node 69a88572440c1da21c238b4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-06 19:19:16,033 - lava_callback - INFO - Received callback for node 69a885ad440c1da21c238b62 INFO: 172.21.0.1:59480 - "POST /node/69a885ad440c1da21c238b62 HTTP/1.0" 202 Accepted 2026-03-06 19:19:16,038 - lava_callback - INFO - Starting async job submit for node 69a885ad440c1da21c238b62 2026-03-06 19:19:16,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:19:16,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a885ad440c1da21c238b62 HTTP/1.1" 200 None 2026-03-06 19:19:16,056 - lava_callback - DEBUG - Processing node 69a885ad440c1da21c238b62: baseline-arm64-baylibre 2026-03-06 19:19:16,056 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a885ad440c1da21c238b62 2026-03-06 19:19:16,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:19:16,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a885ad440c1da21c238b62 HTTP/1.1" 200 None 2026-03-06 19:19:16,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:19:16,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a77a6ba255cc0324eb011a HTTP/1.1" 200 None 2026-03-06 19:19:16,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:19:16,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a885ad440c1da21c238b62 HTTP/1.1" 200 None 2026-03-06 19:19:16,115 - lava_callback - ERROR - Error processing callback for node 69a885ad440c1da21c238b62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36744 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:20:36,277 - lava_callback - INFO - Received callback for node 69a885f7440c1da21c238b81 INFO: 172.21.0.1:33488 - "POST /node/69a885f7440c1da21c238b81 HTTP/1.0" 202 Accepted 2026-03-06 19:20:36,282 - lava_callback - INFO - Starting async job submit for node 69a885f7440c1da21c238b81 2026-03-06 19:20:36,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:20:36,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a885f7440c1da21c238b81 HTTP/1.1" 200 None 2026-03-06 19:20:36,299 - lava_callback - DEBUG - Processing node 69a885f7440c1da21c238b81: baseline-arm-baylibre 2026-03-06 19:20:36,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a885f7440c1da21c238b81 2026-03-06 19:20:36,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:20:36,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a885f7440c1da21c238b81 HTTP/1.1" 200 None 2026-03-06 19:20:36,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:20:36,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-06 19:20:36,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:20:36,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a885f7440c1da21c238b81 HTTP/1.1" 200 None 2026-03-06 19:20:36,357 - lava_callback - ERROR - Error processing callback for node 69a885f7440c1da21c238b81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58478 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:33:16,908 - lava_callback - INFO - Received callback for node 69a888ee440c1da21c238c95 INFO: 172.21.0.1:58482 - "POST /node/69a888ee440c1da21c238c95 HTTP/1.0" 202 Accepted 2026-03-06 19:33:16,914 - lava_callback - INFO - Starting async job submit for node 69a888ee440c1da21c238c95 2026-03-06 19:33:16,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:33:16,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a888ee440c1da21c238c95 HTTP/1.1" 200 None 2026-03-06 19:33:16,930 - lava_callback - DEBUG - Processing node 69a888ee440c1da21c238c95: baseline-arm-baylibre 2026-03-06 19:33:16,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a888ee440c1da21c238c95 2026-03-06 19:33:16,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:33:16,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a888ee440c1da21c238c95 HTTP/1.1" 200 None 2026-03-06 19:33:16,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:33:16,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-06 19:33:16,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:33:16,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a888ee440c1da21c238c95 HTTP/1.1" 200 None 2026-03-06 19:33:16,994 - lava_callback - ERROR - Error processing callback for node 69a888ee440c1da21c238c95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33646 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:33:56,896 - lava_callback - INFO - Received callback for node 69a88922440c1da21c238ca4 INFO: 172.21.0.1:33658 - "POST /node/69a88922440c1da21c238ca4 HTTP/1.0" 202 Accepted 2026-03-06 19:33:56,902 - lava_callback - INFO - Starting async job submit for node 69a88922440c1da21c238ca4 2026-03-06 19:33:56,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:33:56,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88922440c1da21c238ca4 HTTP/1.1" 200 None 2026-03-06 19:33:56,921 - lava_callback - DEBUG - Processing node 69a88922440c1da21c238ca4: baseline-arm-baylibre 2026-03-06 19:33:56,921 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a88922440c1da21c238ca4 2026-03-06 19:33:56,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:33:56,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88922440c1da21c238ca4 HTTP/1.1" 200 None 2026-03-06 19:33:56,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:33:56,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-06 19:33:56,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:33:56,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a88922440c1da21c238ca4 HTTP/1.1" 200 None 2026-03-06 19:33:56,982 - lava_callback - ERROR - Error processing callback for node 69a88922440c1da21c238ca4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:34:56,975 - lava_callback - INFO - Received callback for node 69a88952440c1da21c238cb8 INFO: 172.21.0.1:45596 - "POST /node/69a88952440c1da21c238cb8 HTTP/1.0" 202 Accepted 2026-03-06 19:34:56,985 - lava_callback - INFO - Starting async job submit for node 69a88952440c1da21c238cb8 2026-03-06 19:34:56,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:34:57,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88952440c1da21c238cb8 HTTP/1.1" 200 None 2026-03-06 19:34:57,034 - lava_callback - DEBUG - Processing node 69a88952440c1da21c238cb8: baseline-arm-baylibre 2026-03-06 19:34:57,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a88952440c1da21c238cb8 2026-03-06 19:34:57,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:34:57,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88952440c1da21c238cb8 HTTP/1.1" 200 None 2026-03-06 19:34:57,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:34:57,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-06 19:34:57,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:34:57,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a88952440c1da21c238cb8 HTTP/1.1" 200 None 2026-03-06 19:34:57,120 - lava_callback - ERROR - Error processing callback for node 69a88952440c1da21c238cb8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47334 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:35:36,955 - lava_callback - INFO - Received callback for node 69a88982440c1da21c238cda INFO: 172.21.0.1:47348 - "POST /node/69a88982440c1da21c238cda HTTP/1.0" 202 Accepted 2026-03-06 19:35:36,961 - lava_callback - INFO - Starting async job submit for node 69a88982440c1da21c238cda 2026-03-06 19:35:36,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:35:36,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88982440c1da21c238cda HTTP/1.1" 200 None 2026-03-06 19:35:36,977 - lava_callback - DEBUG - Processing node 69a88982440c1da21c238cda: baseline-arm-baylibre 2026-03-06 19:35:36,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a88982440c1da21c238cda 2026-03-06 19:35:36,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:35:36,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88982440c1da21c238cda HTTP/1.1" 200 None 2026-03-06 19:35:36,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:35:37,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-06 19:35:37,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:35:37,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a88982440c1da21c238cda HTTP/1.1" 200 None 2026-03-06 19:35:37,037 - lava_callback - ERROR - Error processing callback for node 69a88982440c1da21c238cda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34230 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:36:37,075 - lava_callback - INFO - Received callback for node 69a889b4440c1da21c238cef INFO: 172.21.0.1:34232 - "POST /node/69a889b4440c1da21c238cef HTTP/1.0" 202 Accepted 2026-03-06 19:36:37,080 - lava_callback - INFO - Starting async job submit for node 69a889b4440c1da21c238cef 2026-03-06 19:36:37,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:36:37,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a889b4440c1da21c238cef HTTP/1.1" 200 None 2026-03-06 19:36:37,103 - lava_callback - DEBUG - Processing node 69a889b4440c1da21c238cef: baseline-arm-baylibre 2026-03-06 19:36:37,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a889b4440c1da21c238cef 2026-03-06 19:36:37,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:36:37,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a889b4440c1da21c238cef HTTP/1.1" 200 None 2026-03-06 19:36:37,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:36:37,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-06 19:36:37,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:36:37,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a889b4440c1da21c238cef HTTP/1.1" 200 None 2026-03-06 19:36:37,165 - lava_callback - ERROR - Error processing callback for node 69a889b4440c1da21c238cef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59052 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:37:17,103 - lava_callback - INFO - Received callback for node 69a889e5440c1da21c238d05 INFO: 172.21.0.1:59064 - "POST /node/69a889e5440c1da21c238d05 HTTP/1.0" 202 Accepted 2026-03-06 19:37:17,109 - lava_callback - INFO - Starting async job submit for node 69a889e5440c1da21c238d05 2026-03-06 19:37:17,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:37:17,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a889e5440c1da21c238d05 HTTP/1.1" 200 None 2026-03-06 19:37:17,146 - lava_callback - DEBUG - Processing node 69a889e5440c1da21c238d05: baseline-arm-baylibre 2026-03-06 19:37:17,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a889e5440c1da21c238d05 2026-03-06 19:37:17,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:37:17,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a889e5440c1da21c238d05 HTTP/1.1" 200 None 2026-03-06 19:37:17,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:37:17,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-06 19:37:17,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:37:17,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a889e5440c1da21c238d05 HTTP/1.1" 200 None 2026-03-06 19:37:17,205 - lava_callback - ERROR - Error processing callback for node 69a889e5440c1da21c238d05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50230 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:55:18,187 - lava_callback - INFO - Received callback for node 69a88e18440c1da21c238de9 INFO: 172.21.0.1:50242 - "POST /node/69a88e18440c1da21c238de9 HTTP/1.0" 202 Accepted 2026-03-06 19:55:18,193 - lava_callback - INFO - Starting async job submit for node 69a88e18440c1da21c238de9 2026-03-06 19:55:18,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:55:18,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88e18440c1da21c238de9 HTTP/1.1" 200 None 2026-03-06 19:55:18,209 - lava_callback - DEBUG - Processing node 69a88e18440c1da21c238de9: baseline-arm64-baylibre 2026-03-06 19:55:18,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a88e18440c1da21c238de9 2026-03-06 19:55:18,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:55:18,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88e18440c1da21c238de9 HTTP/1.1" 200 None 2026-03-06 19:55:18,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:55:18,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-06 19:55:18,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:55:18,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a88e18440c1da21c238de9 HTTP/1.1" 200 None 2026-03-06 19:55:18,262 - lava_callback - ERROR - Error processing callback for node 69a88e18440c1da21c238de9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46778 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:56:58,248 - lava_callback - INFO - Received callback for node 69a88e75440c1da21c238e12 INFO: 172.21.0.1:46782 - "POST /node/69a88e75440c1da21c238e12 HTTP/1.0" 202 Accepted 2026-03-06 19:56:58,253 - lava_callback - INFO - Starting async job submit for node 69a88e75440c1da21c238e12 2026-03-06 19:56:58,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:56:58,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88e75440c1da21c238e12 HTTP/1.1" 200 None 2026-03-06 19:56:58,299 - lava_callback - DEBUG - Processing node 69a88e75440c1da21c238e12: baseline-arm64-baylibre 2026-03-06 19:56:58,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a88e75440c1da21c238e12 2026-03-06 19:56:58,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:56:58,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88e75440c1da21c238e12 HTTP/1.1" 200 None 2026-03-06 19:56:58,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:56:58,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-06 19:56:58,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:56:58,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a88e75440c1da21c238e12 HTTP/1.1" 200 None 2026-03-06 19:56:58,363 - lava_callback - ERROR - Error processing callback for node 69a88e75440c1da21c238e12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54142 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:58:18,310 - lava_callback - INFO - Received callback for node 69a88ec8440c1da21c238e25 INFO: 172.21.0.1:54144 - "POST /node/69a88ec8440c1da21c238e25 HTTP/1.0" 202 Accepted 2026-03-06 19:58:18,318 - lava_callback - INFO - Starting async job submit for node 69a88ec8440c1da21c238e25 2026-03-06 19:58:18,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:58:18,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88ec8440c1da21c238e25 HTTP/1.1" 200 None 2026-03-06 19:58:18,335 - lava_callback - DEBUG - Processing node 69a88ec8440c1da21c238e25: baseline-arm64-baylibre 2026-03-06 19:58:18,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a88ec8440c1da21c238e25 2026-03-06 19:58:18,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:58:18,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88ec8440c1da21c238e25 HTTP/1.1" 200 None 2026-03-06 19:58:18,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:58:18,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-06 19:58:18,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:58:18,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a88ec8440c1da21c238e25 HTTP/1.1" 200 None 2026-03-06 19:58:18,412 - lava_callback - ERROR - Error processing callback for node 69a88ec8440c1da21c238e25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35704 - "GET / HTTP/1.0" 200 OK 2026-03-06 19:59:38,412 - lava_callback - INFO - Received callback for node 69a88f24440c1da21c238e51 INFO: 172.21.0.1:35714 - "POST /node/69a88f24440c1da21c238e51 HTTP/1.0" 202 Accepted 2026-03-06 19:59:38,417 - lava_callback - INFO - Starting async job submit for node 69a88f24440c1da21c238e51 2026-03-06 19:59:38,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:59:38,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88f24440c1da21c238e51 HTTP/1.1" 200 None 2026-03-06 19:59:38,434 - lava_callback - DEBUG - Processing node 69a88f24440c1da21c238e51: baseline-arm64-baylibre 2026-03-06 19:59:38,434 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a88f24440c1da21c238e51 2026-03-06 19:59:38,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:59:38,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88f24440c1da21c238e51 HTTP/1.1" 200 None 2026-03-06 19:59:38,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:59:38,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-06 19:59:38,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 19:59:38,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a88f24440c1da21c238e51 HTTP/1.1" 200 None 2026-03-06 19:59:38,522 - lava_callback - ERROR - Error processing callback for node 69a88f24440c1da21c238e51: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:01:18,423 - lava_callback - INFO - Received callback for node 69a88f7f440c1da21c238e71 INFO: 172.21.0.1:49862 - "POST /node/69a88f7f440c1da21c238e71 HTTP/1.0" 202 Accepted 2026-03-06 20:01:18,428 - lava_callback - INFO - Starting async job submit for node 69a88f7f440c1da21c238e71 2026-03-06 20:01:18,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:01:18,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88f7f440c1da21c238e71 HTTP/1.1" 200 None 2026-03-06 20:01:18,463 - lava_callback - DEBUG - Processing node 69a88f7f440c1da21c238e71: baseline-arm64-baylibre 2026-03-06 20:01:18,464 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a88f7f440c1da21c238e71 2026-03-06 20:01:18,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:01:18,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88f7f440c1da21c238e71 HTTP/1.1" 200 None 2026-03-06 20:01:18,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:01:18,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-06 20:01:18,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:01:18,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a88f7f440c1da21c238e71 HTTP/1.1" 200 None 2026-03-06 20:01:18,531 - lava_callback - ERROR - Error processing callback for node 69a88f7f440c1da21c238e71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60906 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:02:38,478 - lava_callback - INFO - Received callback for node 69a88fda440c1da21c238e84 INFO: 172.21.0.1:60916 - "POST /node/69a88fda440c1da21c238e84 HTTP/1.0" 202 Accepted 2026-03-06 20:02:38,484 - lava_callback - INFO - Starting async job submit for node 69a88fda440c1da21c238e84 2026-03-06 20:02:38,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:02:38,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88fda440c1da21c238e84 HTTP/1.1" 200 None 2026-03-06 20:02:38,518 - lava_callback - DEBUG - Processing node 69a88fda440c1da21c238e84: baseline-arm64-baylibre 2026-03-06 20:02:38,518 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a88fda440c1da21c238e84 2026-03-06 20:02:38,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:02:38,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a88fda440c1da21c238e84 HTTP/1.1" 200 None 2026-03-06 20:02:38,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:02:38,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-06 20:02:38,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:02:38,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a88fda440c1da21c238e84 HTTP/1.1" 200 None 2026-03-06 20:02:38,579 - lava_callback - ERROR - Error processing callback for node 69a88fda440c1da21c238e84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45412 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:47:01,718 - lava_callback - INFO - Received callback for node 69ab3d2727cb11dcdfc770ed INFO: 172.21.0.1:59828 - "POST /node/69ab3d2727cb11dcdfc770ed HTTP/1.0" 202 Accepted 2026-03-06 20:47:01,729 - lava_callback - INFO - Starting async job submit for node 69ab3d2727cb11dcdfc770ed 2026-03-06 20:47:01,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:01,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2727cb11dcdfc770ed HTTP/1.1" 200 None 2026-03-06 20:47:01,781 - lava_callback - DEBUG - Processing node 69ab3d2727cb11dcdfc770ed: baseline-arm64 2026-03-06 20:47:02,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:02,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:02,196 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2727cb11dcdfc770ed/log.txt.gz 2026-03-06 20:47:02,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:02,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:02,516 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2727cb11dcdfc770ed/lava-logs.yaml 2026-03-06 20:47:02,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:02,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:02,702 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2727cb11dcdfc770ed/lava_callback.json.gz 2026-03-06 20:47:02,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:02,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2727cb11dcdfc770ed HTTP/1.1" 200 None 2026-03-06 20:47:02,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:02,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:47:02,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:02,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d2727cb11dcdfc770ed HTTP/1.1" 200 None 2026-03-06 20:47:02,844 - lava_callback - INFO - Completed processing callback for node 69ab3d2727cb11dcdfc770ed INFO: 172.21.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38600 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:47:22,766 - lava_callback - INFO - Received callback for node 69ab3d3227cb11dcdfc77127 INFO: 172.21.0.1:41850 - "POST /node/69ab3d3227cb11dcdfc77127 HTTP/1.0" 202 Accepted 2026-03-06 20:47:22,778 - lava_callback - INFO - Starting async job submit for node 69ab3d3227cb11dcdfc77127 2026-03-06 20:47:22,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:22,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3227cb11dcdfc77127 HTTP/1.1" 200 None 2026-03-06 20:47:22,836 - lava_callback - DEBUG - Processing node 69ab3d3227cb11dcdfc77127: baseline-arm64 2026-03-06 20:47:23,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:23,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:23,181 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3227cb11dcdfc77127/log.txt.gz 2026-03-06 20:47:23,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:23,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:23,558 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3227cb11dcdfc77127/lava-logs.yaml 2026-03-06 20:47:23,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:23,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:23,755 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3227cb11dcdfc77127/lava_callback.json.gz 2026-03-06 20:47:23,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:23,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3227cb11dcdfc77127 HTTP/1.1" 200 None 2026-03-06 20:47:23,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:23,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:47:23,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:23,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d3227cb11dcdfc77127 HTTP/1.1" 200 None 2026-03-06 20:47:23,841 - lava_callback - INFO - Completed processing callback for node 69ab3d3227cb11dcdfc77127 INFO: 172.21.0.1:41866 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:47:28,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:28,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-06 20:47:29,771 - lava_callback - INFO - Received callback for node 69ab3d4327cb11dcdfc77153 INFO: 172.21.0.1:38756 - "POST /node/69ab3d4327cb11dcdfc77153 HTTP/1.0" 202 Accepted 2026-03-06 20:47:29,782 - lava_callback - INFO - Starting async job submit for node 69ab3d4327cb11dcdfc77153 2026-03-06 20:47:29,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:29,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d4327cb11dcdfc77153 HTTP/1.1" 200 None 2026-03-06 20:47:29,820 - lava_callback - DEBUG - Processing node 69ab3d4327cb11dcdfc77153: baseline-nfs-arm64 2026-03-06 20:47:29,822 - lava_callback - WARNING - Failed to upload log 2026-03-06 20:47:29,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:29,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:29,954 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4327cb11dcdfc77153/lava-logs.yaml 2026-03-06 20:47:29,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:30,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:30,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4327cb11dcdfc77153/lava_callback.json.gz 2026-03-06 20:47:30,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:30,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d4327cb11dcdfc77153 HTTP/1.1" 200 None 2026-03-06 20:47:30,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:30,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:47:30,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:30,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d4327cb11dcdfc77153 HTTP/1.1" 200 None 2026-03-06 20:47:30,226 - lava_callback - INFO - Completed processing callback for node 69ab3d4327cb11dcdfc77153 INFO: 172.21.0.1:38764 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:47:38,449 - lava_callback - INFO - Received callback for node 69ab3d2a27cb11dcdfc7710e INFO: 172.21.0.1:38772 - "POST /node/69ab3d2a27cb11dcdfc7710e HTTP/1.0" 202 Accepted 2026-03-06 20:47:38,456 - lava_callback - INFO - Starting async job submit for node 69ab3d2a27cb11dcdfc7710e 2026-03-06 20:47:38,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:38,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2a27cb11dcdfc7710e HTTP/1.1" 200 None 2026-03-06 20:47:38,503 - lava_callback - DEBUG - Processing node 69ab3d2a27cb11dcdfc7710e: baseline-arm64 2026-03-06 20:47:38,674 - lava_callback - WARNING - Failed to upload log 2026-03-06 20:47:38,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:38,978 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:38,981 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2a27cb11dcdfc7710e/lava-logs.yaml 2026-03-06 20:47:38,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:39,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:39,168 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2a27cb11dcdfc7710e/lava_callback.json.gz 2026-03-06 20:47:39,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:39,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2a27cb11dcdfc7710e HTTP/1.1" 200 None 2026-03-06 20:47:39,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:39,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:47:39,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:39,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d2a27cb11dcdfc7710e HTTP/1.1" 200 None 2026-03-06 20:47:39,319 - lava_callback - INFO - Completed processing callback for node 69ab3d2a27cb11dcdfc7710e 2026-03-06 20:47:39,665 - lava_callback - INFO - Received callback for node 69ab3d2b27cb11dcdfc77111 INFO: 172.21.0.1:38778 - "POST /node/69ab3d2b27cb11dcdfc77111 HTTP/1.0" 202 Accepted 2026-03-06 20:47:39,672 - lava_callback - INFO - Starting async job submit for node 69ab3d2b27cb11dcdfc77111 2026-03-06 20:47:39,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:39,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2b27cb11dcdfc77111 HTTP/1.1" 200 None 2026-03-06 20:47:39,720 - lava_callback - DEBUG - Processing node 69ab3d2b27cb11dcdfc77111: baseline-arm64 2026-03-06 20:47:39,905 - lava_callback - WARNING - Failed to upload log 2026-03-06 20:47:40,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:40,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:40,320 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2b27cb11dcdfc77111/lava-logs.yaml 2026-03-06 20:47:40,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:40,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:40,460 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2b27cb11dcdfc77111/lava_callback.json.gz 2026-03-06 20:47:40,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:40,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2b27cb11dcdfc77111 HTTP/1.1" 200 None 2026-03-06 20:47:40,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:40,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:47:40,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:40,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d2b27cb11dcdfc77111 HTTP/1.1" 200 None 2026-03-06 20:47:40,635 - lava_callback - INFO - Completed processing callback for node 69ab3d2b27cb11dcdfc77111 INFO: 172.21.0.1:56364 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:47:47,683 - lava_callback - INFO - Received callback for node 69ab3d3727cb11dcdfc77133 INFO: 172.21.0.1:56378 - "POST /node/69ab3d3727cb11dcdfc77133 HTTP/1.0" 202 Accepted 2026-03-06 20:47:47,695 - lava_callback - INFO - Starting async job submit for node 69ab3d3727cb11dcdfc77133 2026-03-06 20:47:47,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:47,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3727cb11dcdfc77133 HTTP/1.1" 200 None 2026-03-06 20:47:47,755 - lava_callback - DEBUG - Processing node 69ab3d3727cb11dcdfc77133: baseline-arm64 2026-03-06 20:47:48,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:48,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:48,130 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3727cb11dcdfc77133/log.txt.gz 2026-03-06 20:47:48,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:48,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:48,473 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3727cb11dcdfc77133/lava-logs.yaml 2026-03-06 20:47:48,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:48,621 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:48,623 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3727cb11dcdfc77133/lava_callback.json.gz 2026-03-06 20:47:48,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:48,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3727cb11dcdfc77133 HTTP/1.1" 200 None 2026-03-06 20:47:48,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:48,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:47:48,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:48,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d3727cb11dcdfc77133 HTTP/1.1" 200 None 2026-03-06 20:47:48,722 - lava_callback - INFO - Completed processing callback for node 69ab3d3727cb11dcdfc77133 INFO: 172.21.0.1:47056 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:47:56,187 - lava_callback - INFO - Received callback for node 69ab3d2827cb11dcdfc770f3 INFO: 172.21.0.1:47066 - "POST /node/69ab3d2827cb11dcdfc770f3 HTTP/1.0" 202 Accepted 2026-03-06 20:47:56,194 - lava_callback - INFO - Starting async job submit for node 69ab3d2827cb11dcdfc770f3 2026-03-06 20:47:56,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:56,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2827cb11dcdfc770f3 HTTP/1.1" 200 None 2026-03-06 20:47:56,252 - lava_callback - DEBUG - Processing node 69ab3d2827cb11dcdfc770f3: baseline-arm64 INFO: 172.21.0.1:47068 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:47:56,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:56,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:56,894 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2827cb11dcdfc770f3/log.txt.gz 2026-03-06 20:47:57,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:57,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:57,373 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2827cb11dcdfc770f3/lava-logs.yaml 2026-03-06 20:47:57,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:47:57,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:47:57,534 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2827cb11dcdfc770f3/lava_callback.json.gz 2026-03-06 20:47:57,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:57,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2827cb11dcdfc770f3 HTTP/1.1" 200 None 2026-03-06 20:47:57,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:57,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:47:57,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:57,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d2827cb11dcdfc770f3 HTTP/1.1" 200 None 2026-03-06 20:47:57,628 - lava_callback - INFO - Completed processing callback for node 69ab3d2827cb11dcdfc770f3 2026-03-06 20:47:58,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:47:58,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-06 20:48:05,101 - lava_callback - INFO - Received callback for node 69ab3d2927cb11dcdfc770f6 INFO: 172.21.0.1:52012 - "POST /node/69ab3d2927cb11dcdfc770f6 HTTP/1.0" 202 Accepted 2026-03-06 20:48:05,107 - lava_callback - INFO - Starting async job submit for node 69ab3d2927cb11dcdfc770f6 2026-03-06 20:48:05,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:05,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2927cb11dcdfc770f6 HTTP/1.1" 200 None 2026-03-06 20:48:05,157 - lava_callback - DEBUG - Processing node 69ab3d2927cb11dcdfc770f6: baseline-arm64 2026-03-06 20:48:05,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:05,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:05,549 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2927cb11dcdfc770f6/log.txt.gz 2026-03-06 20:48:05,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:05,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:05,893 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2927cb11dcdfc770f6/lava-logs.yaml 2026-03-06 20:48:05,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:06,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:06,036 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2927cb11dcdfc770f6/lava_callback.json.gz 2026-03-06 20:48:06,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:06,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2927cb11dcdfc770f6 HTTP/1.1" 200 None 2026-03-06 20:48:06,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:06,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:06,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:06,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d2927cb11dcdfc770f6 HTTP/1.1" 200 None 2026-03-06 20:48:06,153 - lava_callback - INFO - Completed processing callback for node 69ab3d2927cb11dcdfc770f6 INFO: 172.21.0.1:52022 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:48:08,962 - lava_callback - INFO - Received callback for node 69ab3d3427cb11dcdfc7712a INFO: 172.21.0.1:52036 - "POST /node/69ab3d3427cb11dcdfc7712a HTTP/1.0" 202 Accepted 2026-03-06 20:48:08,968 - lava_callback - INFO - Starting async job submit for node 69ab3d3427cb11dcdfc7712a 2026-03-06 20:48:09,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:09,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3427cb11dcdfc7712a HTTP/1.1" 200 None 2026-03-06 20:48:09,023 - lava_callback - DEBUG - Processing node 69ab3d3427cb11dcdfc7712a: baseline-arm64 2026-03-06 20:48:09,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:09,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:09,445 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3427cb11dcdfc7712a/log.txt.gz 2026-03-06 20:48:09,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:09,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:09,919 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3427cb11dcdfc7712a/lava-logs.yaml 2026-03-06 20:48:09,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:10,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:10,061 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3427cb11dcdfc7712a/lava_callback.json.gz 2026-03-06 20:48:10,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:10,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3427cb11dcdfc7712a HTTP/1.1" 200 None 2026-03-06 20:48:10,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:10,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:10,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:10,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d3427cb11dcdfc7712a HTTP/1.1" 200 None 2026-03-06 20:48:10,154 - lava_callback - INFO - Completed processing callback for node 69ab3d3427cb11dcdfc7712a 2026-03-06 20:48:10,892 - lava_callback - INFO - Received callback for node 69ab3d3027cb11dcdfc77121 INFO: 172.21.0.1:56242 - "POST /node/69ab3d3027cb11dcdfc77121 HTTP/1.0" 202 Accepted 2026-03-06 20:48:10,899 - lava_callback - INFO - Starting async job submit for node 69ab3d3027cb11dcdfc77121 2026-03-06 20:48:10,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:10,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3027cb11dcdfc77121 HTTP/1.1" 200 None 2026-03-06 20:48:10,947 - lava_callback - DEBUG - Processing node 69ab3d3027cb11dcdfc77121: baseline-arm64 2026-03-06 20:48:11,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:11,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:11,458 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3027cb11dcdfc77121/log.txt.gz 2026-03-06 20:48:11,490 - lava_callback - INFO - Received callback for node 69ab3d2727cb11dcdfc770f0 INFO: 172.21.0.1:56254 - "POST /node/69ab3d2727cb11dcdfc770f0 HTTP/1.0" 202 Accepted 2026-03-06 20:48:11,507 - lava_callback - INFO - Starting async job submit for node 69ab3d2727cb11dcdfc770f0 2026-03-06 20:48:11,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:11,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2727cb11dcdfc770f0 HTTP/1.1" 200 None 2026-03-06 20:48:11,634 - lava_callback - DEBUG - Processing node 69ab3d2727cb11dcdfc770f0: baseline-arm64 2026-03-06 20:48:11,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:11,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:12,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:12,155 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2727cb11dcdfc770f0/log.txt.gz 2026-03-06 20:48:12,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:12,229 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3027cb11dcdfc77121/lava-logs.yaml 2026-03-06 20:48:12,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:12,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:12,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:12,471 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3027cb11dcdfc77121/lava_callback.json.gz 2026-03-06 20:48:12,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:12,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3027cb11dcdfc77121 HTTP/1.1" 200 None 2026-03-06 20:48:12,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:12,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:12,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:12,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:12,531 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2727cb11dcdfc770f0/lava-logs.yaml 2026-03-06 20:48:12,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:12,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d3027cb11dcdfc77121 HTTP/1.1" 200 None 2026-03-06 20:48:12,560 - lava_callback - INFO - Completed processing callback for node 69ab3d3027cb11dcdfc77121 2026-03-06 20:48:12,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:12,760 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2727cb11dcdfc770f0/lava_callback.json.gz 2026-03-06 20:48:12,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:12,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2727cb11dcdfc770f0 HTTP/1.1" 200 None 2026-03-06 20:48:12,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:12,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:12,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:12,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d2727cb11dcdfc770f0 HTTP/1.1" 200 None 2026-03-06 20:48:12,882 - lava_callback - INFO - Completed processing callback for node 69ab3d2727cb11dcdfc770f0 INFO: 172.21.0.1:56262 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-06 20:48:19,657 - lava_callback - INFO - Received callback for node 69ab3d3627cb11dcdfc77130 INFO: 172.21.0.1:56272 - "POST /node/69ab3d3627cb11dcdfc77130 HTTP/1.0" 202 Accepted 2026-03-06 20:48:19,663 - lava_callback - INFO - Starting async job submit for node 69ab3d3627cb11dcdfc77130 2026-03-06 20:48:19,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:19,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3627cb11dcdfc77130 HTTP/1.1" 200 None 2026-03-06 20:48:19,703 - lava_callback - DEBUG - Processing node 69ab3d3627cb11dcdfc77130: baseline-arm64 2026-03-06 20:48:19,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:20,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:20,094 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3627cb11dcdfc77130/log.txt.gz 2026-03-06 20:48:20,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:20,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:20,447 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3627cb11dcdfc77130/lava-logs.yaml 2026-03-06 20:48:20,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:46492 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:48:20,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:20,582 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3627cb11dcdfc77130/lava_callback.json.gz 2026-03-06 20:48:20,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:20,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3627cb11dcdfc77130 HTTP/1.1" 200 None 2026-03-06 20:48:20,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:20,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:20,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:20,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d3627cb11dcdfc77130 HTTP/1.1" 200 None 2026-03-06 20:48:20,670 - lava_callback - INFO - Completed processing callback for node 69ab3d3627cb11dcdfc77130 2026-03-06 20:48:26,002 - lava_callback - INFO - Received callback for node 69ab3d2f27cb11dcdfc7711a INFO: 172.21.0.1:46506 - "POST /node/69ab3d2f27cb11dcdfc7711a HTTP/1.0" 202 Accepted 2026-03-06 20:48:26,008 - lava_callback - INFO - Starting async job submit for node 69ab3d2f27cb11dcdfc7711a 2026-03-06 20:48:26,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:26,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2f27cb11dcdfc7711a HTTP/1.1" 200 None 2026-03-06 20:48:26,045 - lava_callback - DEBUG - Processing node 69ab3d2f27cb11dcdfc7711a: baseline-arm64 2026-03-06 20:48:26,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:46514 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:48:26,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:26,525 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2f27cb11dcdfc7711a/log.txt.gz 2026-03-06 20:48:26,611 - lava_callback - INFO - Received callback for node 69ab3d3927cb11dcdfc77136 INFO: 172.21.0.1:46524 - "POST /node/69ab3d3927cb11dcdfc77136 HTTP/1.0" 202 Accepted 2026-03-06 20:48:26,634 - lava_callback - INFO - Starting async job submit for node 69ab3d3927cb11dcdfc77136 2026-03-06 20:48:26,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:26,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3927cb11dcdfc77136 HTTP/1.1" 200 None 2026-03-06 20:48:26,800 - lava_callback - DEBUG - Processing node 69ab3d3927cb11dcdfc77136: baseline-arm64 2026-03-06 20:48:27,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:27,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:27,338 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2f27cb11dcdfc7711a/lava-logs.yaml 2026-03-06 20:48:27,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:27,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:27,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:27,478 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3927cb11dcdfc77136/log.txt.gz 2026-03-06 20:48:27,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:27,579 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2f27cb11dcdfc7711a/lava_callback.json.gz 2026-03-06 20:48:27,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:27,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2f27cb11dcdfc7711a HTTP/1.1" 200 None 2026-03-06 20:48:27,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:27,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:27,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:27,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:27,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d2f27cb11dcdfc7711a HTTP/1.1" 200 None 2026-03-06 20:48:27,786 - lava_callback - INFO - Completed processing callback for node 69ab3d2f27cb11dcdfc7711a 2026-03-06 20:48:27,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:27,967 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3927cb11dcdfc77136/lava-logs.yaml 2026-03-06 20:48:27,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:28,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:28,149 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3927cb11dcdfc77136/lava_callback.json.gz 2026-03-06 20:48:28,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:28,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3927cb11dcdfc77136 HTTP/1.1" 200 None 2026-03-06 20:48:28,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:28,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:28,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:28,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d3927cb11dcdfc77136 HTTP/1.1" 200 None 2026-03-06 20:48:28,262 - lava_callback - INFO - Completed processing callback for node 69ab3d3927cb11dcdfc77136 2026-03-06 20:48:28,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:28,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-06 20:48:30,697 - lava_callback - INFO - Received callback for node 69ab3d4427cb11dcdfc77156 INFO: 172.21.0.1:49790 - "POST /node/69ab3d4427cb11dcdfc77156 HTTP/1.0" 202 Accepted 2026-03-06 20:48:30,703 - lava_callback - INFO - Starting async job submit for node 69ab3d4427cb11dcdfc77156 2026-03-06 20:48:30,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:30,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d4427cb11dcdfc77156 HTTP/1.1" 200 None 2026-03-06 20:48:30,742 - lava_callback - DEBUG - Processing node 69ab3d4427cb11dcdfc77156: baseline-nfs-arm64 2026-03-06 20:48:31,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:31,190 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:31,192 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4427cb11dcdfc77156/log.txt.gz 2026-03-06 20:48:31,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:31,487 - lava_callback - INFO - Received callback for node 69ab3d5427cb11dcdfc7719e INFO: 172.21.0.1:49794 - "POST /node/69ab3d5427cb11dcdfc7719e HTTP/1.0" 202 Accepted 2026-03-06 20:48:31,495 - lava_callback - INFO - Starting async job submit for node 69ab3d5427cb11dcdfc7719e 2026-03-06 20:48:31,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:31,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d5427cb11dcdfc7719e HTTP/1.1" 200 None 2026-03-06 20:48:31,538 - lava_callback - DEBUG - Processing node 69ab3d5427cb11dcdfc7719e: baseline-arm64-broonie 2026-03-06 20:48:31,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:31,682 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4427cb11dcdfc77156/lava-logs.yaml 2026-03-06 20:48:31,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:31,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:31,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:31,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:31,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4427cb11dcdfc77156/lava_callback.json.gz 2026-03-06 20:48:31,984 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5427cb11dcdfc7719e/log.txt.gz 2026-03-06 20:48:32,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:32,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d4427cb11dcdfc77156 HTTP/1.1" 200 None 2026-03-06 20:48:32,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:32,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:32,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:32,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:32,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d4427cb11dcdfc77156 HTTP/1.1" 200 None 2026-03-06 20:48:32,198 - lava_callback - INFO - Completed processing callback for node 69ab3d4427cb11dcdfc77156 2026-03-06 20:48:32,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:32,402 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5427cb11dcdfc7719e/lava-logs.yaml 2026-03-06 20:48:32,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:32,472 - lava_callback - INFO - Received callback for node 69ab3d3127cb11dcdfc77124 INFO: 172.21.0.1:49802 - "POST /node/69ab3d3127cb11dcdfc77124 HTTP/1.0" 202 Accepted 2026-03-06 20:48:32,480 - lava_callback - INFO - Starting async job submit for node 69ab3d3127cb11dcdfc77124 2026-03-06 20:48:32,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:32,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3127cb11dcdfc77124 HTTP/1.1" 200 None 2026-03-06 20:48:32,526 - lava_callback - DEBUG - Processing node 69ab3d3127cb11dcdfc77124: baseline-arm64 2026-03-06 20:48:32,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:32,628 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5427cb11dcdfc7719e/lava_callback.json.gz 2026-03-06 20:48:32,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:32,680 - lava_callback - INFO - Received callback for node 69ab3d2e27cb11dcdfc77117 INFO: 172.21.0.1:49814 - "POST /node/69ab3d2e27cb11dcdfc77117 HTTP/1.0" 202 Accepted 2026-03-06 20:48:32,704 - lava_callback - INFO - Starting async job submit for node 69ab3d2e27cb11dcdfc77117 2026-03-06 20:48:32,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:32,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d5427cb11dcdfc7719e HTTP/1.1" 200 None 2026-03-06 20:48:32,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:32,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2e27cb11dcdfc77117 HTTP/1.1" 200 None 2026-03-06 20:48:32,858 - lava_callback - DEBUG - Processing node 69ab3d2e27cb11dcdfc77117: baseline-arm64 2026-03-06 20:48:33,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:33,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:33,077 - lava_callback - INFO - Received callback for node 69ab3d5d27cb11dcdfc771b6 2026-03-06 20:48:33,097 - lava_callback - INFO - Starting async job submit for node 69ab3d5d27cb11dcdfc771b6 INFO: 172.21.0.1:49824 - "POST /node/69ab3d5d27cb11dcdfc771b6 HTTP/1.0" 202 Accepted 2026-03-06 20:48:33,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:33,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d5427cb11dcdfc7719e HTTP/1.1" 200 None 2026-03-06 20:48:33,458 - lava_callback - INFO - Completed processing callback for node 69ab3d5427cb11dcdfc7719e 2026-03-06 20:48:33,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d5d27cb11dcdfc771b6 HTTP/1.1" 200 None 2026-03-06 20:48:33,473 - lava_callback - DEBUG - Processing node 69ab3d5d27cb11dcdfc771b6: baseline-arm64-broonie 2026-03-06 20:48:33,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:33,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:33,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:33,954 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3127cb11dcdfc77124/log.txt.gz 2026-03-06 20:48:34,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:34,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:34,116 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2e27cb11dcdfc77117/log.txt.gz 2026-03-06 20:48:34,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:34,366 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5d27cb11dcdfc771b6/log.txt.gz 2026-03-06 20:48:34,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:34,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:34,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:34,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:34,870 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2e27cb11dcdfc77117/lava-logs.yaml 2026-03-06 20:48:34,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:34,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:34,894 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3127cb11dcdfc77124/lava-logs.yaml 2026-03-06 20:48:34,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:34,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:34,956 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5d27cb11dcdfc771b6/lava-logs.yaml 2026-03-06 20:48:34,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:35,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:35,058 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2e27cb11dcdfc77117/lava_callback.json.gz 2026-03-06 20:48:35,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:35,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2e27cb11dcdfc77117 HTTP/1.1" 200 None 2026-03-06 20:48:35,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:35,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:35,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:35,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:35,124 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5d27cb11dcdfc771b6/lava_callback.json.gz 2026-03-06 20:48:35,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:35,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:35,152 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3127cb11dcdfc77124/lava_callback.json.gz 2026-03-06 20:48:35,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:35,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d2e27cb11dcdfc77117 HTTP/1.1" 200 None 2026-03-06 20:48:35,198 - lava_callback - INFO - Completed processing callback for node 69ab3d2e27cb11dcdfc77117 2026-03-06 20:48:35,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d5d27cb11dcdfc771b6 HTTP/1.1" 200 None 2026-03-06 20:48:35,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:35,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3127cb11dcdfc77124 HTTP/1.1" 200 None 2026-03-06 20:48:35,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:35,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:35,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:35,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:35,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:35,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d5d27cb11dcdfc771b6 HTTP/1.1" 200 None 2026-03-06 20:48:35,287 - lava_callback - INFO - Completed processing callback for node 69ab3d5d27cb11dcdfc771b6 2026-03-06 20:48:35,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d3127cb11dcdfc77124 HTTP/1.1" 200 None 2026-03-06 20:48:35,333 - lava_callback - INFO - Completed processing callback for node 69ab3d3127cb11dcdfc77124 INFO: 172.21.0.1:49840 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:48:42,258 - lava_callback - INFO - Received callback for node 69ab3d4a27cb11dcdfc7718c INFO: 172.21.0.1:47692 - "POST /node/69ab3d4a27cb11dcdfc7718c HTTP/1.0" 202 Accepted 2026-03-06 20:48:42,264 - lava_callback - INFO - Starting async job submit for node 69ab3d4a27cb11dcdfc7718c 2026-03-06 20:48:42,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:42,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d4a27cb11dcdfc7718c HTTP/1.1" 200 None 2026-03-06 20:48:42,307 - lava_callback - DEBUG - Processing node 69ab3d4a27cb11dcdfc7718c: baseline-nfs-arm64 2026-03-06 20:48:42,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:42,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:42,860 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4a27cb11dcdfc7718c/log.txt.gz 2026-03-06 20:48:43,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:43,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:43,304 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4a27cb11dcdfc7718c/lava-logs.yaml 2026-03-06 20:48:43,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:43,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:43,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4a27cb11dcdfc7718c/lava_callback.json.gz 2026-03-06 20:48:43,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:43,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d4a27cb11dcdfc7718c HTTP/1.1" 200 None 2026-03-06 20:48:43,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:43,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:43,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:43,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d4a27cb11dcdfc7718c HTTP/1.1" 200 None 2026-03-06 20:48:43,592 - lava_callback - INFO - Completed processing callback for node 69ab3d4a27cb11dcdfc7718c 2026-03-06 20:48:46,043 - lava_callback - INFO - Received callback for node 69ab3d4827cb11dcdfc77160 INFO: 172.21.0.1:47694 - "POST /node/69ab3d4827cb11dcdfc77160 HTTP/1.0" 202 Accepted 2026-03-06 20:48:46,050 - lava_callback - INFO - Starting async job submit for node 69ab3d4827cb11dcdfc77160 2026-03-06 20:48:46,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:46,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d4827cb11dcdfc77160 HTTP/1.1" 200 None 2026-03-06 20:48:46,092 - lava_callback - DEBUG - Processing node 69ab3d4827cb11dcdfc77160: baseline-nfs-arm64 2026-03-06 20:48:46,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:47698 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:48:46,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:46,559 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4827cb11dcdfc77160/log.txt.gz 2026-03-06 20:48:46,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:46,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:46,969 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4827cb11dcdfc77160/lava-logs.yaml 2026-03-06 20:48:46,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:47,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:47,128 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4827cb11dcdfc77160/lava_callback.json.gz 2026-03-06 20:48:47,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:47,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d4827cb11dcdfc77160 HTTP/1.1" 200 None 2026-03-06 20:48:47,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:47,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:47,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:47,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d4827cb11dcdfc77160 HTTP/1.1" 200 None 2026-03-06 20:48:47,210 - lava_callback - INFO - Completed processing callback for node 69ab3d4827cb11dcdfc77160 2026-03-06 20:48:51,497 - lava_callback - INFO - Received callback for node 69ab3d4927cb11dcdfc77189 INFO: 172.21.0.1:50144 - "POST /node/69ab3d4927cb11dcdfc77189 HTTP/1.0" 202 Accepted 2026-03-06 20:48:51,503 - lava_callback - INFO - Starting async job submit for node 69ab3d4927cb11dcdfc77189 2026-03-06 20:48:51,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:51,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d4927cb11dcdfc77189 HTTP/1.1" 200 None 2026-03-06 20:48:51,545 - lava_callback - DEBUG - Processing node 69ab3d4927cb11dcdfc77189: baseline-nfs-arm64 2026-03-06 20:48:51,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:52,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:52,024 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4927cb11dcdfc77189/log.txt.gz 2026-03-06 20:48:52,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:52,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:52,421 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4927cb11dcdfc77189/lava-logs.yaml 2026-03-06 20:48:52,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:52,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:52,575 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4927cb11dcdfc77189/lava_callback.json.gz 2026-03-06 20:48:52,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:52,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d4927cb11dcdfc77189 HTTP/1.1" 200 None 2026-03-06 20:48:52,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:52,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:52,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:52,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d4927cb11dcdfc77189 HTTP/1.1" 200 None 2026-03-06 20:48:52,664 - lava_callback - INFO - Completed processing callback for node 69ab3d4927cb11dcdfc77189 2026-03-06 20:48:52,882 - lava_callback - INFO - Received callback for node 69ab3d6d27cb11dcdfc7720c INFO: 172.21.0.1:50158 - "POST /node/69ab3d6d27cb11dcdfc7720c HTTP/1.0" 202 Accepted 2026-03-06 20:48:52,891 - lava_callback - INFO - Starting async job submit for node 69ab3d6d27cb11dcdfc7720c 2026-03-06 20:48:52,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:52,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6d27cb11dcdfc7720c HTTP/1.1" 200 None 2026-03-06 20:48:52,934 - lava_callback - DEBUG - Processing node 69ab3d6d27cb11dcdfc7720c: baseline-arm64-pengutronix 2026-03-06 20:48:53,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:53,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:53,265 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab3d6d27cb11dcdfc7720c/log.txt.gz 2026-03-06 20:48:53,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:53,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:53,562 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab3d6d27cb11dcdfc7720c/lava-logs.yaml 2026-03-06 20:48:53,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:53,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:53,789 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab3d6d27cb11dcdfc7720c/lava_callback.json.gz 2026-03-06 20:48:53,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:53,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6d27cb11dcdfc7720c HTTP/1.1" 200 None 2026-03-06 20:48:53,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:53,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:53,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:53,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d6d27cb11dcdfc7720c HTTP/1.1" 200 None 2026-03-06 20:48:53,867 - lava_callback - INFO - Completed processing callback for node 69ab3d6d27cb11dcdfc7720c 2026-03-06 20:48:54,177 - lava_callback - INFO - Received callback for node 69ab3d3c27cb11dcdfc77140 INFO: 172.21.0.1:50160 - "POST /node/69ab3d3c27cb11dcdfc77140 HTTP/1.0" 202 Accepted 2026-03-06 20:48:54,184 - lava_callback - INFO - Starting async job submit for node 69ab3d3c27cb11dcdfc77140 2026-03-06 20:48:54,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:54,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3c27cb11dcdfc77140 HTTP/1.1" 200 None 2026-03-06 20:48:54,246 - lava_callback - DEBUG - Processing node 69ab3d3c27cb11dcdfc77140: baseline-nfs-arm64 INFO: 172.21.0.1:50176 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:48:54,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:54,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:54,758 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d3c27cb11dcdfc77140/log.txt.gz 2026-03-06 20:48:54,860 - lava_callback - INFO - Received callback for node 69ab3d4227cb11dcdfc77150 INFO: 172.21.0.1:50190 - "POST /node/69ab3d4227cb11dcdfc77150 HTTP/1.0" 202 Accepted 2026-03-06 20:48:54,909 - lava_callback - INFO - Starting async job submit for node 69ab3d4227cb11dcdfc77150 2026-03-06 20:48:54,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:55,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:55,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d4227cb11dcdfc77150 HTTP/1.1" 200 None 2026-03-06 20:48:55,014 - lava_callback - DEBUG - Processing node 69ab3d4227cb11dcdfc77150: baseline-nfs-arm64 2026-03-06 20:48:55,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:55,341 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d3c27cb11dcdfc77140/lava-logs.yaml 2026-03-06 20:48:55,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:55,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:55,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:55,643 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d3c27cb11dcdfc77140/lava_callback.json.gz 2026-03-06 20:48:55,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:55,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3c27cb11dcdfc77140 HTTP/1.1" 200 None 2026-03-06 20:48:55,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:55,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:55,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:55,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d3c27cb11dcdfc77140 HTTP/1.1" 200 None 2026-03-06 20:48:55,754 - lava_callback - INFO - Completed processing callback for node 69ab3d3c27cb11dcdfc77140 2026-03-06 20:48:55,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:55,782 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4227cb11dcdfc77150/log.txt.gz 2026-03-06 20:48:55,898 - lava_callback - INFO - Received callback for node 69ab3d6b27cb11dcdfc77207 INFO: 172.21.0.1:50202 - "POST /node/69ab3d6b27cb11dcdfc77207 HTTP/1.0" 202 Accepted 2026-03-06 20:48:55,931 - lava_callback - INFO - Starting async job submit for node 69ab3d6b27cb11dcdfc77207 2026-03-06 20:48:55,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:56,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6b27cb11dcdfc77207 HTTP/1.1" 200 None 2026-03-06 20:48:56,085 - lava_callback - DEBUG - Processing node 69ab3d6b27cb11dcdfc77207: baseline-arm64-pengutronix 2026-03-06 20:48:56,300 - lava_callback - INFO - Received callback for node 69ab3d4127cb11dcdfc7714d INFO: 172.21.0.1:50204 - "POST /node/69ab3d4127cb11dcdfc7714d HTTP/1.0" 202 Accepted 2026-03-06 20:48:56,414 - lava_callback - INFO - Starting async job submit for node 69ab3d4127cb11dcdfc7714d 2026-03-06 20:48:56,427 - lava_callback - INFO - Received callback for node 69ab3d3527cb11dcdfc7712d INFO: 172.21.0.1:50220 - "POST /node/69ab3d3527cb11dcdfc7712d HTTP/1.0" 202 Accepted 2026-03-06 20:48:56,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:56,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:56,462 - lava_callback - INFO - Starting async job submit for node 69ab3d3527cb11dcdfc7712d 2026-03-06 20:48:56,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:56,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:56,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d4127cb11dcdfc7714d HTTP/1.1" 200 None 2026-03-06 20:48:56,508 - lava_callback - DEBUG - Processing node 69ab3d4127cb11dcdfc7714d: baseline-nfs-arm64 2026-03-06 20:48:56,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3527cb11dcdfc7712d HTTP/1.1" 200 None INFO: 172.21.0.1:50222 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:48:56,551 - lava_callback - DEBUG - Processing node 69ab3d3527cb11dcdfc7712d: baseline-arm64 2026-03-06 20:48:56,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:56,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:56,923 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab3d6b27cb11dcdfc77207/log.txt.gz 2026-03-06 20:48:57,001 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4227cb11dcdfc77150/lava-logs.yaml 2026-03-06 20:48:57,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:57,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:57,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:57,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:57,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:57,790 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4227cb11dcdfc77150/lava_callback.json.gz 2026-03-06 20:48:57,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:57,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:57,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:57,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:57,821 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab3d6b27cb11dcdfc77207/lava-logs.yaml 2026-03-06 20:48:57,822 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3527cb11dcdfc7712d/log.txt.gz 2026-03-06 20:48:57,823 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4127cb11dcdfc7714d/log.txt.gz 2026-03-06 20:48:57,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:57,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d4227cb11dcdfc77150 HTTP/1.1" 200 None 2026-03-06 20:48:58,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:58,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:58,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:58,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:58,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:58,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:58,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d4227cb11dcdfc77150 HTTP/1.1" 200 None 2026-03-06 20:48:58,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-06 20:48:58,510 - lava_callback - INFO - Completed processing callback for node 69ab3d4227cb11dcdfc77150 2026-03-06 20:48:58,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:58,565 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab3d6b27cb11dcdfc77207/lava_callback.json.gz 2026-03-06 20:48:58,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:58,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6b27cb11dcdfc77207 HTTP/1.1" 200 None 2026-03-06 20:48:58,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:58,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:58,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:58,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:58,704 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3527cb11dcdfc7712d/lava-logs.yaml 2026-03-06 20:48:58,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d6b27cb11dcdfc77207 HTTP/1.1" 200 None 2026-03-06 20:48:58,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:58,804 - lava_callback - INFO - Completed processing callback for node 69ab3d6b27cb11dcdfc77207 2026-03-06 20:48:58,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:58,818 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4127cb11dcdfc7714d/lava-logs.yaml 2026-03-06 20:48:58,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:48:59,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:59,037 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3527cb11dcdfc7712d/lava_callback.json.gz 2026-03-06 20:48:59,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:59,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:48:59,076 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4127cb11dcdfc7714d/lava_callback.json.gz 2026-03-06 20:48:59,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3527cb11dcdfc7712d HTTP/1.1" 200 None 2026-03-06 20:48:59,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:59,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:59,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d4127cb11dcdfc7714d HTTP/1.1" 200 None 2026-03-06 20:48:59,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:59,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:59,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:59,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:48:59,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:48:59,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d3527cb11dcdfc7712d HTTP/1.1" 200 None 2026-03-06 20:48:59,176 - lava_callback - INFO - Completed processing callback for node 69ab3d3527cb11dcdfc7712d 2026-03-06 20:48:59,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d4127cb11dcdfc7714d HTTP/1.1" 200 None 2026-03-06 20:48:59,185 - lava_callback - INFO - Completed processing callback for node 69ab3d4127cb11dcdfc7714d 2026-03-06 20:49:01,105 - lava_callback - INFO - Received callback for node 69ab3d6e27cb11dcdfc7720f INFO: 172.21.0.1:40024 - "POST /node/69ab3d6e27cb11dcdfc7720f HTTP/1.0" 202 Accepted 2026-03-06 20:49:01,111 - lava_callback - INFO - Starting async job submit for node 69ab3d6e27cb11dcdfc7720f 2026-03-06 20:49:01,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:01,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6e27cb11dcdfc7720f HTTP/1.1" 200 None 2026-03-06 20:49:01,153 - lava_callback - DEBUG - Processing node 69ab3d6e27cb11dcdfc7720f: baseline-arm64-pengutronix 2026-03-06 20:49:01,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:01,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:01,503 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab3d6e27cb11dcdfc7720f/log.txt.gz 2026-03-06 20:49:01,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:01,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:01,794 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab3d6e27cb11dcdfc7720f/lava-logs.yaml 2026-03-06 20:49:01,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:01,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:01,944 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab3d6e27cb11dcdfc7720f/lava_callback.json.gz 2026-03-06 20:49:01,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:01,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6e27cb11dcdfc7720f HTTP/1.1" 200 None 2026-03-06 20:49:01,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:02,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:49:02,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:02,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d6e27cb11dcdfc7720f HTTP/1.1" 200 None 2026-03-06 20:49:02,044 - lava_callback - INFO - Completed processing callback for node 69ab3d6e27cb11dcdfc7720f 2026-03-06 20:49:04,951 - lava_callback - INFO - Received callback for node 69ab3d3e27cb11dcdfc77146 INFO: 172.21.0.1:40030 - "POST /node/69ab3d3e27cb11dcdfc77146 HTTP/1.0" 202 Accepted 2026-03-06 20:49:04,958 - lava_callback - INFO - Starting async job submit for node 69ab3d3e27cb11dcdfc77146 2026-03-06 20:49:04,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:04,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3e27cb11dcdfc77146 HTTP/1.1" 200 None 2026-03-06 20:49:04,997 - lava_callback - DEBUG - Processing node 69ab3d3e27cb11dcdfc77146: baseline-nfs-arm64 2026-03-06 20:49:05,241 - lava_callback - INFO - Received callback for node 69ab3d6f27cb11dcdfc77212 INFO: 172.21.0.1:40036 - "POST /node/69ab3d6f27cb11dcdfc77212 HTTP/1.0" 202 Accepted 2026-03-06 20:49:05,270 - lava_callback - INFO - Starting async job submit for node 69ab3d6f27cb11dcdfc77212 2026-03-06 20:49:05,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:05,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:05,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6f27cb11dcdfc77212 HTTP/1.1" 200 None 2026-03-06 20:49:05,372 - lava_callback - DEBUG - Processing node 69ab3d6f27cb11dcdfc77212: baseline-arm64-foundriesio 2026-03-06 20:49:05,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:05,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:05,689 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d3e27cb11dcdfc77146/log.txt.gz 2026-03-06 20:49:05,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:05,774 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ab3d6f27cb11dcdfc77212/log.txt.gz 2026-03-06 20:49:06,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:06,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:06,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:06,247 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d3e27cb11dcdfc77146/lava-logs.yaml 2026-03-06 20:49:06,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:06,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:06,321 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ab3d6f27cb11dcdfc77212/lava-logs.yaml 2026-03-06 20:49:06,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:06,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:06,394 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d3e27cb11dcdfc77146/lava_callback.json.gz 2026-03-06 20:49:06,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:06,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3e27cb11dcdfc77146 HTTP/1.1" 200 None 2026-03-06 20:49:06,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:06,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:49:06,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:06,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:06,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ab3d6f27cb11dcdfc77212/lava_callback.json.gz 2026-03-06 20:49:06,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:06,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d3e27cb11dcdfc77146 HTTP/1.1" 200 None 2026-03-06 20:49:06,504 - lava_callback - INFO - Completed processing callback for node 69ab3d3e27cb11dcdfc77146 2026-03-06 20:49:06,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6f27cb11dcdfc77212 HTTP/1.1" 200 None INFO: 172.21.0.1:40044 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:49:06,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:06,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:49:06,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:06,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d6f27cb11dcdfc77212 HTTP/1.1" 200 None 2026-03-06 20:49:06,619 - lava_callback - INFO - Completed processing callback for node 69ab3d6f27cb11dcdfc77212 INFO: 172.21.0.1:59066 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-06 20:49:15,893 - lava_callback - INFO - Received callback for node 69ab3d6527cb11dcdfc771d3 INFO: 172.21.0.1:59070 - "POST /node/69ab3d6527cb11dcdfc771d3 HTTP/1.0" 202 Accepted 2026-03-06 20:49:15,902 - lava_callback - INFO - Starting async job submit for node 69ab3d6527cb11dcdfc771d3 2026-03-06 20:49:15,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:15,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6527cb11dcdfc771d3 HTTP/1.1" 200 None 2026-03-06 20:49:15,953 - lava_callback - DEBUG - Processing node 69ab3d6527cb11dcdfc771d3: baseline-arm64-clabbe 2026-03-06 20:49:16,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:16,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:16,367 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab3d6527cb11dcdfc771d3/log.txt.gz 2026-03-06 20:49:16,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:59086 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:49:16,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:16,669 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab3d6527cb11dcdfc771d3/lava-logs.yaml 2026-03-06 20:49:16,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:16,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:16,808 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab3d6527cb11dcdfc771d3/lava_callback.json.gz 2026-03-06 20:49:16,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:16,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6527cb11dcdfc771d3 HTTP/1.1" 200 None 2026-03-06 20:49:16,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:16,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:49:16,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:16,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d6527cb11dcdfc771d3 HTTP/1.1" 200 None 2026-03-06 20:49:16,891 - lava_callback - INFO - Completed processing callback for node 69ab3d6527cb11dcdfc771d3 2026-03-06 20:49:19,702 - lava_callback - INFO - Received callback for node 69ab3d5a27cb11dcdfc771aa INFO: 172.21.0.1:58436 - "POST /node/69ab3d5a27cb11dcdfc771aa HTTP/1.0" 202 Accepted 2026-03-06 20:49:19,708 - lava_callback - INFO - Starting async job submit for node 69ab3d5a27cb11dcdfc771aa 2026-03-06 20:49:19,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:19,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d5a27cb11dcdfc771aa HTTP/1.1" 200 None 2026-03-06 20:49:19,752 - lava_callback - DEBUG - Processing node 69ab3d5a27cb11dcdfc771aa: baseline-arm64-broonie 2026-03-06 20:49:20,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:20,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:20,120 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5a27cb11dcdfc771aa/log.txt.gz 2026-03-06 20:49:20,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:20,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:20,462 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5a27cb11dcdfc771aa/lava-logs.yaml 2026-03-06 20:49:20,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:20,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:20,599 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5a27cb11dcdfc771aa/lava_callback.json.gz 2026-03-06 20:49:20,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:20,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d5a27cb11dcdfc771aa HTTP/1.1" 200 None 2026-03-06 20:49:20,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:20,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:49:20,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:20,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d5a27cb11dcdfc771aa HTTP/1.1" 200 None 2026-03-06 20:49:20,689 - lava_callback - INFO - Completed processing callback for node 69ab3d5a27cb11dcdfc771aa 2026-03-06 20:49:21,255 - lava_callback - INFO - Received callback for node 69ab3d6127cb11dcdfc771c5 INFO: 172.21.0.1:58452 - "POST /node/69ab3d6127cb11dcdfc771c5 HTTP/1.0" 202 Accepted 2026-03-06 20:49:21,261 - lava_callback - INFO - Starting async job submit for node 69ab3d6127cb11dcdfc771c5 2026-03-06 20:49:21,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:21,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6127cb11dcdfc771c5 HTTP/1.1" 200 None 2026-03-06 20:49:21,300 - lava_callback - DEBUG - Processing node 69ab3d6127cb11dcdfc771c5: baseline-arm64-broonie 2026-03-06 20:49:21,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:21,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:21,677 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d6127cb11dcdfc771c5/log.txt.gz 2026-03-06 20:49:21,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:22,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:22,002 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d6127cb11dcdfc771c5/lava-logs.yaml 2026-03-06 20:49:22,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:22,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:22,142 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d6127cb11dcdfc771c5/lava_callback.json.gz 2026-03-06 20:49:22,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:22,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6127cb11dcdfc771c5 HTTP/1.1" 200 None 2026-03-06 20:49:22,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:22,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:49:22,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:22,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d6127cb11dcdfc771c5 HTTP/1.1" 200 None 2026-03-06 20:49:22,226 - lava_callback - INFO - Completed processing callback for node 69ab3d6127cb11dcdfc771c5 2026-03-06 20:49:23,841 - lava_callback - INFO - Received callback for node 69ab3d6427cb11dcdfc771d0 INFO: 172.21.0.1:58456 - "POST /node/69ab3d6427cb11dcdfc771d0 HTTP/1.0" 202 Accepted 2026-03-06 20:49:23,850 - lava_callback - INFO - Starting async job submit for node 69ab3d6427cb11dcdfc771d0 2026-03-06 20:49:23,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:23,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6427cb11dcdfc771d0 HTTP/1.1" 200 None 2026-03-06 20:49:23,888 - lava_callback - DEBUG - Processing node 69ab3d6427cb11dcdfc771d0: baseline-arm64-clabbe 2026-03-06 20:49:24,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:24,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:24,333 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab3d6427cb11dcdfc771d0/log.txt.gz 2026-03-06 20:49:24,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:24,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:24,719 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab3d6427cb11dcdfc771d0/lava-logs.yaml 2026-03-06 20:49:24,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:24,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:24,862 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab3d6427cb11dcdfc771d0/lava_callback.json.gz 2026-03-06 20:49:24,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:24,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6427cb11dcdfc771d0 HTTP/1.1" 200 None 2026-03-06 20:49:24,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:24,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:49:24,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:24,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d6427cb11dcdfc771d0 HTTP/1.1" 200 None 2026-03-06 20:49:24,941 - lava_callback - INFO - Completed processing callback for node 69ab3d6427cb11dcdfc771d0 INFO: 172.21.0.1:58464 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:49:28,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:28,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-06 20:49:31,807 - lava_callback - INFO - Received callback for node 69ab3d7127cb11dcdfc77215 INFO: 172.21.0.1:49918 - "POST /node/69ab3d7127cb11dcdfc77215 HTTP/1.0" 202 Accepted 2026-03-06 20:49:31,815 - lava_callback - INFO - Starting async job submit for node 69ab3d7127cb11dcdfc77215 2026-03-06 20:49:31,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:31,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d7127cb11dcdfc77215 HTTP/1.1" 200 None 2026-03-06 20:49:31,883 - lava_callback - DEBUG - Processing node 69ab3d7127cb11dcdfc77215: baseline-arm64-foundriesio 2026-03-06 20:49:32,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:32,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:32,656 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ab3d7127cb11dcdfc77215/log.txt.gz 2026-03-06 20:49:32,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:33,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:33,131 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ab3d7127cb11dcdfc77215/lava-logs.yaml 2026-03-06 20:49:33,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:33,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:33,334 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ab3d7127cb11dcdfc77215/lava_callback.json.gz 2026-03-06 20:49:33,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:33,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d7127cb11dcdfc77215 HTTP/1.1" 200 None 2026-03-06 20:49:33,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:33,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:49:33,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:33,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d7127cb11dcdfc77215 HTTP/1.1" 200 None 2026-03-06 20:49:33,419 - lava_callback - INFO - Completed processing callback for node 69ab3d7127cb11dcdfc77215 INFO: 172.21.0.1:49934 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:49:39,609 - lava_callback - INFO - Received callback for node 69ab3d6227cb11dcdfc771ca INFO: 172.21.0.1:49946 - "POST /node/69ab3d6227cb11dcdfc771ca HTTP/1.0" 202 Accepted 2026-03-06 20:49:39,615 - lava_callback - INFO - Starting async job submit for node 69ab3d6227cb11dcdfc771ca 2026-03-06 20:49:39,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:39,649 - lava_callback - INFO - Received callback for node 69ab3d4627cb11dcdfc7715d INFO: 172.21.0.1:49948 - "POST /node/69ab3d4627cb11dcdfc7715d HTTP/1.0" 202 Accepted 2026-03-06 20:49:39,656 - lava_callback - INFO - Starting async job submit for node 69ab3d4627cb11dcdfc7715d 2026-03-06 20:49:39,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6227cb11dcdfc771ca HTTP/1.1" 200 None 2026-03-06 20:49:39,679 - lava_callback - DEBUG - Processing node 69ab3d6227cb11dcdfc771ca: baseline-arm64-broonie 2026-03-06 20:49:39,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:39,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d4627cb11dcdfc7715d HTTP/1.1" 200 None 2026-03-06 20:49:39,795 - lava_callback - DEBUG - Processing node 69ab3d4627cb11dcdfc7715d: baseline-nfs-arm64 2026-03-06 20:49:40,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:40,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:40,467 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d6227cb11dcdfc771ca/log.txt.gz 2026-03-06 20:49:40,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:40,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:40,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:40,748 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4627cb11dcdfc7715d/log.txt.gz 2026-03-06 20:49:40,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:40,885 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d6227cb11dcdfc771ca/lava-logs.yaml 2026-03-06 20:49:40,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:41,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:41,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:41,134 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d6227cb11dcdfc771ca/lava_callback.json.gz 2026-03-06 20:49:41,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:41,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6227cb11dcdfc771ca HTTP/1.1" 200 None 2026-03-06 20:49:41,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:41,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:49:41,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:41,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:41,237 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4627cb11dcdfc7715d/lava-logs.yaml 2026-03-06 20:49:41,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d6227cb11dcdfc771ca HTTP/1.1" 200 None 2026-03-06 20:49:41,249 - lava_callback - INFO - Completed processing callback for node 69ab3d6227cb11dcdfc771ca 2026-03-06 20:49:41,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:41,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:41,493 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d4627cb11dcdfc7715d/lava_callback.json.gz 2026-03-06 20:49:41,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:41,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d4627cb11dcdfc7715d HTTP/1.1" 200 None 2026-03-06 20:49:41,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:41,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:49:41,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:41,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d4627cb11dcdfc7715d HTTP/1.1" 200 None 2026-03-06 20:49:41,585 - lava_callback - INFO - Completed processing callback for node 69ab3d4627cb11dcdfc7715d INFO: 172.21.0.1:54872 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:49:49,135 - lava_callback - INFO - Received callback for node 69ab3d5627cb11dcdfc771a1 INFO: 172.21.0.1:54880 - "POST /node/69ab3d5627cb11dcdfc771a1 HTTP/1.0" 202 Accepted 2026-03-06 20:49:49,141 - lava_callback - INFO - Starting async job submit for node 69ab3d5627cb11dcdfc771a1 2026-03-06 20:49:49,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:49,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d5627cb11dcdfc771a1 HTTP/1.1" 200 None 2026-03-06 20:49:49,178 - lava_callback - DEBUG - Processing node 69ab3d5627cb11dcdfc771a1: baseline-arm64-broonie 2026-03-06 20:49:49,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:49,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:49,557 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5627cb11dcdfc771a1/log.txt.gz 2026-03-06 20:49:49,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:49,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:49,868 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5627cb11dcdfc771a1/lava-logs.yaml 2026-03-06 20:49:49,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:49:50,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:49:50,022 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5627cb11dcdfc771a1/lava_callback.json.gz 2026-03-06 20:49:50,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:50,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d5627cb11dcdfc771a1 HTTP/1.1" 200 None 2026-03-06 20:49:50,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:50,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:49:50,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:50,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d5627cb11dcdfc771a1 HTTP/1.1" 200 None 2026-03-06 20:49:50,102 - lava_callback - INFO - Completed processing callback for node 69ab3d5627cb11dcdfc771a1 INFO: 172.21.0.1:34264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34280 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:49:58,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:49:58,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:54558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39882 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:50:19,699 - lava_callback - INFO - Received callback for node 69ab3d5f27cb11dcdfc771bb INFO: 172.21.0.1:54024 - "POST /node/69ab3d5f27cb11dcdfc771bb HTTP/1.0" 202 Accepted 2026-03-06 20:50:19,710 - lava_callback - INFO - Starting async job submit for node 69ab3d5f27cb11dcdfc771bb 2026-03-06 20:50:19,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:19,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d5f27cb11dcdfc771bb HTTP/1.1" 200 None 2026-03-06 20:50:19,776 - lava_callback - DEBUG - Processing node 69ab3d5f27cb11dcdfc771bb: baseline-arm64-broonie 2026-03-06 20:50:20,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:50:20,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:50:20,229 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5f27cb11dcdfc771bb/log.txt.gz 2026-03-06 20:50:20,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:50:20,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:50:20,676 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5f27cb11dcdfc771bb/lava-logs.yaml 2026-03-06 20:50:20,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:50:20,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:50:20,824 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5f27cb11dcdfc771bb/lava_callback.json.gz 2026-03-06 20:50:20,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:20,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d5f27cb11dcdfc771bb HTTP/1.1" 200 None 2026-03-06 20:50:20,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:20,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:50:20,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:20,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d5f27cb11dcdfc771bb HTTP/1.1" 200 None 2026-03-06 20:50:20,947 - lava_callback - INFO - Completed processing callback for node 69ab3d5f27cb11dcdfc771bb INFO: 172.21.0.1:54034 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:50:28,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:28,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-06 20:50:34,391 - lava_callback - INFO - Received callback for node 69ab3d2d27cb11dcdfc77114 INFO: 172.21.0.1:45702 - "POST /node/69ab3d2d27cb11dcdfc77114 HTTP/1.0" 202 Accepted 2026-03-06 20:50:34,398 - lava_callback - INFO - Starting async job submit for node 69ab3d2d27cb11dcdfc77114 2026-03-06 20:50:34,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:34,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2d27cb11dcdfc77114 HTTP/1.1" 200 None 2026-03-06 20:50:34,436 - lava_callback - DEBUG - Processing node 69ab3d2d27cb11dcdfc77114: baseline-arm64 2026-03-06 20:50:34,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:50:34,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:50:34,961 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2d27cb11dcdfc77114/log.txt.gz 2026-03-06 20:50:35,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:50:35,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:50:35,334 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2d27cb11dcdfc77114/lava-logs.yaml 2026-03-06 20:50:35,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:50:35,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:50:35,522 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d2d27cb11dcdfc77114/lava_callback.json.gz 2026-03-06 20:50:35,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:35,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d2d27cb11dcdfc77114 HTTP/1.1" 200 None 2026-03-06 20:50:35,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:35,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:50:35,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:35,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d2d27cb11dcdfc77114 HTTP/1.1" 200 None 2026-03-06 20:50:35,605 - lava_callback - INFO - Completed processing callback for node 69ab3d2d27cb11dcdfc77114 INFO: 172.21.0.1:45708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58890 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:50:49,276 - lava_callback - INFO - Received callback for node 69ab3d5c27cb11dcdfc771b3 INFO: 172.21.0.1:58900 - "POST /node/69ab3d5c27cb11dcdfc771b3 HTTP/1.0" 202 Accepted 2026-03-06 20:50:49,286 - lava_callback - INFO - Starting async job submit for node 69ab3d5c27cb11dcdfc771b3 2026-03-06 20:50:49,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:49,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d5c27cb11dcdfc771b3 HTTP/1.1" 200 None 2026-03-06 20:50:49,358 - lava_callback - DEBUG - Processing node 69ab3d5c27cb11dcdfc771b3: baseline-arm64-broonie 2026-03-06 20:50:49,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:50:49,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:50:49,769 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5c27cb11dcdfc771b3/log.txt.gz 2026-03-06 20:50:49,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:50:50,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:50:50,136 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5c27cb11dcdfc771b3/lava-logs.yaml 2026-03-06 20:50:50,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:50:50,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:50:50,294 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5c27cb11dcdfc771b3/lava_callback.json.gz 2026-03-06 20:50:50,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:50,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d5c27cb11dcdfc771b3 HTTP/1.1" 200 None 2026-03-06 20:50:50,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:50,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:50:50,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:50,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d5c27cb11dcdfc771b3 HTTP/1.1" 200 None 2026-03-06 20:50:50,375 - lava_callback - INFO - Completed processing callback for node 69ab3d5c27cb11dcdfc771b3 2026-03-06 20:50:50,698 - lava_callback - INFO - Received callback for node 69ab3d6927cb11dcdfc77201 INFO: 172.21.0.1:57072 - "POST /node/69ab3d6927cb11dcdfc77201 HTTP/1.0" 202 Accepted 2026-03-06 20:50:50,707 - lava_callback - INFO - Starting async job submit for node 69ab3d6927cb11dcdfc77201 2026-03-06 20:50:50,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:50,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6927cb11dcdfc77201 HTTP/1.1" 200 None 2026-03-06 20:50:50,760 - lava_callback - DEBUG - Processing node 69ab3d6927cb11dcdfc77201: baseline-arm64-clabbe 2026-03-06 20:50:50,780 - lava_callback - INFO - Received callback for node 69ab3d3d27cb11dcdfc77143 INFO: 172.21.0.1:57074 - "POST /node/69ab3d3d27cb11dcdfc77143 HTTP/1.0" 202 Accepted 2026-03-06 20:50:50,797 - lava_callback - INFO - Starting async job submit for node 69ab3d3d27cb11dcdfc77143 2026-03-06 20:50:50,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:50,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3d27cb11dcdfc77143 HTTP/1.1" 200 None 2026-03-06 20:50:50,928 - lava_callback - DEBUG - Processing node 69ab3d3d27cb11dcdfc77143: baseline-nfs-arm64 2026-03-06 20:50:51,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:50:51,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:50:51,501 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab3d6927cb11dcdfc77201/log.txt.gz 2026-03-06 20:50:51,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:50:51,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:50:51,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:50:51,796 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d3d27cb11dcdfc77143/log.txt.gz 2026-03-06 20:50:51,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:50:51,946 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab3d6927cb11dcdfc77201/lava-logs.yaml 2026-03-06 20:50:52,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:50:52,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:50:52,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:50:52,222 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab3d6927cb11dcdfc77201/lava_callback.json.gz 2026-03-06 20:50:52,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:52,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6927cb11dcdfc77201 HTTP/1.1" 200 None 2026-03-06 20:50:52,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:52,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:50:52,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:52,291 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:50:52,293 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d3d27cb11dcdfc77143/lava-logs.yaml 2026-03-06 20:50:52,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:50:52,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d6927cb11dcdfc77201 HTTP/1.1" 200 None 2026-03-06 20:50:52,321 - lava_callback - INFO - Completed processing callback for node 69ab3d6927cb11dcdfc77201 2026-03-06 20:50:52,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:50:52,567 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d3d27cb11dcdfc77143/lava_callback.json.gz 2026-03-06 20:50:52,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:52,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3d27cb11dcdfc77143 HTTP/1.1" 200 None 2026-03-06 20:50:52,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:52,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:50:52,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:52,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d3d27cb11dcdfc77143 HTTP/1.1" 200 None 2026-03-06 20:50:52,704 - lava_callback - INFO - Completed processing callback for node 69ab3d3d27cb11dcdfc77143 INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57080 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:50:58,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:50:58,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-06 20:50:59,990 - lava_callback - INFO - Received callback for node 69ab3e1e27cb11dcdfc77363 INFO: 172.21.0.1:41468 - "POST /node/69ab3e1e27cb11dcdfc77363 HTTP/1.0" 202 Accepted 2026-03-06 20:50:59,996 - lava_callback - INFO - Starting async job submit for node 69ab3e1e27cb11dcdfc77363 2026-03-06 20:50:59,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:51:00,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3e1e27cb11dcdfc77363 HTTP/1.1" 200 None 2026-03-06 20:51:00,017 - lava_callback - DEBUG - Processing node 69ab3e1e27cb11dcdfc77363: baseline-nfs-arm64 2026-03-06 20:51:00,019 - lava_callback - WARNING - Failed to upload log 2026-03-06 20:51:00,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:51:00,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:51:00,133 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3e1e27cb11dcdfc77363/lava-logs.yaml 2026-03-06 20:51:00,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:51:00,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:51:00,250 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3e1e27cb11dcdfc77363/lava_callback.json.gz 2026-03-06 20:51:00,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:51:00,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3e1e27cb11dcdfc77363 HTTP/1.1" 200 None 2026-03-06 20:51:00,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:51:00,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:51:00,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:51:00,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3e1e27cb11dcdfc77363 HTTP/1.1" 200 None 2026-03-06 20:51:00,315 - lava_callback - INFO - Completed processing callback for node 69ab3e1e27cb11dcdfc77363 2026-03-06 20:51:02,548 - lava_callback - INFO - Received callback for node 69ab3d6627cb11dcdfc771f8 INFO: 172.21.0.1:41478 - "POST /node/69ab3d6627cb11dcdfc771f8 HTTP/1.0" 202 Accepted 2026-03-06 20:51:02,554 - lava_callback - INFO - Starting async job submit for node 69ab3d6627cb11dcdfc771f8 2026-03-06 20:51:02,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:51:02,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6627cb11dcdfc771f8 HTTP/1.1" 200 None 2026-03-06 20:51:02,593 - lava_callback - DEBUG - Processing node 69ab3d6627cb11dcdfc771f8: baseline-arm64-clabbe 2026-03-06 20:51:02,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:51:03,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:51:03,062 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab3d6627cb11dcdfc771f8/log.txt.gz 2026-03-06 20:51:03,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:51:03,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:51:03,452 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab3d6627cb11dcdfc771f8/lava-logs.yaml 2026-03-06 20:51:03,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:51:03,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:51:03,585 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab3d6627cb11dcdfc771f8/lava_callback.json.gz 2026-03-06 20:51:03,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:51:03,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6627cb11dcdfc771f8 HTTP/1.1" 200 None 2026-03-06 20:51:03,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:51:03,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:51:03,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:51:03,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d6627cb11dcdfc771f8 HTTP/1.1" 200 None 2026-03-06 20:51:03,668 - lava_callback - INFO - Completed processing callback for node 69ab3d6627cb11dcdfc771f8 INFO: 172.21.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39046 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:51:28,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:51:28,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:52:43,066 - lava_callback - INFO - Received callback for node 69ab3e6427cb11dcdfc773a3 INFO: 172.21.0.1:53560 - "POST /node/69ab3e6427cb11dcdfc773a3 HTTP/1.0" 202 Accepted 2026-03-06 20:52:43,073 - lava_callback - INFO - Starting async job submit for node 69ab3e6427cb11dcdfc773a3 2026-03-06 20:52:43,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:52:43,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3e6427cb11dcdfc773a3 HTTP/1.1" 200 None 2026-03-06 20:52:43,118 - lava_callback - DEBUG - Processing node 69ab3e6427cb11dcdfc773a3: baseline-arm64 2026-03-06 20:52:43,253 - lava_callback - WARNING - Failed to upload log 2026-03-06 20:52:43,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:52:43,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:52:43,529 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3e6427cb11dcdfc773a3/lava-logs.yaml 2026-03-06 20:52:43,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:52:43,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:52:43,689 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3e6427cb11dcdfc773a3/lava_callback.json.gz 2026-03-06 20:52:43,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:52:43,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3e6427cb11dcdfc773a3 HTTP/1.1" 200 None 2026-03-06 20:52:43,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:52:43,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:52:43,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:52:43,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3e6427cb11dcdfc773a3 HTTP/1.1" 200 None 2026-03-06 20:52:43,855 - lava_callback - INFO - Completed processing callback for node 69ab3e6427cb11dcdfc773a3 INFO: 172.21.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36788 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:52:58,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:52:58,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:54:00,838 - lava_callback - INFO - Received callback for node 69ab3eb127cb11dcdfc773cb INFO: 172.21.0.1:46160 - "POST /node/69ab3eb127cb11dcdfc773cb HTTP/1.0" 202 Accepted 2026-03-06 20:54:00,844 - lava_callback - INFO - Starting async job submit for node 69ab3eb127cb11dcdfc773cb 2026-03-06 20:54:00,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:54:00,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3eb127cb11dcdfc773cb HTTP/1.1" 200 None 2026-03-06 20:54:00,889 - lava_callback - DEBUG - Processing node 69ab3eb127cb11dcdfc773cb: baseline-arm64 2026-03-06 20:54:01,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:54:01,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:54:01,197 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3eb127cb11dcdfc773cb/log.txt.gz 2026-03-06 20:54:01,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:54:01,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:54:01,487 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3eb127cb11dcdfc773cb/lava-logs.yaml 2026-03-06 20:54:01,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:54:01,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:54:01,627 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3eb127cb11dcdfc773cb/lava_callback.json.gz 2026-03-06 20:54:01,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:54:01,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3eb127cb11dcdfc773cb HTTP/1.1" 200 None 2026-03-06 20:54:01,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:54:01,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:54:01,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:54:01,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3eb127cb11dcdfc773cb HTTP/1.1" 200 None 2026-03-06 20:54:01,810 - lava_callback - INFO - Completed processing callback for node 69ab3eb127cb11dcdfc773cb INFO: 172.21.0.1:46170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59080 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:54:28,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:54:28,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57354 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:54:41,411 - lava_callback - INFO - Received callback for node 69a89c03440c1da21c2391bf INFO: 172.21.0.1:55986 - "POST /node/69a89c03440c1da21c2391bf HTTP/1.0" 202 Accepted 2026-03-06 20:54:41,421 - lava_callback - INFO - Starting async job submit for node 69a89c03440c1da21c2391bf 2026-03-06 20:54:41,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:54:41,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89c03440c1da21c2391bf HTTP/1.1" 200 None 2026-03-06 20:54:41,459 - lava_callback - DEBUG - Processing node 69a89c03440c1da21c2391bf: baseline-arm-baylibre 2026-03-06 20:54:41,460 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a89c03440c1da21c2391bf 2026-03-06 20:54:41,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:54:41,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89c03440c1da21c2391bf HTTP/1.1" 200 None 2026-03-06 20:54:41,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:54:41,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-06 20:54:41,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:54:41,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a89c03440c1da21c2391bf HTTP/1.1" 200 None 2026-03-06 20:54:41,547 - lava_callback - ERROR - Error processing callback for node 69a89c03440c1da21c2391bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56002 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:54:52,562 - lava_callback - INFO - Received callback for node 69ab3d3a27cb11dcdfc7713c INFO: 172.21.0.1:56780 - "POST /node/69ab3d3a27cb11dcdfc7713c HTTP/1.0" 202 Accepted 2026-03-06 20:54:52,570 - lava_callback - INFO - Starting async job submit for node 69ab3d3a27cb11dcdfc7713c 2026-03-06 20:54:52,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:54:52,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3a27cb11dcdfc7713c HTTP/1.1" 200 None 2026-03-06 20:54:52,621 - lava_callback - DEBUG - Processing node 69ab3d3a27cb11dcdfc7713c: baseline-arm64 2026-03-06 20:54:53,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:54:53,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:54:53,200 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3a27cb11dcdfc7713c/log.txt.gz 2026-03-06 20:54:53,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:54:53,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:54:53,668 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3a27cb11dcdfc7713c/lava-logs.yaml 2026-03-06 20:54:53,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:54:53,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:54:53,910 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab3d3a27cb11dcdfc7713c/lava_callback.json.gz DEBUG: Setup failed for 69ab3d3a27cb11dcdfc7713c. Transitting job node result: incomplete -> fail 2026-03-06 20:54:53,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:54:54,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3a27cb11dcdfc7713c HTTP/1.1" 200 None 2026-03-06 20:54:54,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:54:54,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:54:54,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:54:54,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d3a27cb11dcdfc7713c HTTP/1.1" 200 None 2026-03-06 20:54:54,157 - lava_callback - INFO - Completed processing callback for node 69ab3d3a27cb11dcdfc7713c INFO: 172.21.0.1:56784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56796 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:54:58,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:54:58,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36428 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:55:21,372 - lava_callback - INFO - Received callback for node 69a89c35440c1da21c2391df INFO: 172.21.0.1:51826 - "POST /node/69a89c35440c1da21c2391df HTTP/1.0" 202 Accepted 2026-03-06 20:55:21,378 - lava_callback - INFO - Starting async job submit for node 69a89c35440c1da21c2391df 2026-03-06 20:55:21,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:55:21,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89c35440c1da21c2391df HTTP/1.1" 200 None 2026-03-06 20:55:21,399 - lava_callback - DEBUG - Processing node 69a89c35440c1da21c2391df: baseline-arm-baylibre 2026-03-06 20:55:21,399 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a89c35440c1da21c2391df 2026-03-06 20:55:21,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:55:21,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89c35440c1da21c2391df HTTP/1.1" 200 None 2026-03-06 20:55:21,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:55:21,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-06 20:55:21,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:55:21,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a89c35440c1da21c2391df HTTP/1.1" 200 None 2026-03-06 20:55:21,456 - lava_callback - ERROR - Error processing callback for node 69a89c35440c1da21c2391df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59662 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:56:41,553 - lava_callback - INFO - Received callback for node 69a89c74440c1da21c239201 INFO: 172.21.0.1:55466 - "POST /node/69a89c74440c1da21c239201 HTTP/1.0" 202 Accepted 2026-03-06 20:56:41,559 - lava_callback - INFO - Starting async job submit for node 69a89c74440c1da21c239201 2026-03-06 20:56:41,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:56:41,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89c74440c1da21c239201 HTTP/1.1" 200 None 2026-03-06 20:56:41,574 - lava_callback - DEBUG - Processing node 69a89c74440c1da21c239201: baseline-arm64-baylibre 2026-03-06 20:56:41,574 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a89c74440c1da21c239201 2026-03-06 20:56:41,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:56:41,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89c74440c1da21c239201 HTTP/1.1" 200 None 2026-03-06 20:56:41,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:56:41,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a7ea227c78d2166ff857f2 HTTP/1.1" 200 None 2026-03-06 20:56:41,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:56:41,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a89c74440c1da21c239201 HTTP/1.1" 200 None 2026-03-06 20:56:41,642 - lava_callback - ERROR - Error processing callback for node 69a89c74440c1da21c239201: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40622 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:57:41,466 - lava_callback - INFO - Received callback for node 69a89cbf440c1da21c239226 INFO: 172.21.0.1:55172 - "POST /node/69a89cbf440c1da21c239226 HTTP/1.0" 202 Accepted 2026-03-06 20:57:41,476 - lava_callback - INFO - Starting async job submit for node 69a89cbf440c1da21c239226 2026-03-06 20:57:41,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:57:41,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89cbf440c1da21c239226 HTTP/1.1" 200 None 2026-03-06 20:57:41,508 - lava_callback - DEBUG - Processing node 69a89cbf440c1da21c239226: baseline-arm-baylibre 2026-03-06 20:57:41,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a89cbf440c1da21c239226 2026-03-06 20:57:41,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:57:41,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89cbf440c1da21c239226 HTTP/1.1" 200 None 2026-03-06 20:57:41,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:57:41,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-06 20:57:41,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:57:41,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a89cbf440c1da21c239226 HTTP/1.1" 200 None 2026-03-06 20:57:41,603 - lava_callback - ERROR - Error processing callback for node 69a89cbf440c1da21c239226: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43478 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:58:30,655 - lava_callback - INFO - Received callback for node 69ab3fb427cb11dcdfc7743e INFO: 172.21.0.1:49800 - "POST /node/69ab3fb427cb11dcdfc7743e HTTP/1.0" 202 Accepted 2026-03-06 20:58:30,661 - lava_callback - INFO - Starting async job submit for node 69ab3fb427cb11dcdfc7743e 2026-03-06 20:58:30,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:58:30,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3fb427cb11dcdfc7743e HTTP/1.1" 200 None 2026-03-06 20:58:30,709 - lava_callback - DEBUG - Processing node 69ab3fb427cb11dcdfc7743e: baseline-arm64-pengutronix 2026-03-06 20:58:30,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:58:31,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:58:31,080 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab3fb427cb11dcdfc7743e/log.txt.gz 2026-03-06 20:58:31,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:58:31,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:58:31,385 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab3fb427cb11dcdfc7743e/lava-logs.yaml 2026-03-06 20:58:31,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 20:58:31,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 20:58:31,558 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab3fb427cb11dcdfc7743e/lava_callback.json.gz 2026-03-06 20:58:31,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:58:31,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3fb427cb11dcdfc7743e HTTP/1.1" 200 None 2026-03-06 20:58:31,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:58:31,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 20:58:31,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:58:31,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3fb427cb11dcdfc7743e HTTP/1.1" 200 None 2026-03-06 20:58:31,641 - lava_callback - INFO - Completed processing callback for node 69ab3fb427cb11dcdfc7743e INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37076 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:58:58,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:58:58,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38320 - "GET / HTTP/1.0" 200 OK 2026-03-06 20:59:21,574 - lava_callback - INFO - Received callback for node 69a89d1d440c1da21c239259 INFO: 172.21.0.1:45584 - "POST /node/69a89d1d440c1da21c239259 HTTP/1.0" 202 Accepted 2026-03-06 20:59:21,580 - lava_callback - INFO - Starting async job submit for node 69a89d1d440c1da21c239259 2026-03-06 20:59:21,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:59:21,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89d1d440c1da21c239259 HTTP/1.1" 200 None 2026-03-06 20:59:21,596 - lava_callback - DEBUG - Processing node 69a89d1d440c1da21c239259: baseline-arm-baylibre 2026-03-06 20:59:21,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a89d1d440c1da21c239259 2026-03-06 20:59:21,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:59:21,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89d1d440c1da21c239259 HTTP/1.1" 200 None 2026-03-06 20:59:21,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:59:21,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-06 20:59:21,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 20:59:21,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a89d1d440c1da21c239259 HTTP/1.1" 200 None 2026-03-06 20:59:21,682 - lava_callback - ERROR - Error processing callback for node 69a89d1d440c1da21c239259: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36930 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:00:11,003 - lava_callback - INFO - Received callback for node 69ab404527cb11dcdfc7747e INFO: 172.21.0.1:38878 - "POST /node/69ab404527cb11dcdfc7747e HTTP/1.0" 202 Accepted 2026-03-06 21:00:11,009 - lava_callback - INFO - Starting async job submit for node 69ab404527cb11dcdfc7747e 2026-03-06 21:00:11,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:00:11,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab404527cb11dcdfc7747e HTTP/1.1" 200 None 2026-03-06 21:00:11,029 - lava_callback - DEBUG - Processing node 69ab404527cb11dcdfc7747e: baseline-nfs-arm64 2026-03-06 21:00:11,030 - lava_callback - WARNING - Failed to upload log 2026-03-06 21:00:11,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:00:11,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:00:11,181 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab404527cb11dcdfc7747e/lava-logs.yaml 2026-03-06 21:00:11,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:00:11,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:00:11,335 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab404527cb11dcdfc7747e/lava_callback.json.gz 2026-03-06 21:00:11,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:00:11,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab404527cb11dcdfc7747e HTTP/1.1" 200 None 2026-03-06 21:00:11,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:00:11,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 21:00:11,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:00:11,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab404527cb11dcdfc7747e HTTP/1.1" 200 None 2026-03-06 21:00:11,398 - lava_callback - INFO - Completed processing callback for node 69ab404527cb11dcdfc7747e INFO: 172.21.0.1:38880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48712 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:00:28,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:00:28,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50234 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:01:41,732 - lava_callback - INFO - Received callback for node 69a89da8440c1da21c239297 INFO: 172.21.0.1:33830 - "POST /node/69a89da8440c1da21c239297 HTTP/1.0" 202 Accepted 2026-03-06 21:01:41,737 - lava_callback - INFO - Starting async job submit for node 69a89da8440c1da21c239297 2026-03-06 21:01:41,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:01:41,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89da8440c1da21c239297 HTTP/1.1" 200 None 2026-03-06 21:01:41,753 - lava_callback - DEBUG - Processing node 69a89da8440c1da21c239297: baseline-arm-baylibre 2026-03-06 21:01:41,753 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a89da8440c1da21c239297 2026-03-06 21:01:41,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:01:41,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89da8440c1da21c239297 HTTP/1.1" 200 None 2026-03-06 21:01:41,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:01:41,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-06 21:01:41,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:01:41,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a89da8440c1da21c239297 HTTP/1.1" 200 None 2026-03-06 21:01:41,811 - lava_callback - ERROR - Error processing callback for node 69a89da8440c1da21c239297: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38006 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:02:21,724 - lava_callback - INFO - Received callback for node 69a89dd9440c1da21c2392b9 INFO: 172.21.0.1:54050 - "POST /node/69a89dd9440c1da21c2392b9 HTTP/1.0" 202 Accepted 2026-03-06 21:02:21,729 - lava_callback - INFO - Starting async job submit for node 69a89dd9440c1da21c2392b9 2026-03-06 21:02:21,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:02:21,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89dd9440c1da21c2392b9 HTTP/1.1" 200 None 2026-03-06 21:02:21,746 - lava_callback - DEBUG - Processing node 69a89dd9440c1da21c2392b9: baseline-arm-baylibre 2026-03-06 21:02:21,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a89dd9440c1da21c2392b9 2026-03-06 21:02:21,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:02:21,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89dd9440c1da21c2392b9 HTTP/1.1" 200 None 2026-03-06 21:02:21,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:02:21,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-06 21:02:21,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:02:21,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a89dd9440c1da21c2392b9 HTTP/1.1" 200 None 2026-03-06 21:02:21,798 - lava_callback - ERROR - Error processing callback for node 69a89dd9440c1da21c2392b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:03:29,493 - lava_callback - INFO - Received callback for node 69ab40dc27cb11dcdfc774b4 INFO: 172.21.0.1:45508 - "POST /node/69ab40dc27cb11dcdfc774b4 HTTP/1.0" 202 Accepted 2026-03-06 21:03:29,500 - lava_callback - INFO - Starting async job submit for node 69ab40dc27cb11dcdfc774b4 2026-03-06 21:03:29,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:03:29,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab40dc27cb11dcdfc774b4 HTTP/1.1" 200 None 2026-03-06 21:03:29,578 - lava_callback - DEBUG - Processing node 69ab40dc27cb11dcdfc774b4: baseline-arm64 2026-03-06 21:03:29,713 - lava_callback - WARNING - Failed to upload log 2026-03-06 21:03:29,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:03:29,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:03:29,997 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab40dc27cb11dcdfc774b4/lava-logs.yaml 2026-03-06 21:03:30,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:03:30,154 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:03:30,156 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab40dc27cb11dcdfc774b4/lava_callback.json.gz 2026-03-06 21:03:30,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:03:30,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab40dc27cb11dcdfc774b4 HTTP/1.1" 200 None 2026-03-06 21:03:30,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:03:30,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 21:03:30,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:03:30,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab40dc27cb11dcdfc774b4 HTTP/1.1" 200 None 2026-03-06 21:03:30,310 - lava_callback - INFO - Completed processing callback for node 69ab40dc27cb11dcdfc774b4 INFO: 172.21.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:03:58,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:03:58,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37940 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:05:57,090 - lava_callback - INFO - Received callback for node 69ab412b27cb11dcdfc774d8 INFO: 172.21.0.1:37948 - "POST /node/69ab412b27cb11dcdfc774d8 HTTP/1.0" 202 Accepted 2026-03-06 21:05:57,097 - lava_callback - INFO - Starting async job submit for node 69ab412b27cb11dcdfc774d8 2026-03-06 21:05:57,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:05:57,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab412b27cb11dcdfc774d8 HTTP/1.1" 200 None 2026-03-06 21:05:57,143 - lava_callback - DEBUG - Processing node 69ab412b27cb11dcdfc774d8: baseline-arm64 2026-03-06 21:05:57,341 - lava_callback - WARNING - Failed to upload log 2026-03-06 21:05:57,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:05:57,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:05:57,689 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab412b27cb11dcdfc774d8/lava-logs.yaml 2026-03-06 21:05:57,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:05:57,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:05:57,838 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab412b27cb11dcdfc774d8/lava_callback.json.gz 2026-03-06 21:05:57,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:05:57,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab412b27cb11dcdfc774d8 HTTP/1.1" 200 None 2026-03-06 21:05:57,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:05:57,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 21:05:57,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:05:57,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab412b27cb11dcdfc774d8 HTTP/1.1" 200 None 2026-03-06 21:05:58,018 - lava_callback - INFO - Completed processing callback for node 69ab412b27cb11dcdfc774d8 2026-03-06 21:05:58,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:05:58,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:07:04,018 - lava_callback - INFO - Received callback for node 69ab3d3f27cb11dcdfc77149 INFO: 172.21.0.1:50894 - "POST /node/69ab3d3f27cb11dcdfc77149 HTTP/1.0" 202 Accepted 2026-03-06 21:07:04,027 - lava_callback - INFO - Starting async job submit for node 69ab3d3f27cb11dcdfc77149 2026-03-06 21:07:04,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:07:04,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3f27cb11dcdfc77149 HTTP/1.1" 200 None 2026-03-06 21:07:04,086 - lava_callback - DEBUG - Processing node 69ab3d3f27cb11dcdfc77149: baseline-nfs-arm64 2026-03-06 21:07:05,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:07:05,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:07:05,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d3f27cb11dcdfc77149/log.txt.gz 2026-03-06 21:07:06,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:07:06,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:07:06,445 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d3f27cb11dcdfc77149/lava-logs.yaml 2026-03-06 21:07:06,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:50900 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:07:06,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:07:06,655 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab3d3f27cb11dcdfc77149/lava_callback.json.gz DEBUG: Setup failed for 69ab3d3f27cb11dcdfc77149. Transitting job node result: incomplete -> fail 2026-03-06 21:07:06,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:07:06,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d3f27cb11dcdfc77149 HTTP/1.1" 200 None 2026-03-06 21:07:06,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:07:06,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 21:07:06,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:07:06,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d3f27cb11dcdfc77149 HTTP/1.1" 200 None 2026-03-06 21:07:06,950 - lava_callback - INFO - Completed processing callback for node 69ab3d3f27cb11dcdfc77149 INFO: 172.21.0.1:37738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:07:22,131 - lava_callback - INFO - Received callback for node 69a89f00440c1da21c239373 INFO: 172.21.0.1:48622 - "POST /node/69a89f00440c1da21c239373 HTTP/1.0" 202 Accepted 2026-03-06 21:07:22,137 - lava_callback - INFO - Starting async job submit for node 69a89f00440c1da21c239373 2026-03-06 21:07:22,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:07:22,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89f00440c1da21c239373 HTTP/1.1" 200 None 2026-03-06 21:07:22,154 - lava_callback - DEBUG - Processing node 69a89f00440c1da21c239373: baseline-arm-baylibre 2026-03-06 21:07:22,154 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a89f00440c1da21c239373 2026-03-06 21:07:22,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:07:22,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89f00440c1da21c239373 HTTP/1.1" 200 None 2026-03-06 21:07:22,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:07:22,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-06 21:07:22,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:07:22,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a89f00440c1da21c239373 HTTP/1.1" 200 None 2026-03-06 21:07:22,209 - lava_callback - ERROR - Error processing callback for node 69a89f00440c1da21c239373: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:07:28,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:07:28,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54190 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:08:22,039 - lava_callback - INFO - Received callback for node 69a89f31440c1da21c239390 INFO: 172.21.0.1:40088 - "POST /node/69a89f31440c1da21c239390 HTTP/1.0" 202 Accepted 2026-03-06 21:08:22,045 - lava_callback - INFO - Starting async job submit for node 69a89f31440c1da21c239390 2026-03-06 21:08:22,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:08:22,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89f31440c1da21c239390 HTTP/1.1" 200 None 2026-03-06 21:08:22,060 - lava_callback - DEBUG - Processing node 69a89f31440c1da21c239390: baseline-arm-baylibre 2026-03-06 21:08:22,061 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a89f31440c1da21c239390 2026-03-06 21:08:22,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:08:22,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89f31440c1da21c239390 HTTP/1.1" 200 None 2026-03-06 21:08:22,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:08:22,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-06 21:08:22,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:08:22,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a89f31440c1da21c239390 HTTP/1.1" 200 None 2026-03-06 21:08:22,133 - lava_callback - ERROR - Error processing callback for node 69a89f31440c1da21c239390: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50068 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:08:44,965 - lava_callback - INFO - Received callback for node 69ab3d6727cb11dcdfc771fb INFO: 172.21.0.1:48546 - "POST /node/69ab3d6727cb11dcdfc771fb HTTP/1.0" 202 Accepted 2026-03-06 21:08:44,972 - lava_callback - INFO - Starting async job submit for node 69ab3d6727cb11dcdfc771fb 2026-03-06 21:08:45,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:08:45,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6727cb11dcdfc771fb HTTP/1.1" 200 None 2026-03-06 21:08:45,039 - lava_callback - DEBUG - Processing node 69ab3d6727cb11dcdfc771fb: baseline-arm64-clabbe 2026-03-06 21:08:45,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:08:45,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:08:45,782 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab3d6727cb11dcdfc771fb/log.txt.gz 2026-03-06 21:08:46,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:08:46,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:08:46,394 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab3d6727cb11dcdfc771fb/lava-logs.yaml 2026-03-06 21:08:46,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:48562 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:08:46,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:08:46,559 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab3d6727cb11dcdfc771fb/lava_callback.json.gz DEBUG: Setup failed for 69ab3d6727cb11dcdfc771fb. Transitting job node result: incomplete -> fail 2026-03-06 21:08:46,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:08:46,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d6727cb11dcdfc771fb HTTP/1.1" 200 None 2026-03-06 21:08:46,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:08:46,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 21:08:46,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:08:46,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d6727cb11dcdfc771fb HTTP/1.1" 200 None 2026-03-06 21:08:46,812 - lava_callback - INFO - Completed processing callback for node 69ab3d6727cb11dcdfc771fb INFO: 172.21.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:08:58,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:08:58,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-06 21:09:02,154 - lava_callback - INFO - Received callback for node 69a89f61440c1da21c2393c3 INFO: 172.21.0.1:53538 - "POST /node/69a89f61440c1da21c2393c3 HTTP/1.0" 202 Accepted 2026-03-06 21:09:02,159 - lava_callback - INFO - Starting async job submit for node 69a89f61440c1da21c2393c3 2026-03-06 21:09:02,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:09:02,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89f61440c1da21c2393c3 HTTP/1.1" 200 None 2026-03-06 21:09:02,182 - lava_callback - DEBUG - Processing node 69a89f61440c1da21c2393c3: baseline-arm-baylibre 2026-03-06 21:09:02,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a89f61440c1da21c2393c3 2026-03-06 21:09:02,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:09:02,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89f61440c1da21c2393c3 HTTP/1.1" 200 None 2026-03-06 21:09:02,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:09:02,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-06 21:09:02,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:09:02,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a89f61440c1da21c2393c3 HTTP/1.1" 200 None 2026-03-06 21:09:02,240 - lava_callback - ERROR - Error processing callback for node 69a89f61440c1da21c2393c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41470 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:09:42,118 - lava_callback - INFO - Received callback for node 69a89f92440c1da21c2393eb INFO: 172.21.0.1:48230 - "POST /node/69a89f92440c1da21c2393eb HTTP/1.0" 202 Accepted 2026-03-06 21:09:42,124 - lava_callback - INFO - Starting async job submit for node 69a89f92440c1da21c2393eb 2026-03-06 21:09:42,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:09:42,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89f92440c1da21c2393eb HTTP/1.1" 200 None 2026-03-06 21:09:42,140 - lava_callback - DEBUG - Processing node 69a89f92440c1da21c2393eb: baseline-arm-baylibre 2026-03-06 21:09:42,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a89f92440c1da21c2393eb 2026-03-06 21:09:42,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:09:42,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89f92440c1da21c2393eb HTTP/1.1" 200 None 2026-03-06 21:09:42,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:09:42,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-06 21:09:42,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:09:42,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a89f92440c1da21c2393eb HTTP/1.1" 200 None 2026-03-06 21:09:42,247 - lava_callback - ERROR - Error processing callback for node 69a89f92440c1da21c2393eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39054 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:10:40,470 - lava_callback - INFO - Received callback for node 69ab42bd27cb11dcdfc77577 INFO: 172.21.0.1:59892 - "POST /node/69ab42bd27cb11dcdfc77577 HTTP/1.0" 202 Accepted 2026-03-06 21:10:40,476 - lava_callback - INFO - Starting async job submit for node 69ab42bd27cb11dcdfc77577 2026-03-06 21:10:40,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:10:40,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab42bd27cb11dcdfc77577 HTTP/1.1" 200 None 2026-03-06 21:10:40,497 - lava_callback - DEBUG - Processing node 69ab42bd27cb11dcdfc77577: baseline-nfs-arm64 2026-03-06 21:10:40,498 - lava_callback - WARNING - Failed to upload log 2026-03-06 21:10:40,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:10:40,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:10:40,653 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab42bd27cb11dcdfc77577/lava-logs.yaml 2026-03-06 21:10:40,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:10:40,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:10:40,800 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab42bd27cb11dcdfc77577/lava_callback.json.gz 2026-03-06 21:10:40,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:10:40,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab42bd27cb11dcdfc77577 HTTP/1.1" 200 None 2026-03-06 21:10:40,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:10:40,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 21:10:40,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:10:40,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab42bd27cb11dcdfc77577 HTTP/1.1" 200 None 2026-03-06 21:10:40,878 - lava_callback - INFO - Completed processing callback for node 69ab42bd27cb11dcdfc77577 2026-03-06 21:10:42,260 - lava_callback - INFO - Received callback for node 69a89fc3440c1da21c239404 INFO: 172.21.0.1:59900 - "POST /node/69a89fc3440c1da21c239404 HTTP/1.0" 202 Accepted 2026-03-06 21:10:42,266 - lava_callback - INFO - Starting async job submit for node 69a89fc3440c1da21c239404 2026-03-06 21:10:42,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:10:42,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89fc3440c1da21c239404 HTTP/1.1" 200 None 2026-03-06 21:10:42,285 - lava_callback - DEBUG - Processing node 69a89fc3440c1da21c239404: baseline-arm-baylibre 2026-03-06 21:10:42,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a89fc3440c1da21c239404 2026-03-06 21:10:42,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:10:42,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89fc3440c1da21c239404 HTTP/1.1" 200 None 2026-03-06 21:10:42,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:10:42,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-06 21:10:42,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:10:42,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a89fc3440c1da21c239404 HTTP/1.1" 200 None 2026-03-06 21:10:42,369 - lava_callback - ERROR - Error processing callback for node 69a89fc3440c1da21c239404: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:10:58,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:10:58,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43088 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:11:22,221 - lava_callback - INFO - Received callback for node 69a89ff3440c1da21c239427 INFO: 172.21.0.1:50438 - "POST /node/69a89ff3440c1da21c239427 HTTP/1.0" 202 Accepted 2026-03-06 21:11:22,226 - lava_callback - INFO - Starting async job submit for node 69a89ff3440c1da21c239427 2026-03-06 21:11:22,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:11:22,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89ff3440c1da21c239427 HTTP/1.1" 200 None 2026-03-06 21:11:22,242 - lava_callback - DEBUG - Processing node 69a89ff3440c1da21c239427: baseline-arm-baylibre 2026-03-06 21:11:22,243 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a89ff3440c1da21c239427 2026-03-06 21:11:22,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:11:22,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a89ff3440c1da21c239427 HTTP/1.1" 200 None 2026-03-06 21:11:22,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:11:22,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-06 21:11:22,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:11:22,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a89ff3440c1da21c239427 HTTP/1.1" 200 None 2026-03-06 21:11:22,319 - lava_callback - ERROR - Error processing callback for node 69a89ff3440c1da21c239427: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38554 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:14:12,787 - lava_callback - INFO - Received callback for node 69ab41cf27cb11dcdfc77509 INFO: 172.21.0.1:45010 - "POST /node/69ab41cf27cb11dcdfc77509 HTTP/1.0" 202 Accepted 2026-03-06 21:14:12,794 - lava_callback - INFO - Starting async job submit for node 69ab41cf27cb11dcdfc77509 2026-03-06 21:14:12,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:14:12,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab41cf27cb11dcdfc77509 HTTP/1.1" 200 None 2026-03-06 21:14:12,846 - lava_callback - DEBUG - Processing node 69ab41cf27cb11dcdfc77509: baseline-arm64 2026-03-06 21:14:13,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:14:13,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:14:13,350 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab41cf27cb11dcdfc77509/log.txt.gz 2026-03-06 21:14:13,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:45014 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-06 21:14:15,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:14:15,323 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab41cf27cb11dcdfc77509/lava-logs.yaml 2026-03-06 21:14:15,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:14:16,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:14:16,255 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab41cf27cb11dcdfc77509/lava_callback.json.gz DEBUG: Setup failed for 69ab41cf27cb11dcdfc77509. Transitting job node result: incomplete -> fail 2026-03-06 21:14:16,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:14:16,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab41cf27cb11dcdfc77509 HTTP/1.1" 200 None 2026-03-06 21:14:16,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:14:16,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 21:14:16,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:14:16,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab41cf27cb11dcdfc77509 HTTP/1.1" 200 None 2026-03-06 21:14:16,491 - lava_callback - INFO - Completed processing callback for node 69ab41cf27cb11dcdfc77509 INFO: 172.21.0.1:45016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:14:28,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:14:28,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59016 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:16:31,169 - lava_callback - INFO - Received callback for node 69ab43a327cb11dcdfc775cc INFO: 172.21.0.1:38810 - "POST /node/69ab43a327cb11dcdfc775cc HTTP/1.0" 202 Accepted 2026-03-06 21:16:31,176 - lava_callback - INFO - Starting async job submit for node 69ab43a327cb11dcdfc775cc 2026-03-06 21:16:31,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:16:31,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab43a327cb11dcdfc775cc HTTP/1.1" 200 None 2026-03-06 21:16:31,227 - lava_callback - DEBUG - Processing node 69ab43a327cb11dcdfc775cc: baseline-arm64 2026-03-06 21:16:31,376 - lava_callback - WARNING - Failed to upload log 2026-03-06 21:16:31,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:16:35,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:16:35,611 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab43a327cb11dcdfc775cc/lava-logs.yaml 2026-03-06 21:16:35,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:16:35,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:16:35,721 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab43a327cb11dcdfc775cc/lava_callback.json.gz 2026-03-06 21:16:35,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:16:35,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab43a327cb11dcdfc775cc HTTP/1.1" 200 None 2026-03-06 21:16:35,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:16:35,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 21:16:35,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:16:35,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab43a327cb11dcdfc775cc HTTP/1.1" 200 None 2026-03-06 21:16:35,867 - lava_callback - INFO - Completed processing callback for node 69ab43a327cb11dcdfc775cc INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:16:40,950 - lava_callback - INFO - Received callback for node 69aa25658c4d487a0e751ae5 INFO: 172.21.0.1:51180 - "POST /node/69aa25658c4d487a0e751ae5 HTTP/1.0" 202 Accepted 2026-03-06 21:16:40,956 - lava_callback - INFO - Starting async job submit for node 69aa25658c4d487a0e751ae5 2026-03-06 21:16:40,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:16:40,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa25658c4d487a0e751ae5 HTTP/1.1" 200 None 2026-03-06 21:16:41,000 - lava_callback - DEBUG - Processing node 69aa25658c4d487a0e751ae5: baseline-arm64-broonie 2026-03-06 21:16:41,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:16:41,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:16:41,396 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aa25658c4d487a0e751ae5/log.txt.gz 2026-03-06 21:16:41,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:16:41,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:16:41,822 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aa25658c4d487a0e751ae5/lava-logs.yaml 2026-03-06 21:16:41,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:16:41,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:16:41,974 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aa25658c4d487a0e751ae5/lava_callback.json.gz 2026-03-06 21:16:41,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:16:42,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa25658c4d487a0e751ae5 HTTP/1.1" 200 None 2026-03-06 21:16:42,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:16:42,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-06 21:16:42,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:16:42,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa25658c4d487a0e751ae5 HTTP/1.1" 200 None 2026-03-06 21:16:42,066 - lava_callback - INFO - Completed processing callback for node 69aa25658c4d487a0e751ae5 2026-03-06 21:16:42,573 - lava_callback - INFO - Received callback for node 69a8a130440c1da21c2394b5 INFO: 172.21.0.1:51182 - "POST /node/69a8a130440c1da21c2394b5 HTTP/1.0" 202 Accepted 2026-03-06 21:16:42,578 - lava_callback - INFO - Starting async job submit for node 69a8a130440c1da21c2394b5 2026-03-06 21:16:42,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:16:42,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8a130440c1da21c2394b5 HTTP/1.1" 200 None 2026-03-06 21:16:42,596 - lava_callback - DEBUG - Processing node 69a8a130440c1da21c2394b5: baseline-arm64-baylibre 2026-03-06 21:16:42,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8a130440c1da21c2394b5 2026-03-06 21:16:42,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:16:42,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8a130440c1da21c2394b5 HTTP/1.1" 200 None 2026-03-06 21:16:42,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:16:42,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-06 21:16:42,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:16:42,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8a130440c1da21c2394b5 HTTP/1.1" 200 None 2026-03-06 21:16:42,657 - lava_callback - ERROR - Error processing callback for node 69a8a130440c1da21c2394b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58174 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:16:58,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:16:58,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34682 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:17:56,177 - lava_callback - INFO - Received callback for node 69ab43ff27cb11dcdfc775f2 INFO: 172.21.0.1:34686 - "POST /node/69ab43ff27cb11dcdfc775f2 HTTP/1.0" 202 Accepted 2026-03-06 21:17:56,184 - lava_callback - INFO - Starting async job submit for node 69ab43ff27cb11dcdfc775f2 2026-03-06 21:17:56,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:17:56,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab43ff27cb11dcdfc775f2 HTTP/1.1" 200 None 2026-03-06 21:17:56,236 - lava_callback - DEBUG - Processing node 69ab43ff27cb11dcdfc775f2: baseline-arm64 2026-03-06 21:17:56,429 - lava_callback - WARNING - Failed to upload log INFO: 172.21.0.1:34688 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:17:56,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:17:56,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:17:56,752 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab43ff27cb11dcdfc775f2/lava-logs.yaml 2026-03-06 21:17:56,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:17:56,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:17:56,890 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab43ff27cb11dcdfc775f2/lava_callback.json.gz 2026-03-06 21:17:56,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:17:56,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab43ff27cb11dcdfc775f2 HTTP/1.1" 200 None 2026-03-06 21:17:56,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:17:56,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 21:17:56,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:17:56,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab43ff27cb11dcdfc775f2 HTTP/1.1" 200 None 2026-03-06 21:17:57,077 - lava_callback - INFO - Completed processing callback for node 69ab43ff27cb11dcdfc775f2 2026-03-06 21:17:58,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:17:58,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53812 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:18:40,765 - lava_callback - INFO - Received callback for node 69aa7bd98c4d487a0e753de4 INFO: 172.21.0.1:35944 - "POST /node/69aa7bd98c4d487a0e753de4 HTTP/1.0" 202 Accepted 2026-03-06 21:18:40,771 - lava_callback - INFO - Starting async job submit for node 69aa7bd98c4d487a0e753de4 2026-03-06 21:18:40,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:18:40,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa7bd98c4d487a0e753de4 HTTP/1.1" 200 None 2026-03-06 21:18:40,809 - lava_callback - DEBUG - Processing node 69aa7bd98c4d487a0e753de4: baseline-arm64-broonie 2026-03-06 21:18:41,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:18:41,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:18:41,215 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aa7bd98c4d487a0e753de4/log.txt.gz 2026-03-06 21:18:41,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:18:41,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:18:41,583 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aa7bd98c4d487a0e753de4/lava-logs.yaml 2026-03-06 21:18:41,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:18:41,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:18:41,738 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aa7bd98c4d487a0e753de4/lava_callback.json.gz 2026-03-06 21:18:41,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:18:41,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa7bd98c4d487a0e753de4 HTTP/1.1" 200 None 2026-03-06 21:18:41,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:18:41,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d4a8c4d487a0e751161 HTTP/1.1" 200 None 2026-03-06 21:18:41,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:18:41,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa7bd98c4d487a0e753de4 HTTP/1.1" 200 None 2026-03-06 21:18:41,821 - lava_callback - INFO - Completed processing callback for node 69aa7bd98c4d487a0e753de4 INFO: 172.21.0.1:35958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54194 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:18:58,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:18:59,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38128 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:19:42,729 - lava_callback - INFO - Received callback for node 69a8a1e3440c1da21c2394fa INFO: 172.21.0.1:58918 - "POST /node/69a8a1e3440c1da21c2394fa HTTP/1.0" 202 Accepted 2026-03-06 21:19:42,735 - lava_callback - INFO - Starting async job submit for node 69a8a1e3440c1da21c2394fa 2026-03-06 21:19:42,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:19:42,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8a1e3440c1da21c2394fa HTTP/1.1" 200 None 2026-03-06 21:19:42,750 - lava_callback - DEBUG - Processing node 69a8a1e3440c1da21c2394fa: baseline-arm64-baylibre 2026-03-06 21:19:42,750 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8a1e3440c1da21c2394fa 2026-03-06 21:19:42,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:19:42,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8a1e3440c1da21c2394fa HTTP/1.1" 200 None 2026-03-06 21:19:42,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:19:42,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-06 21:19:42,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:19:42,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8a1e3440c1da21c2394fa HTTP/1.1" 200 None 2026-03-06 21:19:42,836 - lava_callback - ERROR - Error processing callback for node 69a8a1e3440c1da21c2394fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43672 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:20:40,843 - lava_callback - INFO - Received callback for node 69ab08fd27cb11dcdfc75d31 INFO: 172.21.0.1:58802 - "POST /node/69ab08fd27cb11dcdfc75d31 HTTP/1.0" 202 Accepted 2026-03-06 21:20:40,849 - lava_callback - INFO - Starting async job submit for node 69ab08fd27cb11dcdfc75d31 2026-03-06 21:20:40,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:20:40,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab08fd27cb11dcdfc75d31 HTTP/1.1" 200 None 2026-03-06 21:20:40,887 - lava_callback - DEBUG - Processing node 69ab08fd27cb11dcdfc75d31: baseline-arm64-broonie 2026-03-06 21:20:41,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:20:41,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:20:41,312 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab08fd27cb11dcdfc75d31/log.txt.gz 2026-03-06 21:20:41,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:20:41,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:20:41,764 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab08fd27cb11dcdfc75d31/lava-logs.yaml 2026-03-06 21:20:41,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:20:41,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:20:41,906 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab08fd27cb11dcdfc75d31/lava_callback.json.gz 2026-03-06 21:20:41,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:20:41,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab08fd27cb11dcdfc75d31 HTTP/1.1" 200 None 2026-03-06 21:20:41,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:20:42,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85aff440c1da21c2371fe HTTP/1.1" 200 None 2026-03-06 21:20:42,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:20:42,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab08fd27cb11dcdfc75d31 HTTP/1.1" 200 None 2026-03-06 21:20:42,034 - lava_callback - INFO - Completed processing callback for node 69ab08fd27cb11dcdfc75d31 INFO: 172.21.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50510 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:20:59,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:20:59,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40168 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:21:22,881 - lava_callback - INFO - Received callback for node 69a8a23d440c1da21c23953a INFO: 172.21.0.1:49244 - "POST /node/69a8a23d440c1da21c23953a HTTP/1.0" 202 Accepted 2026-03-06 21:21:22,887 - lava_callback - INFO - Starting async job submit for node 69a8a23d440c1da21c23953a 2026-03-06 21:21:22,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:21:22,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8a23d440c1da21c23953a HTTP/1.1" 200 None 2026-03-06 21:21:22,914 - lava_callback - DEBUG - Processing node 69a8a23d440c1da21c23953a: baseline-arm64-baylibre 2026-03-06 21:21:22,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8a23d440c1da21c23953a 2026-03-06 21:21:22,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:21:22,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8a23d440c1da21c23953a HTTP/1.1" 200 None 2026-03-06 21:21:22,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:21:22,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-06 21:21:22,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:21:22,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8a23d440c1da21c23953a HTTP/1.1" 200 None 2026-03-06 21:21:22,992 - lava_callback - ERROR - Error processing callback for node 69a8a23d440c1da21c23953a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59168 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:22:42,900 - lava_callback - INFO - Received callback for node 69a8a295440c1da21c239572 INFO: 172.21.0.1:36158 - "POST /node/69a8a295440c1da21c239572 HTTP/1.0" 202 Accepted 2026-03-06 21:22:42,905 - lava_callback - INFO - Starting async job submit for node 69a8a295440c1da21c239572 2026-03-06 21:22:42,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:22:42,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8a295440c1da21c239572 HTTP/1.1" 200 None 2026-03-06 21:22:42,929 - lava_callback - DEBUG - Processing node 69a8a295440c1da21c239572: baseline-arm64-baylibre 2026-03-06 21:22:42,929 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8a295440c1da21c239572 2026-03-06 21:22:42,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:22:42,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8a295440c1da21c239572 HTTP/1.1" 200 None 2026-03-06 21:22:42,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:22:42,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-06 21:22:42,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:22:42,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8a295440c1da21c239572 HTTP/1.1" 200 None 2026-03-06 21:22:42,986 - lava_callback - ERROR - Error processing callback for node 69a8a295440c1da21c239572: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55814 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:24:02,917 - lava_callback - INFO - Received callback for node 69a8a2ef440c1da21c2395bb INFO: 172.21.0.1:42638 - "POST /node/69a8a2ef440c1da21c2395bb HTTP/1.0" 202 Accepted 2026-03-06 21:24:02,922 - lava_callback - INFO - Starting async job submit for node 69a8a2ef440c1da21c2395bb 2026-03-06 21:24:02,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:24:02,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8a2ef440c1da21c2395bb HTTP/1.1" 200 None 2026-03-06 21:24:02,945 - lava_callback - DEBUG - Processing node 69a8a2ef440c1da21c2395bb: baseline-arm64-baylibre 2026-03-06 21:24:02,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8a2ef440c1da21c2395bb 2026-03-06 21:24:02,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:24:02,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8a2ef440c1da21c2395bb HTTP/1.1" 200 None 2026-03-06 21:24:02,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:24:02,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-06 21:24:02,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:24:03,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8a2ef440c1da21c2395bb HTTP/1.1" 200 None 2026-03-06 21:24:03,009 - lava_callback - ERROR - Error processing callback for node 69a8a2ef440c1da21c2395bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42958 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:27:03,167 - lava_callback - INFO - Received callback for node 69a8a3a1440c1da21c2395fa INFO: 172.21.0.1:50480 - "POST /node/69a8a3a1440c1da21c2395fa HTTP/1.0" 202 Accepted 2026-03-06 21:27:03,173 - lava_callback - INFO - Starting async job submit for node 69a8a3a1440c1da21c2395fa 2026-03-06 21:27:03,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:27:03,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8a3a1440c1da21c2395fa HTTP/1.1" 200 None 2026-03-06 21:27:03,190 - lava_callback - DEBUG - Processing node 69a8a3a1440c1da21c2395fa: baseline-arm64-baylibre 2026-03-06 21:27:03,190 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8a3a1440c1da21c2395fa 2026-03-06 21:27:03,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:27:03,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8a3a1440c1da21c2395fa HTTP/1.1" 200 None 2026-03-06 21:27:03,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:27:03,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-06 21:27:03,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:27:03,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8a3a1440c1da21c2395fa HTTP/1.1" 200 None 2026-03-06 21:27:03,260 - lava_callback - ERROR - Error processing callback for node 69a8a3a1440c1da21c2395fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:27:24,630 - lava_callback - INFO - Received callback for node 69ab458827cb11dcdfc77693 INFO: 172.21.0.1:36010 - "POST /node/69ab458827cb11dcdfc77693 HTTP/1.0" 202 Accepted 2026-03-06 21:27:24,638 - lava_callback - INFO - Starting async job submit for node 69ab458827cb11dcdfc77693 2026-03-06 21:27:24,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:27:24,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab458827cb11dcdfc77693 HTTP/1.1" 200 None 2026-03-06 21:27:24,693 - lava_callback - DEBUG - Processing node 69ab458827cb11dcdfc77693: baseline-arm64 2026-03-06 21:27:25,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:27:25,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:27:25,232 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab458827cb11dcdfc77693/log.txt.gz 2026-03-06 21:27:25,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:27:25,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:27:25,660 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab458827cb11dcdfc77693/lava-logs.yaml 2026-03-06 21:27:25,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:27:25,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:27:25,823 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab458827cb11dcdfc77693/lava_callback.json.gz DEBUG: Setup failed for 69ab458827cb11dcdfc77693. Transitting job node result: incomplete -> fail 2026-03-06 21:27:25,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:27:25,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab458827cb11dcdfc77693 HTTP/1.1" 200 None 2026-03-06 21:27:25,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:27:25,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 21:27:25,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:27:25,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab458827cb11dcdfc77693 HTTP/1.1" 200 None 2026-03-06 21:27:26,064 - lava_callback - INFO - Completed processing callback for node 69ab458827cb11dcdfc77693 INFO: 172.21.0.1:36014 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:27:29,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:27:29,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43184 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:30:03,271 - lava_callback - INFO - Received callback for node 69a8a451440c1da21c239667 INFO: 172.21.0.1:45226 - "POST /node/69a8a451440c1da21c239667 HTTP/1.0" 202 Accepted 2026-03-06 21:30:03,276 - lava_callback - INFO - Starting async job submit for node 69a8a451440c1da21c239667 2026-03-06 21:30:03,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:30:03,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8a451440c1da21c239667 HTTP/1.1" 200 None 2026-03-06 21:30:03,304 - lava_callback - DEBUG - Processing node 69a8a451440c1da21c239667: baseline-arm64-baylibre 2026-03-06 21:30:03,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8a451440c1da21c239667 2026-03-06 21:30:03,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:30:03,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8a451440c1da21c239667 HTTP/1.1" 200 None 2026-03-06 21:30:03,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:30:03,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-06 21:30:03,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:30:03,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8a451440c1da21c239667 HTTP/1.1" 200 None 2026-03-06 21:30:03,362 - lava_callback - ERROR - Error processing callback for node 69a8a451440c1da21c239667: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46150 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:35:02,210 - lava_callback - INFO - Received callback for node 69ab46c427cb11dcdfc776fc INFO: 172.21.0.1:51516 - "POST /node/69ab46c427cb11dcdfc776fc HTTP/1.0" 202 Accepted 2026-03-06 21:35:02,222 - lava_callback - INFO - Starting async job submit for node 69ab46c427cb11dcdfc776fc 2026-03-06 21:35:02,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:35:02,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab46c427cb11dcdfc776fc HTTP/1.1" 200 None 2026-03-06 21:35:02,324 - lava_callback - DEBUG - Processing node 69ab46c427cb11dcdfc776fc: baseline-arm64 2026-03-06 21:35:02,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:35:03,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:35:03,054 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab46c427cb11dcdfc776fc/log.txt.gz 2026-03-06 21:35:03,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:35:03,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:35:03,777 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab46c427cb11dcdfc776fc/lava-logs.yaml 2026-03-06 21:35:03,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:35:04,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:35:04,218 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab46c427cb11dcdfc776fc/lava_callback.json.gz DEBUG: Setup failed for 69ab46c427cb11dcdfc776fc. Transitting job node result: incomplete -> fail 2026-03-06 21:35:04,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:35:04,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab46c427cb11dcdfc776fc HTTP/1.1" 200 None 2026-03-06 21:35:04,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:35:04,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 21:35:04,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:35:04,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab46c427cb11dcdfc776fc HTTP/1.1" 200 None 2026-03-06 21:35:04,499 - lava_callback - INFO - Completed processing callback for node 69ab46c427cb11dcdfc776fc INFO: 172.21.0.1:51522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:35:29,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:35:29,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57702 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:35:41,408 - lava_callback - INFO - Received callback for node 69ab3d5927cb11dcdfc771a7 INFO: 172.21.0.1:39312 - "POST /node/69ab3d5927cb11dcdfc771a7 HTTP/1.0" 202 Accepted 2026-03-06 21:35:41,414 - lava_callback - INFO - Starting async job submit for node 69ab3d5927cb11dcdfc771a7 2026-03-06 21:35:41,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:35:41,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d5927cb11dcdfc771a7 HTTP/1.1" 200 None 2026-03-06 21:35:41,451 - lava_callback - DEBUG - Processing node 69ab3d5927cb11dcdfc771a7: baseline-arm64-broonie 2026-03-06 21:35:41,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:35:41,928 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:35:41,929 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5927cb11dcdfc771a7/log.txt.gz 2026-03-06 21:35:42,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:35:42,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:35:42,426 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5927cb11dcdfc771a7/lava-logs.yaml 2026-03-06 21:35:42,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:35:42,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:35:42,577 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5927cb11dcdfc771a7/lava_callback.json.gz 2026-03-06 21:35:42,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:35:42,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d5927cb11dcdfc771a7 HTTP/1.1" 200 None 2026-03-06 21:35:42,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:35:42,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 21:35:42,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:35:42,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d5927cb11dcdfc771a7 HTTP/1.1" 200 None 2026-03-06 21:35:42,663 - lava_callback - INFO - Completed processing callback for node 69ab3d5927cb11dcdfc771a7 INFO: 172.21.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37702 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:35:59,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:35:59,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:39:41,541 - lava_callback - INFO - Received callback for node 69ab44bb27cb11dcdfc77643 INFO: 172.21.0.1:59314 - "POST /node/69ab44bb27cb11dcdfc77643 HTTP/1.0" 202 Accepted 2026-03-06 21:39:41,548 - lava_callback - INFO - Starting async job submit for node 69ab44bb27cb11dcdfc77643 2026-03-06 21:39:41,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:39:41,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab44bb27cb11dcdfc77643 HTTP/1.1" 200 None 2026-03-06 21:39:41,608 - lava_callback - DEBUG - Processing node 69ab44bb27cb11dcdfc77643: baseline-arm64-clabbe 2026-03-06 21:39:42,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:39:42,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:39:42,358 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab44bb27cb11dcdfc77643/log.txt.gz 2026-03-06 21:39:42,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:39:43,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:39:43,032 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab44bb27cb11dcdfc77643/lava-logs.yaml 2026-03-06 21:39:43,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:39:43,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:39:43,217 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab44bb27cb11dcdfc77643/lava_callback.json.gz DEBUG: Setup failed for 69ab44bb27cb11dcdfc77643. Transitting job node result: incomplete -> fail 2026-03-06 21:39:43,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:39:43,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab44bb27cb11dcdfc77643 HTTP/1.1" 200 None 2026-03-06 21:39:43,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:39:43,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 21:39:43,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:39:43,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab44bb27cb11dcdfc77643 HTTP/1.1" 200 None 2026-03-06 21:39:43,460 - lava_callback - INFO - Completed processing callback for node 69ab44bb27cb11dcdfc77643 INFO: 172.21.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:39:59,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:39:59,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47404 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58266 - "GET /.well-known/security.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51118 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:53:24,582 - lava_callback - INFO - Received callback for node 69a8a9c6440c1da21c239777 INFO: 172.21.0.1:39170 - "POST /node/69a8a9c6440c1da21c239777 HTTP/1.0" 202 Accepted 2026-03-06 21:53:24,587 - lava_callback - INFO - Starting async job submit for node 69a8a9c6440c1da21c239777 2026-03-06 21:53:24,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:53:24,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8a9c6440c1da21c239777 HTTP/1.1" 200 None 2026-03-06 21:53:24,606 - lava_callback - DEBUG - Processing node 69a8a9c6440c1da21c239777: baseline-arm64-baylibre 2026-03-06 21:53:24,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8a9c6440c1da21c239777 2026-03-06 21:53:24,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:53:24,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8a9c6440c1da21c239777 HTTP/1.1" 200 None 2026-03-06 21:53:24,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:53:24,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-06 21:53:24,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:53:24,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8a9c6440c1da21c239777 HTTP/1.1" 200 None 2026-03-06 21:53:24,662 - lava_callback - ERROR - Error processing callback for node 69a8a9c6440c1da21c239777: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49562 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:54:56,803 - lava_callback - INFO - Received callback for node 69ab446227cb11dcdfc77618 INFO: 172.21.0.1:49574 - "POST /node/69ab446227cb11dcdfc77618 HTTP/1.0" 202 Accepted 2026-03-06 21:54:56,811 - lava_callback - INFO - Starting async job submit for node 69ab446227cb11dcdfc77618 2026-03-06 21:54:56,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:54:56,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab446227cb11dcdfc77618 HTTP/1.1" 200 None 2026-03-06 21:54:56,872 - lava_callback - DEBUG - Processing node 69ab446227cb11dcdfc77618: baseline-nfs-arm64 2026-03-06 21:54:57,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:54:58,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:54:58,186 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab446227cb11dcdfc77618/log.txt.gz 2026-03-06 21:54:58,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:54:59,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:54:59,097 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab446227cb11dcdfc77618/lava-logs.yaml 2026-03-06 21:54:59,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 21:54:59,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 21:54:59,310 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab446227cb11dcdfc77618/lava_callback.json.gz DEBUG: Setup failed for 69ab446227cb11dcdfc77618. Transitting job node result: incomplete -> fail 2026-03-06 21:54:59,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:54:59,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab446227cb11dcdfc77618 HTTP/1.1" 200 None 2026-03-06 21:54:59,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:54:59,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 21:54:59,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:54:59,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab446227cb11dcdfc77618 HTTP/1.1" 200 None 2026-03-06 21:54:59,568 - lava_callback - INFO - Completed processing callback for node 69ab446227cb11dcdfc77618 INFO: 172.21.0.1:43666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39898 - "GET / HTTP/1.0" 200 OK 2026-03-06 21:55:29,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 21:55:29,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34460 - "GET / HTTP/1.0" 200 OK 2026-03-06 22:00:57,823 - lava_callback - INFO - Received callback for node 69ab49b527cb11dcdfc777b4 INFO: 172.21.0.1:34470 - "POST /node/69ab49b527cb11dcdfc777b4 HTTP/1.0" 202 Accepted 2026-03-06 22:00:57,830 - lava_callback - INFO - Starting async job submit for node 69ab49b527cb11dcdfc777b4 2026-03-06 22:00:57,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:00:57,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab49b527cb11dcdfc777b4 HTTP/1.1" 200 None 2026-03-06 22:00:57,888 - lava_callback - DEBUG - Processing node 69ab49b527cb11dcdfc777b4: baseline-arm64-clabbe 2026-03-06 22:00:58,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 22:00:58,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 22:00:58,606 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab49b527cb11dcdfc777b4/log.txt.gz 2026-03-06 22:00:58,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 22:00:59,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 22:00:59,229 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab49b527cb11dcdfc777b4/lava-logs.yaml 2026-03-06 22:00:59,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 22:00:59,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 22:00:59,416 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab49b527cb11dcdfc777b4/lava_callback.json.gz DEBUG: Setup failed for 69ab49b527cb11dcdfc777b4. Transitting job node result: incomplete -> fail 2026-03-06 22:00:59,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:00:59,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab49b527cb11dcdfc777b4 HTTP/1.1" 200 None 2026-03-06 22:00:59,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:00:59,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 22:00:59,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:00:59,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab49b527cb11dcdfc777b4 HTTP/1.1" 200 None 2026-03-06 22:00:59,682 - lava_callback - INFO - Completed processing callback for node 69ab49b527cb11dcdfc777b4 INFO: 172.21.0.1:41580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET / HTTP/1.0" 200 OK 2026-03-06 22:01:29,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:01:29,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49100 - "GET / HTTP/1.0" 200 OK 2026-03-06 22:14:57,589 - lava_callback - INFO - Received callback for node 69ab4d3d27cb11dcdfc7787d INFO: 172.21.0.1:49114 - "POST /node/69ab4d3d27cb11dcdfc7787d HTTP/1.0" 202 Accepted 2026-03-06 22:14:57,598 - lava_callback - INFO - Starting async job submit for node 69ab4d3d27cb11dcdfc7787d 2026-03-06 22:14:57,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:14:57,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab4d3d27cb11dcdfc7787d HTTP/1.1" 200 None 2026-03-06 22:14:57,658 - lava_callback - DEBUG - Processing node 69ab4d3d27cb11dcdfc7787d: baseline-nfs-arm64 2026-03-06 22:14:58,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 22:14:58,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 22:14:58,956 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab4d3d27cb11dcdfc7787d/log.txt.gz 2026-03-06 22:14:59,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 22:14:59,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 22:14:59,896 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab4d3d27cb11dcdfc7787d/lava-logs.yaml 2026-03-06 22:14:59,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 22:15:00,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 22:15:00,146 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab4d3d27cb11dcdfc7787d/lava_callback.json.gz DEBUG: Setup failed for 69ab4d3d27cb11dcdfc7787d. Transitting job node result: incomplete -> fail 2026-03-06 22:15:00,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:15:00,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab4d3d27cb11dcdfc7787d HTTP/1.1" 200 None 2026-03-06 22:15:00,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:15:00,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 22:15:00,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:15:00,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab4d3d27cb11dcdfc7787d HTTP/1.1" 200 None 2026-03-06 22:15:00,391 - lava_callback - INFO - Completed processing callback for node 69ab4d3d27cb11dcdfc7787d INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK 2026-03-06 22:15:29,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:15:29,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43432 - "GET / HTTP/1.0" 200 OK 2026-03-06 22:21:53,956 - lava_callback - INFO - Received callback for node 69ab4eb227cb11dcdfc778d8 INFO: 172.21.0.1:42352 - "POST /node/69ab4eb227cb11dcdfc778d8 HTTP/1.0" 202 Accepted 2026-03-06 22:21:53,963 - lava_callback - INFO - Starting async job submit for node 69ab4eb227cb11dcdfc778d8 2026-03-06 22:21:54,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:21:54,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab4eb227cb11dcdfc778d8 HTTP/1.1" 200 None 2026-03-06 22:21:54,024 - lava_callback - DEBUG - Processing node 69ab4eb227cb11dcdfc778d8: baseline-arm64-clabbe 2026-03-06 22:21:54,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 22:21:54,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 22:21:54,752 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab4eb227cb11dcdfc778d8/log.txt.gz 2026-03-06 22:21:55,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 22:21:55,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 22:21:55,355 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab4eb227cb11dcdfc778d8/lava-logs.yaml 2026-03-06 22:21:55,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 22:21:55,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 22:21:55,544 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab4eb227cb11dcdfc778d8/lava_callback.json.gz DEBUG: Setup failed for 69ab4eb227cb11dcdfc778d8. Transitting job node result: incomplete -> fail 2026-03-06 22:21:55,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:21:55,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab4eb227cb11dcdfc778d8 HTTP/1.1" 200 None 2026-03-06 22:21:55,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:21:55,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 22:21:55,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:21:55,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab4eb227cb11dcdfc778d8 HTTP/1.1" 200 None 2026-03-06 22:21:55,786 - lava_callback - INFO - Completed processing callback for node 69ab4eb227cb11dcdfc778d8 INFO: 172.21.0.1:42366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42368 - "GET / HTTP/1.0" 200 OK 2026-03-06 22:21:59,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:21:59,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52534 - "GET / HTTP/1.0" 200 OK 2026-03-06 22:34:58,020 - lava_callback - INFO - Received callback for node 69ab51ed27cb11dcdfc7798a INFO: 172.21.0.1:52548 - "POST /node/69ab51ed27cb11dcdfc7798a HTTP/1.0" 202 Accepted 2026-03-06 22:34:58,033 - lava_callback - INFO - Starting async job submit for node 69ab51ed27cb11dcdfc7798a 2026-03-06 22:34:58,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:34:58,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab51ed27cb11dcdfc7798a HTTP/1.1" 200 None 2026-03-06 22:34:58,099 - lava_callback - DEBUG - Processing node 69ab51ed27cb11dcdfc7798a: baseline-nfs-arm64 2026-03-06 22:34:59,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 22:34:59,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 22:34:59,525 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab51ed27cb11dcdfc7798a/log.txt.gz 2026-03-06 22:35:00,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 22:35:00,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 22:35:00,518 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab51ed27cb11dcdfc7798a/lava-logs.yaml 2026-03-06 22:35:00,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 22:35:00,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 22:35:00,726 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab51ed27cb11dcdfc7798a/lava_callback.json.gz DEBUG: Setup failed for 69ab51ed27cb11dcdfc7798a. Transitting job node result: incomplete -> fail 2026-03-06 22:35:00,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:35:00,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab51ed27cb11dcdfc7798a HTTP/1.1" 200 None 2026-03-06 22:35:00,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:35:00,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 22:35:00,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:35:00,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab51ed27cb11dcdfc7798a HTTP/1.1" 200 None 2026-03-06 22:35:01,016 - lava_callback - INFO - Completed processing callback for node 69ab51ed27cb11dcdfc7798a INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53714 - "GET / HTTP/1.0" 200 OK 2026-03-06 22:35:29,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:35:29,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK 2026-03-06 22:48:47,584 - lava_callback - INFO - Received callback for node 69a8b6c6440c1da21c239b04 INFO: 172.21.0.1:59350 - "POST /node/69a8b6c6440c1da21c239b04 HTTP/1.0" 202 Accepted 2026-03-06 22:48:47,589 - lava_callback - INFO - Starting async job submit for node 69a8b6c6440c1da21c239b04 2026-03-06 22:48:47,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:48:47,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8b6c6440c1da21c239b04 HTTP/1.1" 200 None 2026-03-06 22:48:47,630 - lava_callback - DEBUG - Processing node 69a8b6c6440c1da21c239b04: baseline-arm-baylibre 2026-03-06 22:48:47,630 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8b6c6440c1da21c239b04 2026-03-06 22:48:47,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:48:47,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8b6c6440c1da21c239b04 HTTP/1.1" 200 None 2026-03-06 22:48:47,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:48:47,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-06 22:48:47,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:48:47,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8b6c6440c1da21c239b04 HTTP/1.1" 200 None 2026-03-06 22:48:47,699 - lava_callback - ERROR - Error processing callback for node 69a8b6c6440c1da21c239b04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET / HTTP/1.0" 200 OK 2026-03-06 22:49:47,460 - lava_callback - INFO - Received callback for node 69a8b6f7440c1da21c239b20 INFO: 172.21.0.1:59880 - "POST /node/69a8b6f7440c1da21c239b20 HTTP/1.0" 202 Accepted 2026-03-06 22:49:47,465 - lava_callback - INFO - Starting async job submit for node 69a8b6f7440c1da21c239b20 2026-03-06 22:49:47,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:49:47,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8b6f7440c1da21c239b20 HTTP/1.1" 200 None 2026-03-06 22:49:47,482 - lava_callback - DEBUG - Processing node 69a8b6f7440c1da21c239b20: baseline-arm-baylibre 2026-03-06 22:49:47,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8b6f7440c1da21c239b20 2026-03-06 22:49:47,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:49:47,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8b6f7440c1da21c239b20 HTTP/1.1" 200 None 2026-03-06 22:49:47,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:49:47,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-06 22:49:47,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:49:47,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8b6f7440c1da21c239b20 HTTP/1.1" 200 None 2026-03-06 22:49:47,582 - lava_callback - ERROR - Error processing callback for node 69a8b6f7440c1da21c239b20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40484 - "GET / HTTP/1.0" 200 OK 2026-03-06 22:50:27,562 - lava_callback - INFO - Received callback for node 69a8b727440c1da21c239b41 INFO: 172.21.0.1:40488 - "POST /node/69a8b727440c1da21c239b41 HTTP/1.0" 202 Accepted 2026-03-06 22:50:27,568 - lava_callback - INFO - Starting async job submit for node 69a8b727440c1da21c239b41 2026-03-06 22:50:27,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:50:27,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8b727440c1da21c239b41 HTTP/1.1" 200 None 2026-03-06 22:50:27,584 - lava_callback - DEBUG - Processing node 69a8b727440c1da21c239b41: baseline-arm-baylibre 2026-03-06 22:50:27,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8b727440c1da21c239b41 2026-03-06 22:50:27,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:50:27,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8b727440c1da21c239b41 HTTP/1.1" 200 None 2026-03-06 22:50:27,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:50:27,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-06 22:50:27,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:50:27,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8b727440c1da21c239b41 HTTP/1.1" 200 None 2026-03-06 22:50:27,655 - lava_callback - ERROR - Error processing callback for node 69a8b727440c1da21c239b41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK 2026-03-06 22:51:07,549 - lava_callback - INFO - Received callback for node 69a8b758440c1da21c239b63 INFO: 172.21.0.1:55754 - "POST /node/69a8b758440c1da21c239b63 HTTP/1.0" 202 Accepted 2026-03-06 22:51:07,555 - lava_callback - INFO - Starting async job submit for node 69a8b758440c1da21c239b63 2026-03-06 22:51:07,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:51:07,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8b758440c1da21c239b63 HTTP/1.1" 200 None 2026-03-06 22:51:07,570 - lava_callback - DEBUG - Processing node 69a8b758440c1da21c239b63: baseline-arm-baylibre 2026-03-06 22:51:07,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8b758440c1da21c239b63 2026-03-06 22:51:07,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:51:07,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8b758440c1da21c239b63 HTTP/1.1" 200 None 2026-03-06 22:51:07,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:51:07,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-06 22:51:07,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:51:07,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8b758440c1da21c239b63 HTTP/1.1" 200 None 2026-03-06 22:51:07,633 - lava_callback - ERROR - Error processing callback for node 69a8b758440c1da21c239b63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK 2026-03-06 22:52:07,627 - lava_callback - INFO - Received callback for node 69a8b78a440c1da21c239b7d INFO: 172.21.0.1:55990 - "POST /node/69a8b78a440c1da21c239b7d HTTP/1.0" 202 Accepted 2026-03-06 22:52:07,632 - lava_callback - INFO - Starting async job submit for node 69a8b78a440c1da21c239b7d 2026-03-06 22:52:07,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:52:07,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8b78a440c1da21c239b7d HTTP/1.1" 200 None 2026-03-06 22:52:07,649 - lava_callback - DEBUG - Processing node 69a8b78a440c1da21c239b7d: baseline-arm-baylibre 2026-03-06 22:52:07,649 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8b78a440c1da21c239b7d 2026-03-06 22:52:07,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:52:07,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8b78a440c1da21c239b7d HTTP/1.1" 200 None 2026-03-06 22:52:07,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:52:07,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-06 22:52:07,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:52:07,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8b78a440c1da21c239b7d HTTP/1.1" 200 None 2026-03-06 22:52:07,713 - lava_callback - ERROR - Error processing callback for node 69a8b78a440c1da21c239b7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54952 - "GET / HTTP/1.0" 200 OK 2026-03-06 22:52:47,642 - lava_callback - INFO - Received callback for node 69a8b7bb440c1da21c239ba1 INFO: 172.21.0.1:54962 - "POST /node/69a8b7bb440c1da21c239ba1 HTTP/1.0" 202 Accepted 2026-03-06 22:52:47,648 - lava_callback - INFO - Starting async job submit for node 69a8b7bb440c1da21c239ba1 2026-03-06 22:52:47,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:52:47,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8b7bb440c1da21c239ba1 HTTP/1.1" 200 None 2026-03-06 22:52:47,674 - lava_callback - DEBUG - Processing node 69a8b7bb440c1da21c239ba1: baseline-arm-baylibre 2026-03-06 22:52:47,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8b7bb440c1da21c239ba1 2026-03-06 22:52:47,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:52:47,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8b7bb440c1da21c239ba1 HTTP/1.1" 200 None 2026-03-06 22:52:47,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:52:47,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-06 22:52:47,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 22:52:47,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8b7bb440c1da21c239ba1 HTTP/1.1" 200 None 2026-03-06 22:52:47,726 - lava_callback - ERROR - Error processing callback for node 69a8b7bb440c1da21c239ba1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49312 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:03:08,243 - lava_callback - INFO - Received callback for node 69a8ba1e440c1da21c239cb0 INFO: 172.21.0.1:49322 - "POST /node/69a8ba1e440c1da21c239cb0 HTTP/1.0" 202 Accepted 2026-03-06 23:03:08,249 - lava_callback - INFO - Starting async job submit for node 69a8ba1e440c1da21c239cb0 2026-03-06 23:03:08,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:03:08,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ba1e440c1da21c239cb0 HTTP/1.1" 200 None 2026-03-06 23:03:08,271 - lava_callback - DEBUG - Processing node 69a8ba1e440c1da21c239cb0: baseline-arm64-baylibre 2026-03-06 23:03:08,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8ba1e440c1da21c239cb0 2026-03-06 23:03:08,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:03:08,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ba1e440c1da21c239cb0 HTTP/1.1" 200 None 2026-03-06 23:03:08,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:03:08,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85aff440c1da21c2371fe HTTP/1.1" 200 None 2026-03-06 23:03:08,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:03:08,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8ba1e440c1da21c239cb0 HTTP/1.1" 200 None 2026-03-06 23:03:08,322 - lava_callback - ERROR - Error processing callback for node 69a8ba1e440c1da21c239cb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49772 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:18:09,214 - lava_callback - INFO - Received callback for node 69a8bdac440c1da21c239e4a INFO: 172.21.0.1:49776 - "POST /node/69a8bdac440c1da21c239e4a HTTP/1.0" 202 Accepted 2026-03-06 23:18:09,220 - lava_callback - INFO - Starting async job submit for node 69a8bdac440c1da21c239e4a 2026-03-06 23:18:09,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:18:09,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8bdac440c1da21c239e4a HTTP/1.1" 200 None 2026-03-06 23:18:09,247 - lava_callback - DEBUG - Processing node 69a8bdac440c1da21c239e4a: baseline-arm64-baylibre 2026-03-06 23:18:09,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8bdac440c1da21c239e4a 2026-03-06 23:18:09,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:18:09,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8bdac440c1da21c239e4a HTTP/1.1" 200 None 2026-03-06 23:18:09,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:18:09,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 23:18:09,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:18:09,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8bdac440c1da21c239e4a HTTP/1.1" 200 None 2026-03-06 23:18:09,375 - lava_callback - ERROR - Error processing callback for node 69a8bdac440c1da21c239e4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41078 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:19:49,203 - lava_callback - INFO - Received callback for node 69a8be04440c1da21c239e74 INFO: 172.21.0.1:41094 - "POST /node/69a8be04440c1da21c239e74 HTTP/1.0" 202 Accepted 2026-03-06 23:19:49,209 - lava_callback - INFO - Starting async job submit for node 69a8be04440c1da21c239e74 2026-03-06 23:19:49,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:19:49,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8be04440c1da21c239e74 HTTP/1.1" 200 None 2026-03-06 23:19:49,224 - lava_callback - DEBUG - Processing node 69a8be04440c1da21c239e74: baseline-arm64-baylibre 2026-03-06 23:19:49,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8be04440c1da21c239e74 2026-03-06 23:19:49,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:19:49,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8be04440c1da21c239e74 HTTP/1.1" 200 None 2026-03-06 23:19:49,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:19:49,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 23:19:49,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:19:49,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8be04440c1da21c239e74 HTTP/1.1" 200 None 2026-03-06 23:19:49,280 - lava_callback - ERROR - Error processing callback for node 69a8be04440c1da21c239e74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:21:09,271 - lava_callback - INFO - Received callback for node 69a8be5d440c1da21c239e98 INFO: 172.21.0.1:59546 - "POST /node/69a8be5d440c1da21c239e98 HTTP/1.0" 202 Accepted 2026-03-06 23:21:09,277 - lava_callback - INFO - Starting async job submit for node 69a8be5d440c1da21c239e98 2026-03-06 23:21:09,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:21:09,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8be5d440c1da21c239e98 HTTP/1.1" 200 None 2026-03-06 23:21:09,292 - lava_callback - DEBUG - Processing node 69a8be5d440c1da21c239e98: baseline-arm64-baylibre 2026-03-06 23:21:09,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8be5d440c1da21c239e98 2026-03-06 23:21:09,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:21:09,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8be5d440c1da21c239e98 HTTP/1.1" 200 None 2026-03-06 23:21:09,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:21:09,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 23:21:09,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:21:09,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8be5d440c1da21c239e98 HTTP/1.1" 200 None 2026-03-06 23:21:09,381 - lava_callback - ERROR - Error processing callback for node 69a8be5d440c1da21c239e98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59640 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:22:35,333 - lava_callback - INFO - Received callback for node 69ab3d5727cb11dcdfc771a4 INFO: 172.21.0.1:59808 - "POST /node/69ab3d5727cb11dcdfc771a4 HTTP/1.0" 202 Accepted 2026-03-06 23:22:35,339 - lava_callback - INFO - Starting async job submit for node 69ab3d5727cb11dcdfc771a4 2026-03-06 23:22:35,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:22:35,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d5727cb11dcdfc771a4 HTTP/1.1" 200 None 2026-03-06 23:22:35,373 - lava_callback - DEBUG - Processing node 69ab3d5727cb11dcdfc771a4: baseline-arm64-broonie 2026-03-06 23:22:35,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:22:35,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:22:35,602 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5727cb11dcdfc771a4/log.txt.gz 2026-03-06 23:22:35,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:22:35,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:22:35,804 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5727cb11dcdfc771a4/lava-logs.yaml 2026-03-06 23:22:35,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:22:35,990 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:22:35,992 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab3d5727cb11dcdfc771a4/lava_callback.json.gz 2026-03-06 23:22:36,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:22:36,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab3d5727cb11dcdfc771a4 HTTP/1.1" 200 None 2026-03-06 23:22:36,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:22:36,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 23:22:36,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:22:36,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab3d5727cb11dcdfc771a4 HTTP/1.1" 200 None 2026-03-06 23:22:36,243 - lava_callback - INFO - Completed processing callback for node 69ab3d5727cb11dcdfc771a4 INFO: 172.21.0.1:59810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39354 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:22:59,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:22:59,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44966 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:23:09,374 - lava_callback - INFO - Received callback for node 69a8bedb440c1da21c239ed0 INFO: 172.21.0.1:44970 - "POST /node/69a8bedb440c1da21c239ed0 HTTP/1.0" 202 Accepted 2026-03-06 23:23:09,383 - lava_callback - INFO - Starting async job submit for node 69a8bedb440c1da21c239ed0 2026-03-06 23:23:09,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:23:09,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8bedb440c1da21c239ed0 HTTP/1.1" 200 None 2026-03-06 23:23:09,412 - lava_callback - DEBUG - Processing node 69a8bedb440c1da21c239ed0: baseline-arm64-baylibre 2026-03-06 23:23:09,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8bedb440c1da21c239ed0 2026-03-06 23:23:09,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:23:09,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8bedb440c1da21c239ed0 HTTP/1.1" 200 None 2026-03-06 23:23:09,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:23:09,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 23:23:09,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:23:09,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8bedb440c1da21c239ed0 HTTP/1.1" 200 None 2026-03-06 23:23:09,506 - lava_callback - ERROR - Error processing callback for node 69a8bedb440c1da21c239ed0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33642 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:24:49,498 - lava_callback - INFO - Received callback for node 69a8bf3c440c1da21c239ef0 INFO: 172.21.0.1:33658 - "POST /node/69a8bf3c440c1da21c239ef0 HTTP/1.0" 202 Accepted 2026-03-06 23:24:49,503 - lava_callback - INFO - Starting async job submit for node 69a8bf3c440c1da21c239ef0 2026-03-06 23:24:49,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:24:49,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8bf3c440c1da21c239ef0 HTTP/1.1" 200 None 2026-03-06 23:24:49,525 - lava_callback - DEBUG - Processing node 69a8bf3c440c1da21c239ef0: baseline-arm64-baylibre 2026-03-06 23:24:49,526 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8bf3c440c1da21c239ef0 2026-03-06 23:24:49,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:24:49,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8bf3c440c1da21c239ef0 HTTP/1.1" 200 None 2026-03-06 23:24:49,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:24:49,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 23:24:49,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:24:49,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8bf3c440c1da21c239ef0 HTTP/1.1" 200 None 2026-03-06 23:24:49,582 - lava_callback - ERROR - Error processing callback for node 69a8bf3c440c1da21c239ef0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58024 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:26:49,589 - lava_callback - INFO - Received callback for node 69a8bfa8440c1da21c239f13 INFO: 172.21.0.1:58026 - "POST /node/69a8bfa8440c1da21c239f13 HTTP/1.0" 202 Accepted 2026-03-06 23:26:49,594 - lava_callback - INFO - Starting async job submit for node 69a8bfa8440c1da21c239f13 2026-03-06 23:26:49,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:26:49,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8bfa8440c1da21c239f13 HTTP/1.1" 200 None 2026-03-06 23:26:49,617 - lava_callback - DEBUG - Processing node 69a8bfa8440c1da21c239f13: baseline-arm64-baylibre 2026-03-06 23:26:49,617 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8bfa8440c1da21c239f13 2026-03-06 23:26:49,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:26:49,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8bfa8440c1da21c239f13 HTTP/1.1" 200 None 2026-03-06 23:26:49,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:26:49,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 23:26:49,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:26:49,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8bfa8440c1da21c239f13 HTTP/1.1" 200 None 2026-03-06 23:26:49,682 - lava_callback - ERROR - Error processing callback for node 69a8bfa8440c1da21c239f13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-06 23:26:55,292 - lava_callback - INFO - Received callback for node 69a9fb989c5f93e4f05edf19 INFO: 172.21.0.1:58722 - "POST /node/69a9fb989c5f93e4f05edf19 HTTP/1.0" 202 Accepted 2026-03-06 23:26:55,298 - lava_callback - INFO - Starting async job submit for node 69a9fb989c5f93e4f05edf19 2026-03-06 23:26:55,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:26:55,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9fb989c5f93e4f05edf19 HTTP/1.1" 200 None 2026-03-06 23:26:55,362 - lava_callback - DEBUG - Processing node 69a9fb989c5f93e4f05edf19: baseline-x86 2026-03-06 23:26:55,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:26:55,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:26:55,873 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69a9fb989c5f93e4f05edf19/log.txt.gz 2026-03-06 23:26:56,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:26:56,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:26:56,288 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69a9fb989c5f93e4f05edf19/lava-logs.yaml 2026-03-06 23:26:56,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:26:56,454 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:26:56,456 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69a9fb989c5f93e4f05edf19/lava_callback.json.gz DEBUG: Setup failed for 69a9fb989c5f93e4f05edf19. Transitting job node result: incomplete -> fail INFO: 172.21.0.1:58738 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:26:56,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:26:56,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9fb989c5f93e4f05edf19 HTTP/1.1" 200 None 2026-03-06 23:26:56,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:26:56,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a697103d518458fb33ea36 HTTP/1.1" 200 None 2026-03-06 23:26:56,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:26:56,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9fb989c5f93e4f05edf19 HTTP/1.1" 200 None 2026-03-06 23:26:56,648 - lava_callback - INFO - Completed processing callback for node 69a9fb989c5f93e4f05edf19 INFO: 172.21.0.1:58748 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:26:59,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:26:59,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42502 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:28:35,406 - lava_callback - INFO - Received callback for node 69ab61ce27cb11dcdfc77dc4 INFO: 172.21.0.1:42684 - "POST /node/69ab61ce27cb11dcdfc77dc4 HTTP/1.0" 202 Accepted 2026-03-06 23:28:35,412 - lava_callback - INFO - Starting async job submit for node 69ab61ce27cb11dcdfc77dc4 2026-03-06 23:28:35,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:28:35,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab61ce27cb11dcdfc77dc4 HTTP/1.1" 200 None 2026-03-06 23:28:35,446 - lava_callback - DEBUG - Processing node 69ab61ce27cb11dcdfc77dc4: baseline-arm64-broonie 2026-03-06 23:28:35,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:28:36,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:28:36,040 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab61ce27cb11dcdfc77dc4/log.txt.gz 2026-03-06 23:28:36,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:28:36,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:28:36,518 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab61ce27cb11dcdfc77dc4/lava-logs.yaml INFO: 172.21.0.1:42686 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:28:36,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:28:36,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:28:36,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab61ce27cb11dcdfc77dc4/lava_callback.json.gz 2026-03-06 23:28:36,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:28:36,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab61ce27cb11dcdfc77dc4 HTTP/1.1" 200 None 2026-03-06 23:28:36,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:28:36,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 23:28:36,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:28:36,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab61ce27cb11dcdfc77dc4 HTTP/1.1" 200 None 2026-03-06 23:28:36,835 - lava_callback - INFO - Completed processing callback for node 69ab61ce27cb11dcdfc77dc4 INFO: 172.21.0.1:40204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50252 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:28:59,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:28:59,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36532 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:29:29,706 - lava_callback - INFO - Received callback for node 69a8c04a440c1da21c239f49 INFO: 172.21.0.1:42006 - "POST /node/69a8c04a440c1da21c239f49 HTTP/1.0" 202 Accepted 2026-03-06 23:29:29,712 - lava_callback - INFO - Starting async job submit for node 69a8c04a440c1da21c239f49 2026-03-06 23:29:29,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:29:29,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c04a440c1da21c239f49 HTTP/1.1" 200 None 2026-03-06 23:29:29,728 - lava_callback - DEBUG - Processing node 69a8c04a440c1da21c239f49: baseline-arm64-baylibre 2026-03-06 23:29:29,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8c04a440c1da21c239f49 2026-03-06 23:29:29,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:29:29,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c04a440c1da21c239f49 HTTP/1.1" 200 None 2026-03-06 23:29:29,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:29:29,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 23:29:29,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:29:29,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8c04a440c1da21c239f49 HTTP/1.1" 200 None 2026-03-06 23:29:29,781 - lava_callback - ERROR - Error processing callback for node 69a8c04a440c1da21c239f49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52726 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:32:07,377 - lava_callback - INFO - Received callback for node 69aa01069c5f93e4f05ee0a2 INFO: 172.21.0.1:52732 - "POST /node/69aa01069c5f93e4f05ee0a2 HTTP/1.0" 202 Accepted 2026-03-06 23:32:07,383 - lava_callback - INFO - Starting async job submit for node 69aa01069c5f93e4f05ee0a2 2026-03-06 23:32:07,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:32:07,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa01069c5f93e4f05ee0a2 HTTP/1.1" 200 None 2026-03-06 23:32:07,437 - lava_callback - DEBUG - Processing node 69aa01069c5f93e4f05ee0a2: baseline-x86 2026-03-06 23:32:07,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:32:07,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:32:07,851 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa01069c5f93e4f05ee0a2/log.txt.gz 2026-03-06 23:32:07,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:32:08,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:32:08,194 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa01069c5f93e4f05ee0a2/lava-logs.yaml 2026-03-06 23:32:08,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:32:08,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:32:08,363 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa01069c5f93e4f05ee0a2/lava_callback.json.gz DEBUG: Setup failed for 69aa01069c5f93e4f05ee0a2. Transitting job node result: incomplete -> fail 2026-03-06 23:32:08,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:32:08,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa01069c5f93e4f05ee0a2 HTTP/1.1" 200 None 2026-03-06 23:32:08,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:32:08,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a744aa5a0c0e10c4819cef HTTP/1.1" 200 None 2026-03-06 23:32:08,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:32:08,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa01069c5f93e4f05ee0a2 HTTP/1.1" 200 None 2026-03-06 23:32:08,576 - lava_callback - INFO - Completed processing callback for node 69aa01069c5f93e4f05ee0a2 INFO: 172.21.0.1:48816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:32:29,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:32:29,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44968 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:33:40,688 - lava_callback - INFO - Received callback for node 69aa0ab69c5f93e4f05ee446 INFO: 172.21.0.1:47936 - "POST /node/69aa0ab69c5f93e4f05ee446 HTTP/1.0" 202 Accepted 2026-03-06 23:33:40,694 - lava_callback - INFO - Starting async job submit for node 69aa0ab69c5f93e4f05ee446 2026-03-06 23:33:40,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:33:40,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa0ab69c5f93e4f05ee446 HTTP/1.1" 200 None 2026-03-06 23:33:40,750 - lava_callback - DEBUG - Processing node 69aa0ab69c5f93e4f05ee446: baseline-x86 2026-03-06 23:33:41,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:33:41,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:33:41,264 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa0ab69c5f93e4f05ee446/log.txt.gz 2026-03-06 23:33:41,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:33:41,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:33:41,672 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa0ab69c5f93e4f05ee446/lava-logs.yaml 2026-03-06 23:33:41,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:33:41,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:33:41,845 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa0ab69c5f93e4f05ee446/lava_callback.json.gz 2026-03-06 23:33:41,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:33:41,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa0ab69c5f93e4f05ee446 HTTP/1.1" 200 None 2026-03-06 23:33:41,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:33:41,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70a80e31b554803095c33 HTTP/1.1" 200 None 2026-03-06 23:33:41,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:33:41,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa0ab69c5f93e4f05ee446 HTTP/1.1" 200 None 2026-03-06 23:33:41,922 - lava_callback - INFO - Completed processing callback for node 69aa0ab69c5f93e4f05ee446 INFO: 172.21.0.1:47950 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:33:49,934 - lava_callback - INFO - Received callback for node 69a8c148440c1da21c239f94 INFO: 172.21.0.1:40132 - "POST /node/69a8c148440c1da21c239f94 HTTP/1.0" 202 Accepted 2026-03-06 23:33:49,942 - lava_callback - INFO - Starting async job submit for node 69a8c148440c1da21c239f94 2026-03-06 23:33:49,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:33:49,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c148440c1da21c239f94 HTTP/1.1" 200 None 2026-03-06 23:33:49,974 - lava_callback - DEBUG - Processing node 69a8c148440c1da21c239f94: baseline-arm64-baylibre 2026-03-06 23:33:49,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8c148440c1da21c239f94 2026-03-06 23:33:49,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:33:49,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c148440c1da21c239f94 HTTP/1.1" 200 None 2026-03-06 23:33:49,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:33:50,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 23:33:50,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:33:50,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8c148440c1da21c239f94 HTTP/1.1" 200 None 2026-03-06 23:33:50,052 - lava_callback - ERROR - Error processing callback for node 69a8c148440c1da21c239f94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40150 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:33:59,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:33:59,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42486 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:35:10,066 - lava_callback - INFO - Received callback for node 69a8c1a2440c1da21c239fb9 INFO: 172.21.0.1:59240 - "POST /node/69a8c1a2440c1da21c239fb9 HTTP/1.0" 202 Accepted 2026-03-06 23:35:10,072 - lava_callback - INFO - Starting async job submit for node 69a8c1a2440c1da21c239fb9 2026-03-06 23:35:10,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:35:10,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c1a2440c1da21c239fb9 HTTP/1.1" 200 None 2026-03-06 23:35:10,101 - lava_callback - DEBUG - Processing node 69a8c1a2440c1da21c239fb9: baseline-arm64-baylibre 2026-03-06 23:35:10,101 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8c1a2440c1da21c239fb9 2026-03-06 23:35:10,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:35:10,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c1a2440c1da21c239fb9 HTTP/1.1" 200 None 2026-03-06 23:35:10,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:35:10,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 23:35:10,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:35:10,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8c1a2440c1da21c239fb9 HTTP/1.1" 200 None 2026-03-06 23:35:10,175 - lava_callback - ERROR - Error processing callback for node 69a8c1a2440c1da21c239fb9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45612 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:36:30,091 - lava_callback - INFO - Received callback for node 69a8c1fa440c1da21c239fda INFO: 172.21.0.1:36656 - "POST /node/69a8c1fa440c1da21c239fda HTTP/1.0" 202 Accepted 2026-03-06 23:36:30,097 - lava_callback - INFO - Starting async job submit for node 69a8c1fa440c1da21c239fda 2026-03-06 23:36:30,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:36:30,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c1fa440c1da21c239fda HTTP/1.1" 200 None 2026-03-06 23:36:30,113 - lava_callback - DEBUG - Processing node 69a8c1fa440c1da21c239fda: baseline-arm64-baylibre 2026-03-06 23:36:30,114 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8c1fa440c1da21c239fda 2026-03-06 23:36:30,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:36:30,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c1fa440c1da21c239fda HTTP/1.1" 200 None 2026-03-06 23:36:30,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:36:30,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 23:36:30,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:36:30,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8c1fa440c1da21c239fda HTTP/1.1" 200 None 2026-03-06 23:36:30,177 - lava_callback - ERROR - Error processing callback for node 69a8c1fa440c1da21c239fda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:38:10,188 - lava_callback - INFO - Received callback for node 69a8c253440c1da21c23a00d INFO: 172.21.0.1:42612 - "POST /node/69a8c253440c1da21c23a00d HTTP/1.0" 202 Accepted 2026-03-06 23:38:10,193 - lava_callback - INFO - Starting async job submit for node 69a8c253440c1da21c23a00d 2026-03-06 23:38:10,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:38:10,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c253440c1da21c23a00d HTTP/1.1" 200 None 2026-03-06 23:38:10,210 - lava_callback - DEBUG - Processing node 69a8c253440c1da21c23a00d: baseline-arm64-baylibre 2026-03-06 23:38:10,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8c253440c1da21c23a00d 2026-03-06 23:38:10,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:38:10,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c253440c1da21c23a00d HTTP/1.1" 200 None 2026-03-06 23:38:10,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:38:10,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 23:38:10,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:38:10,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8c253440c1da21c23a00d HTTP/1.1" 200 None 2026-03-06 23:38:10,266 - lava_callback - ERROR - Error processing callback for node 69a8c253440c1da21c23a00d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34144 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:39:30,281 - lava_callback - INFO - Received callback for node 69a8c2ab440c1da21c23a046 INFO: 172.21.0.1:51842 - "POST /node/69a8c2ab440c1da21c23a046 HTTP/1.0" 202 Accepted 2026-03-06 23:39:30,286 - lava_callback - INFO - Starting async job submit for node 69a8c2ab440c1da21c23a046 2026-03-06 23:39:30,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:39:30,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c2ab440c1da21c23a046 HTTP/1.1" 200 None 2026-03-06 23:39:30,303 - lava_callback - DEBUG - Processing node 69a8c2ab440c1da21c23a046: baseline-arm64-baylibre 2026-03-06 23:39:30,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8c2ab440c1da21c23a046 2026-03-06 23:39:30,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:39:30,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c2ab440c1da21c23a046 HTTP/1.1" 200 None 2026-03-06 23:39:30,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:39:30,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-06 23:39:30,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:39:30,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8c2ab440c1da21c23a046 HTTP/1.1" 200 None 2026-03-06 23:39:30,357 - lava_callback - ERROR - Error processing callback for node 69a8c2ab440c1da21c23a046: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60914 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:48:56,101 - lava_callback - INFO - Received callback for node 69aa08499c5f93e4f05ee2e2 INFO: 172.21.0.1:36638 - "POST /node/69aa08499c5f93e4f05ee2e2 HTTP/1.0" 202 Accepted 2026-03-06 23:48:56,107 - lava_callback - INFO - Starting async job submit for node 69aa08499c5f93e4f05ee2e2 2026-03-06 23:48:56,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:48:56,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa08499c5f93e4f05ee2e2 HTTP/1.1" 200 None 2026-03-06 23:48:56,154 - lava_callback - DEBUG - Processing node 69aa08499c5f93e4f05ee2e2: baseline-x86 2026-03-06 23:48:56,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:36642 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:48:56,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:48:56,602 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa08499c5f93e4f05ee2e2/log.txt.gz 2026-03-06 23:48:56,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:48:56,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:48:56,958 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa08499c5f93e4f05ee2e2/lava-logs.yaml 2026-03-06 23:48:56,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:48:57,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:48:57,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa08499c5f93e4f05ee2e2/lava_callback.json.gz DEBUG: Setup failed for 69aa08499c5f93e4f05ee2e2. Transitting job node result: incomplete -> fail 2026-03-06 23:48:57,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:48:57,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa08499c5f93e4f05ee2e2 HTTP/1.1" 200 None 2026-03-06 23:48:57,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:48:57,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9ad129c5f93e4f05eb2eb HTTP/1.1" 200 None 2026-03-06 23:48:57,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:48:57,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa08499c5f93e4f05ee2e2 HTTP/1.1" 200 None 2026-03-06 23:48:57,316 - lava_callback - INFO - Completed processing callback for node 69aa08499c5f93e4f05ee2e2 INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:48:59,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:48:59,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55254 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:49:11,030 - lava_callback - INFO - Received callback for node 69a8c4f4440c1da21c23a0df INFO: 172.21.0.1:42566 - "POST /node/69a8c4f4440c1da21c23a0df HTTP/1.0" 202 Accepted 2026-03-06 23:49:11,035 - lava_callback - INFO - Starting async job submit for node 69a8c4f4440c1da21c23a0df 2026-03-06 23:49:11,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:49:11,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c4f4440c1da21c23a0df HTTP/1.1" 200 None 2026-03-06 23:49:11,051 - lava_callback - DEBUG - Processing node 69a8c4f4440c1da21c23a0df: baseline-arm64-baylibre 2026-03-06 23:49:11,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8c4f4440c1da21c23a0df 2026-03-06 23:49:11,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:49:11,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c4f4440c1da21c23a0df HTTP/1.1" 200 None 2026-03-06 23:49:11,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:49:11,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-06 23:49:11,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:49:11,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8c4f4440c1da21c23a0df HTTP/1.1" 200 None 2026-03-06 23:49:11,113 - lava_callback - ERROR - Error processing callback for node 69a8c4f4440c1da21c23a0df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36276 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:50:50,901 - lava_callback - INFO - Received callback for node 69a8c54c440c1da21c23a10a INFO: 172.21.0.1:43332 - "POST /node/69a8c54c440c1da21c23a10a HTTP/1.0" 202 Accepted 2026-03-06 23:50:50,907 - lava_callback - INFO - Starting async job submit for node 69a8c54c440c1da21c23a10a 2026-03-06 23:50:50,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:50:50,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c54c440c1da21c23a10a HTTP/1.1" 200 None 2026-03-06 23:50:50,932 - lava_callback - DEBUG - Processing node 69a8c54c440c1da21c23a10a: baseline-arm64-baylibre 2026-03-06 23:50:50,932 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8c54c440c1da21c23a10a 2026-03-06 23:50:50,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:50:50,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c54c440c1da21c23a10a HTTP/1.1" 200 None 2026-03-06 23:50:50,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:50:50,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-06 23:50:50,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:50:50,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8c54c440c1da21c23a10a HTTP/1.1" 200 None 2026-03-06 23:50:51,008 - lava_callback - ERROR - Error processing callback for node 69a8c54c440c1da21c23a10a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-06 23:51:16,473 - lava_callback - INFO - Received callback for node 69ab633627cb11dcdfc77e37 INFO: 172.21.0.1:46224 - "POST /node/69ab633627cb11dcdfc77e37 HTTP/1.0" 202 Accepted 2026-03-06 23:51:16,479 - lava_callback - INFO - Starting async job submit for node 69ab633627cb11dcdfc77e37 2026-03-06 23:51:16,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:51:16,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab633627cb11dcdfc77e37 HTTP/1.1" 200 None 2026-03-06 23:51:16,526 - lava_callback - DEBUG - Processing node 69ab633627cb11dcdfc77e37: baseline-arm64-broonie INFO: 172.21.0.1:46238 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:51:16,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:51:17,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:51:17,011 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab633627cb11dcdfc77e37/log.txt.gz 2026-03-06 23:51:17,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:51:17,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:51:17,444 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab633627cb11dcdfc77e37/lava-logs.yaml 2026-03-06 23:51:17,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:51:17,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:51:17,607 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab633627cb11dcdfc77e37/lava_callback.json.gz 2026-03-06 23:51:17,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:51:17,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab633627cb11dcdfc77e37 HTTP/1.1" 200 None 2026-03-06 23:51:17,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:51:17,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-06 23:51:17,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:51:17,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab633627cb11dcdfc77e37 HTTP/1.1" 200 None 2026-03-06 23:51:17,699 - lava_callback - INFO - Completed processing callback for node 69ab633627cb11dcdfc77e37 INFO: 172.21.0.1:37020 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:51:29,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:51:29,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60502 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:52:51,055 - lava_callback - INFO - Received callback for node 69a8c5c3440c1da21c23a13a INFO: 172.21.0.1:60518 - "POST /node/69a8c5c3440c1da21c23a13a HTTP/1.0" 202 Accepted 2026-03-06 23:52:51,060 - lava_callback - INFO - Starting async job submit for node 69a8c5c3440c1da21c23a13a 2026-03-06 23:52:51,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:52:51,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c5c3440c1da21c23a13a HTTP/1.1" 200 None 2026-03-06 23:52:51,077 - lava_callback - DEBUG - Processing node 69a8c5c3440c1da21c23a13a: baseline-arm64-baylibre 2026-03-06 23:52:51,077 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8c5c3440c1da21c23a13a 2026-03-06 23:52:51,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:52:51,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c5c3440c1da21c23a13a HTTP/1.1" 200 None 2026-03-06 23:52:51,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:52:51,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-06 23:52:51,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:52:51,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8c5c3440c1da21c23a13a HTTP/1.1" 200 None 2026-03-06 23:52:51,156 - lava_callback - ERROR - Error processing callback for node 69a8c5c3440c1da21c23a13a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54502 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:54:00,539 - lava_callback - INFO - Received callback for node 69aa0af69c5f93e4f05ee45e INFO: 172.21.0.1:54570 - "POST /node/69aa0af69c5f93e4f05ee45e HTTP/1.0" 202 Accepted 2026-03-06 23:54:00,545 - lava_callback - INFO - Starting async job submit for node 69aa0af69c5f93e4f05ee45e 2026-03-06 23:54:00,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:54:00,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa0af69c5f93e4f05ee45e HTTP/1.1" 200 None 2026-03-06 23:54:00,602 - lava_callback - DEBUG - Processing node 69aa0af69c5f93e4f05ee45e: baseline-x86 2026-03-06 23:54:00,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:54:01,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:54:01,041 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa0af69c5f93e4f05ee45e/log.txt.gz 2026-03-06 23:54:01,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:54:01,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:54:01,504 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa0af69c5f93e4f05ee45e/lava-logs.yaml 2026-03-06 23:54:01,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-06 23:54:01,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-06 23:54:01,680 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa0af69c5f93e4f05ee45e/lava_callback.json.gz DEBUG: Setup failed for 69aa0af69c5f93e4f05ee45e. Transitting job node result: incomplete -> fail 2026-03-06 23:54:01,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:54:01,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa0af69c5f93e4f05ee45e HTTP/1.1" 200 None 2026-03-06 23:54:01,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:54:01,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a697103d518458fb33ea36 HTTP/1.1" 200 None 2026-03-06 23:54:01,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:54:01,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa0af69c5f93e4f05ee45e HTTP/1.1" 200 None 2026-03-06 23:54:01,897 - lava_callback - INFO - Completed processing callback for node 69aa0af69c5f93e4f05ee45e INFO: 172.21.0.1:54578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58640 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:54:29,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:54:29,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51564 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:54:51,186 - lava_callback - INFO - Received callback for node 69a8c636440c1da21c23a172 INFO: 172.21.0.1:46130 - "POST /node/69a8c636440c1da21c23a172 HTTP/1.0" 202 Accepted 2026-03-06 23:54:51,191 - lava_callback - INFO - Starting async job submit for node 69a8c636440c1da21c23a172 2026-03-06 23:54:51,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:54:51,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c636440c1da21c23a172 HTTP/1.1" 200 None 2026-03-06 23:54:51,250 - lava_callback - DEBUG - Processing node 69a8c636440c1da21c23a172: baseline-arm64-baylibre 2026-03-06 23:54:51,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8c636440c1da21c23a172 2026-03-06 23:54:51,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:54:51,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c636440c1da21c23a172 HTTP/1.1" 200 None 2026-03-06 23:54:51,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:54:51,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-06 23:54:51,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:54:51,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8c636440c1da21c23a172 HTTP/1.1" 200 None 2026-03-06 23:54:51,302 - lava_callback - ERROR - Error processing callback for node 69a8c636440c1da21c23a172: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60260 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:56:11,189 - lava_callback - INFO - Received callback for node 69a8c694440c1da21c23a1a0 INFO: 172.21.0.1:51644 - "POST /node/69a8c694440c1da21c23a1a0 HTTP/1.0" 202 Accepted 2026-03-06 23:56:11,194 - lava_callback - INFO - Starting async job submit for node 69a8c694440c1da21c23a1a0 2026-03-06 23:56:11,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:56:11,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c694440c1da21c23a1a0 HTTP/1.1" 200 None 2026-03-06 23:56:11,232 - lava_callback - DEBUG - Processing node 69a8c694440c1da21c23a1a0: baseline-arm64-baylibre 2026-03-06 23:56:11,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8c694440c1da21c23a1a0 2026-03-06 23:56:11,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:56:11,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c694440c1da21c23a1a0 HTTP/1.1" 200 None 2026-03-06 23:56:11,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:56:11,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-06 23:56:11,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:56:11,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8c694440c1da21c23a1a0 HTTP/1.1" 200 None 2026-03-06 23:56:11,311 - lava_callback - ERROR - Error processing callback for node 69a8c694440c1da21c23a1a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41110 - "GET / HTTP/1.0" 200 OK 2026-03-06 23:57:51,267 - lava_callback - INFO - Received callback for node 69a8c6ed440c1da21c23a1d4 INFO: 172.21.0.1:40972 - "POST /node/69a8c6ed440c1da21c23a1d4 HTTP/1.0" 202 Accepted 2026-03-06 23:57:51,272 - lava_callback - INFO - Starting async job submit for node 69a8c6ed440c1da21c23a1d4 2026-03-06 23:57:51,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:57:51,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c6ed440c1da21c23a1d4 HTTP/1.1" 200 None 2026-03-06 23:57:51,291 - lava_callback - DEBUG - Processing node 69a8c6ed440c1da21c23a1d4: baseline-arm64-baylibre 2026-03-06 23:57:51,292 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8c6ed440c1da21c23a1d4 2026-03-06 23:57:51,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:57:51,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8c6ed440c1da21c23a1d4 HTTP/1.1" 200 None 2026-03-06 23:57:51,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:57:51,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-06 23:57:51,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-06 23:57:51,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8c6ed440c1da21c23a1d4 HTTP/1.1" 200 None 2026-03-06 23:57:51,355 - lava_callback - ERROR - Error processing callback for node 69a8c6ed440c1da21c23a1d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56984 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]