INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.19.0.1:44626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32980 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:39:35,668 - lava_callback - INFO - Received callback for node 69b19ab5a26b422765ba3754 2026-03-11 16:39:35,694 - lava_callback - INFO - Starting async job submit for node 69b19ab5a26b422765ba3754 INFO: 172.19.0.1:58146 - "POST /node/69b19ab5a26b422765ba3754 HTTP/1.0" 202 Accepted 2026-03-11 16:39:35,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:39:35,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ab5a26b422765ba3754 HTTP/1.1" 200 None 2026-03-11 16:39:35,737 - lava_callback - DEBUG - Processing node 69b19ab5a26b422765ba3754: baseline-arm 2026-03-11 16:39:35,753 - lava_callback - WARNING - Failed to upload log 2026-03-11 16:39:35,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:39:36,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:39:36,366 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b19ab5a26b422765ba3754/lava-logs.yaml 2026-03-11 16:39:36,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:58148 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:39:36,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:39:36,741 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b19ab5a26b422765ba3754/lava_callback.json.gz 2026-03-11 16:39:36,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:39:36,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ab5a26b422765ba3754 HTTP/1.1" 200 None 2026-03-11 16:39:36,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:39:36,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:39:36,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:39:36,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ab5a26b422765ba3754 HTTP/1.1" 200 None 2026-03-11 16:39:36,860 - lava_callback - INFO - Completed processing callback for node 69b19ab5a26b422765ba3754 INFO: 172.19.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42210 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:40:02,215 - lava_callback - INFO - Received callback for node 69aef7d6ce46d8ec186abc04 INFO: 172.19.0.1:45314 - "POST /node/69aef7d6ce46d8ec186abc04 HTTP/1.0" 202 Accepted 2026-03-11 16:40:02,225 - lava_callback - INFO - Starting async job submit for node 69aef7d6ce46d8ec186abc04 2026-03-11 16:40:02,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:02,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef7d6ce46d8ec186abc04 HTTP/1.1" 200 None 2026-03-11 16:40:02,263 - lava_callback - DEBUG - Processing node 69aef7d6ce46d8ec186abc04: baseline-arm-baylibre 2026-03-11 16:40:02,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef7d6ce46d8ec186abc04 2026-03-11 16:40:02,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:02,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef7d6ce46d8ec186abc04 HTTP/1.1" 200 None 2026-03-11 16:40:02,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:02,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70a4fe31b554803095c08 HTTP/1.1" 200 None 2026-03-11 16:40:02,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:02,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef7d6ce46d8ec186abc04 HTTP/1.1" 200 None 2026-03-11 16:40:02,378 - lava_callback - ERROR - Error processing callback for node 69aef7d6ce46d8ec186abc04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 16:40:05,095 - lava_callback - INFO - Received callback for node 69b19abaa26b422765ba3760 INFO: 172.19.0.1:45330 - "POST /node/69b19abaa26b422765ba3760 HTTP/1.0" 202 Accepted 2026-03-11 16:40:05,142 - lava_callback - INFO - Starting async job submit for node 69b19abaa26b422765ba3760 2026-03-11 16:40:05,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:05,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19abaa26b422765ba3760 HTTP/1.1" 200 None 2026-03-11 16:40:05,193 - lava_callback - DEBUG - Processing node 69b19abaa26b422765ba3760: baseline-arm 2026-03-11 16:40:05,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:40:05,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:40:05,573 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b19abaa26b422765ba3760/log.txt.gz 2026-03-11 16:40:05,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:40:05,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:40:05,897 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b19abaa26b422765ba3760/lava-logs.yaml 2026-03-11 16:40:05,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:40:06,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:40:06,054 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b19abaa26b422765ba3760/lava_callback.json.gz 2026-03-11 16:40:06,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:06,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19abaa26b422765ba3760 HTTP/1.1" 200 None 2026-03-11 16:40:06,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:06,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:40:06,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:06,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19abaa26b422765ba3760 HTTP/1.1" 200 None 2026-03-11 16:40:06,144 - lava_callback - INFO - Completed processing callback for node 69b19abaa26b422765ba3760 INFO: 172.19.0.1:45344 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:40:06,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:06,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 16:40:08,025 - lava_callback - INFO - Received callback for node 69b19ab6a26b422765ba3757 INFO: 172.19.0.1:45358 - "POST /node/69b19ab6a26b422765ba3757 HTTP/1.0" 202 Accepted 2026-03-11 16:40:08,074 - lava_callback - INFO - Starting async job submit for node 69b19ab6a26b422765ba3757 2026-03-11 16:40:08,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:08,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ab6a26b422765ba3757 HTTP/1.1" 200 None 2026-03-11 16:40:08,110 - lava_callback - DEBUG - Processing node 69b19ab6a26b422765ba3757: baseline-arm 2026-03-11 16:40:08,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:40:08,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:40:08,396 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b19ab6a26b422765ba3757/log.txt.gz 2026-03-11 16:40:08,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:40:08,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:40:08,645 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b19ab6a26b422765ba3757/lava-logs.yaml 2026-03-11 16:40:08,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:40:08,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:40:08,780 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b19ab6a26b422765ba3757/lava_callback.json.gz 2026-03-11 16:40:08,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:08,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ab6a26b422765ba3757 HTTP/1.1" 200 None 2026-03-11 16:40:08,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:08,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:40:08,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:08,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ab6a26b422765ba3757 HTTP/1.1" 200 None 2026-03-11 16:40:08,890 - lava_callback - INFO - Completed processing callback for node 69b19ab6a26b422765ba3757 INFO: 172.19.0.1:57328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49482 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:40:36,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:36,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 16:40:38,095 - lava_callback - INFO - Received callback for node 69b19ab8a26b422765ba375d INFO: 172.19.0.1:49498 - "POST /node/69b19ab8a26b422765ba375d HTTP/1.0" 202 Accepted 2026-03-11 16:40:38,101 - lava_callback - INFO - Starting async job submit for node 69b19ab8a26b422765ba375d 2026-03-11 16:40:38,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:38,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ab8a26b422765ba375d HTTP/1.1" 200 None 2026-03-11 16:40:38,137 - lava_callback - DEBUG - Processing node 69b19ab8a26b422765ba375d: baseline-arm 2026-03-11 16:40:38,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:40:38,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:40:38,532 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b19ab8a26b422765ba375d/log.txt.gz 2026-03-11 16:40:38,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:40:38,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:40:38,922 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b19ab8a26b422765ba375d/lava-logs.yaml 2026-03-11 16:40:38,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:40:39,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:40:39,057 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b19ab8a26b422765ba375d/lava_callback.json.gz 2026-03-11 16:40:39,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:39,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ab8a26b422765ba375d HTTP/1.1" 200 None 2026-03-11 16:40:39,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:39,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:40:39,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:39,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ab8a26b422765ba375d HTTP/1.1" 200 None 2026-03-11 16:40:39,155 - lava_callback - INFO - Completed processing callback for node 69b19ab8a26b422765ba375d INFO: 172.19.0.1:49504 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:40:41,223 - lava_callback - INFO - Received callback for node 69aef7fcce46d8ec186abc19 INFO: 172.19.0.1:36400 - "POST /node/69aef7fcce46d8ec186abc19 HTTP/1.0" 202 Accepted 2026-03-11 16:40:41,229 - lava_callback - INFO - Starting async job submit for node 69aef7fcce46d8ec186abc19 2026-03-11 16:40:41,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:41,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef7fcce46d8ec186abc19 HTTP/1.1" 200 None 2026-03-11 16:40:41,249 - lava_callback - DEBUG - Processing node 69aef7fcce46d8ec186abc19: baseline-arm-baylibre 2026-03-11 16:40:41,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef7fcce46d8ec186abc19 2026-03-11 16:40:41,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:41,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef7fcce46d8ec186abc19 HTTP/1.1" 200 None 2026-03-11 16:40:41,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:41,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70a4fe31b554803095c08 HTTP/1.1" 200 None 2026-03-11 16:40:41,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:41,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef7fcce46d8ec186abc19 HTTP/1.1" 200 None 2026-03-11 16:40:41,365 - lava_callback - ERROR - Error processing callback for node 69aef7fcce46d8ec186abc19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 16:40:44,808 - lava_callback - INFO - Received callback for node 69b19ab4a26b422765ba3751 INFO: 172.19.0.1:36410 - "POST /node/69b19ab4a26b422765ba3751 HTTP/1.0" 202 Accepted 2026-03-11 16:40:44,814 - lava_callback - INFO - Starting async job submit for node 69b19ab4a26b422765ba3751 2026-03-11 16:40:44,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:44,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ab4a26b422765ba3751 HTTP/1.1" 200 None 2026-03-11 16:40:44,850 - lava_callback - DEBUG - Processing node 69b19ab4a26b422765ba3751: baseline-arm 2026-03-11 16:40:45,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:40:45,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:40:45,234 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b19ab4a26b422765ba3751/log.txt.gz 2026-03-11 16:40:45,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:40:45,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:40:45,522 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b19ab4a26b422765ba3751/lava-logs.yaml 2026-03-11 16:40:45,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:40:45,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:40:45,666 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b19ab4a26b422765ba3751/lava_callback.json.gz 2026-03-11 16:40:45,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:45,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ab4a26b422765ba3751 HTTP/1.1" 200 None 2026-03-11 16:40:45,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:45,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:40:45,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:40:45,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ab4a26b422765ba3751 HTTP/1.1" 200 None 2026-03-11 16:40:45,804 - lava_callback - INFO - Completed processing callback for node 69b19ab4a26b422765ba3751 INFO: 172.19.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48978 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:41:06,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:06,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:36848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36862 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:41:21,346 - lava_callback - INFO - Received callback for node 69aef824ce46d8ec186abc64 INFO: 172.19.0.1:40964 - "POST /node/69aef824ce46d8ec186abc64 HTTP/1.0" 202 Accepted 2026-03-11 16:41:21,352 - lava_callback - INFO - Starting async job submit for node 69aef824ce46d8ec186abc64 2026-03-11 16:41:21,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:21,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef824ce46d8ec186abc64 HTTP/1.1" 200 None 2026-03-11 16:41:21,375 - lava_callback - DEBUG - Processing node 69aef824ce46d8ec186abc64: baseline-arm-baylibre 2026-03-11 16:41:21,375 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef824ce46d8ec186abc64 2026-03-11 16:41:21,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:21,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef824ce46d8ec186abc64 HTTP/1.1" 200 None 2026-03-11 16:41:21,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:21,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70a4fe31b554803095c08 HTTP/1.1" 200 None 2026-03-11 16:41:21,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:21,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef824ce46d8ec186abc64 HTTP/1.1" 200 None 2026-03-11 16:41:21,431 - lava_callback - ERROR - Error processing callback for node 69aef824ce46d8ec186abc64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 16:41:22,005 - lava_callback - INFO - Received callback for node 69b19ad4a26b422765ba37b1 INFO: 172.19.0.1:40970 - "POST /node/69b19ad4a26b422765ba37b1 HTTP/1.0" 202 Accepted 2026-03-11 16:41:22,010 - lava_callback - INFO - Starting async job submit for node 69b19ad4a26b422765ba37b1 2026-03-11 16:41:22,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:22,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ad4a26b422765ba37b1 HTTP/1.1" 200 None 2026-03-11 16:41:22,048 - lava_callback - DEBUG - Processing node 69b19ad4a26b422765ba37b1: baseline-arm-clabbe 2026-03-11 16:41:22,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:41:22,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:41:22,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b19ad4a26b422765ba37b1/log.txt.gz 2026-03-11 16:41:22,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:41:22,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:41:22,708 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b19ad4a26b422765ba37b1/lava-logs.yaml 2026-03-11 16:41:22,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:41:22,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:41:22,871 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b19ad4a26b422765ba37b1/lava_callback.json.gz 2026-03-11 16:41:22,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:22,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ad4a26b422765ba37b1 HTTP/1.1" 200 None 2026-03-11 16:41:22,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:22,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:41:22,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:22,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ad4a26b422765ba37b1 HTTP/1.1" 200 None 2026-03-11 16:41:22,960 - lava_callback - INFO - Completed processing callback for node 69b19ad4a26b422765ba37b1 INFO: 172.19.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40476 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:41:36,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:36,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 16:41:38,355 - lava_callback - INFO - Received callback for node 69b19ae4a26b422765ba37dc INFO: 172.19.0.1:40492 - "POST /node/69b19ae4a26b422765ba37dc HTTP/1.0" 202 Accepted 2026-03-11 16:41:38,401 - lava_callback - INFO - Starting async job submit for node 69b19ae4a26b422765ba37dc 2026-03-11 16:41:38,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:38,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ae4a26b422765ba37dc HTTP/1.1" 200 None 2026-03-11 16:41:38,439 - lava_callback - DEBUG - Processing node 69b19ae4a26b422765ba37dc: baseline-arm-pengutronix 2026-03-11 16:41:38,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:41:38,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:41:38,683 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b19ae4a26b422765ba37dc/log.txt.gz 2026-03-11 16:41:38,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:41:38,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:41:38,921 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b19ae4a26b422765ba37dc/lava-logs.yaml 2026-03-11 16:41:38,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:41:39,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:41:39,046 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b19ae4a26b422765ba37dc/lava_callback.json.gz 2026-03-11 16:41:39,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:39,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ae4a26b422765ba37dc HTTP/1.1" 200 None 2026-03-11 16:41:39,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:39,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:41:39,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:39,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ae4a26b422765ba37dc HTTP/1.1" 200 None 2026-03-11 16:41:39,132 - lava_callback - INFO - Completed processing callback for node 69b19ae4a26b422765ba37dc INFO: 172.19.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46396 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:41:51,429 - lava_callback - INFO - Received callback for node 69b19acba26b422765ba379c INFO: 172.19.0.1:49934 - "POST /node/69b19acba26b422765ba379c HTTP/1.0" 202 Accepted 2026-03-11 16:41:51,435 - lava_callback - INFO - Starting async job submit for node 69b19acba26b422765ba379c 2026-03-11 16:41:51,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:51,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19acba26b422765ba379c HTTP/1.1" 200 None 2026-03-11 16:41:51,488 - lava_callback - DEBUG - Processing node 69b19acba26b422765ba379c: baseline-arm-broonie 2026-03-11 16:41:51,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:41:51,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:41:51,840 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b19acba26b422765ba379c/log.txt.gz 2026-03-11 16:41:51,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:41:52,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:41:52,182 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b19acba26b422765ba379c/lava-logs.yaml 2026-03-11 16:41:52,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:41:52,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:41:52,356 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b19acba26b422765ba379c/lava_callback.json.gz 2026-03-11 16:41:52,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:52,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19acba26b422765ba379c HTTP/1.1" 200 None 2026-03-11 16:41:52,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:52,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:41:52,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:52,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19acba26b422765ba379c HTTP/1.1" 200 None 2026-03-11 16:41:52,462 - lava_callback - INFO - Completed processing callback for node 69b19acba26b422765ba379c 2026-03-11 16:41:53,036 - lava_callback - INFO - Received callback for node 69b19acda26b422765ba379f INFO: 172.19.0.1:49946 - "POST /node/69b19acda26b422765ba379f HTTP/1.0" 202 Accepted 2026-03-11 16:41:53,042 - lava_callback - INFO - Starting async job submit for node 69b19acda26b422765ba379f 2026-03-11 16:41:53,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:53,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19acda26b422765ba379f HTTP/1.1" 200 None 2026-03-11 16:41:53,083 - lava_callback - DEBUG - Processing node 69b19acda26b422765ba379f: baseline-arm-broonie 2026-03-11 16:41:53,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:41:53,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:41:53,443 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b19acda26b422765ba379f/log.txt.gz 2026-03-11 16:41:53,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:41:53,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:41:53,751 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b19acda26b422765ba379f/lava-logs.yaml 2026-03-11 16:41:53,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:41:53,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:41:53,911 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b19acda26b422765ba379f/lava_callback.json.gz 2026-03-11 16:41:53,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:53,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19acda26b422765ba379f HTTP/1.1" 200 None 2026-03-11 16:41:53,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:53,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:41:53,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:41:53,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19acda26b422765ba379f HTTP/1.1" 200 None 2026-03-11 16:41:53,999 - lava_callback - INFO - Completed processing callback for node 69b19acda26b422765ba379f INFO: 172.19.0.1:49960 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:42:00,543 - lava_callback - INFO - Received callback for node 69b19b3aa26b422765ba3883 INFO: 172.19.0.1:56570 - "POST /node/69b19b3aa26b422765ba3883 HTTP/1.0" 202 Accepted 2026-03-11 16:42:00,548 - lava_callback - INFO - Starting async job submit for node 69b19b3aa26b422765ba3883 2026-03-11 16:42:00,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:00,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b3aa26b422765ba3883 HTTP/1.1" 200 None 2026-03-11 16:42:00,567 - lava_callback - DEBUG - Processing node 69b19b3aa26b422765ba3883: baseline-arm 2026-03-11 16:42:00,572 - lava_callback - WARNING - Failed to upload log 2026-03-11 16:42:00,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:42:00,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:42:00,705 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b19b3aa26b422765ba3883/lava-logs.yaml 2026-03-11 16:42:00,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:42:00,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:42:00,826 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b19b3aa26b422765ba3883/lava_callback.json.gz 2026-03-11 16:42:00,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:00,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b3aa26b422765ba3883 HTTP/1.1" 200 None 2026-03-11 16:42:00,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:00,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:42:00,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:00,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19b3aa26b422765ba3883 HTTP/1.1" 200 None 2026-03-11 16:42:00,896 - lava_callback - INFO - Completed processing callback for node 69b19b3aa26b422765ba3883 2026-03-11 16:42:01,298 - lava_callback - INFO - Received callback for node 69aef84dce46d8ec186abc80 INFO: 172.19.0.1:56582 - "POST /node/69aef84dce46d8ec186abc80 HTTP/1.0" 202 Accepted 2026-03-11 16:42:01,304 - lava_callback - INFO - Starting async job submit for node 69aef84dce46d8ec186abc80 2026-03-11 16:42:01,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:01,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef84dce46d8ec186abc80 HTTP/1.1" 200 None 2026-03-11 16:42:01,319 - lava_callback - DEBUG - Processing node 69aef84dce46d8ec186abc80: baseline-arm-baylibre 2026-03-11 16:42:01,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef84dce46d8ec186abc80 2026-03-11 16:42:01,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:01,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef84dce46d8ec186abc80 HTTP/1.1" 200 None 2026-03-11 16:42:01,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:01,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 16:42:01,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:01,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef84dce46d8ec186abc80 HTTP/1.1" 200 None 2026-03-11 16:42:01,375 - lava_callback - ERROR - Error processing callback for node 69aef84dce46d8ec186abc80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56588 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:42:06,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:06,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.19.0.1:38962 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 16:42:16,442 - lava_callback - INFO - Received callback for node 69b19afea26b422765ba381e INFO: 172.19.0.1:38972 - "POST /node/69b19afea26b422765ba381e HTTP/1.0" 202 Accepted 2026-03-11 16:42:16,448 - lava_callback - INFO - Starting async job submit for node 69b19afea26b422765ba381e 2026-03-11 16:42:16,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:16,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19afea26b422765ba381e HTTP/1.1" 200 None 2026-03-11 16:42:16,487 - lava_callback - DEBUG - Processing node 69b19afea26b422765ba381e: ltp-dio INFO: 172.19.0.1:38974 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:42:16,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:42:16,927 - lava_callback - INFO - Received callback for node 69b19acea26b422765ba37a2 2026-03-11 16:42:16,933 - lava_callback - INFO - Starting async job submit for node 69b19acea26b422765ba37a2 INFO: 172.19.0.1:38986 - "POST /node/69b19acea26b422765ba37a2 HTTP/1.0" 202 Accepted 2026-03-11 16:42:16,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:16,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19acea26b422765ba37a2 HTTP/1.1" 200 None 2026-03-11 16:42:16,985 - lava_callback - DEBUG - Processing node 69b19acea26b422765ba37a2: baseline-arm-broonie 2026-03-11 16:42:17,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:42:17,067 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69b19afea26b422765ba381e/log.txt.gz 2026-03-11 16:42:17,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:42:17,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:42:17,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:42:17,707 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b19acea26b422765ba37a2/log.txt.gz 2026-03-11 16:42:17,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:42:17,858 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69b19afea26b422765ba381e/lava-logs.yaml 2026-03-11 16:42:17,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:42:17,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:42:18,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:42:18,098 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69b19afea26b422765ba381e/lava_callback.json.gz 2026-03-11 16:42:18,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:18,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:42:18,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19afea26b422765ba381e HTTP/1.1" 200 None 2026-03-11 16:42:18,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:18,156 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b19acea26b422765ba37a2/lava-logs.yaml 2026-03-11 16:42:18,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:42:18,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:42:18,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:18,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19afea26b422765ba381e HTTP/1.1" 200 None 2026-03-11 16:42:18,210 - lava_callback - INFO - Completed processing callback for node 69b19afea26b422765ba381e 2026-03-11 16:42:18,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:42:18,384 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b19acea26b422765ba37a2/lava_callback.json.gz 2026-03-11 16:42:18,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:18,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19acea26b422765ba37a2 HTTP/1.1" 200 None 2026-03-11 16:42:18,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:18,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:42:18,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:18,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19acea26b422765ba37a2 HTTP/1.1" 200 None 2026-03-11 16:42:18,495 - lava_callback - INFO - Completed processing callback for node 69b19acea26b422765ba37a2 INFO: 172.19.0.1:41704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49968 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:42:36,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:36,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:49974 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:42:41,570 - lava_callback - INFO - Received callback for node 69aef877ce46d8ec186abca4 INFO: 172.19.0.1:47252 - "POST /node/69aef877ce46d8ec186abca4 HTTP/1.0" 202 Accepted 2026-03-11 16:42:41,575 - lava_callback - INFO - Starting async job submit for node 69aef877ce46d8ec186abca4 2026-03-11 16:42:41,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:41,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef877ce46d8ec186abca4 HTTP/1.1" 200 None 2026-03-11 16:42:41,595 - lava_callback - DEBUG - Processing node 69aef877ce46d8ec186abca4: baseline-arm-baylibre 2026-03-11 16:42:41,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef877ce46d8ec186abca4 2026-03-11 16:42:41,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:41,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef877ce46d8ec186abca4 HTTP/1.1" 200 None 2026-03-11 16:42:41,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:41,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 16:42:41,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:41,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef877ce46d8ec186abca4 HTTP/1.1" 200 None 2026-03-11 16:42:41,655 - lava_callback - ERROR - Error processing callback for node 69aef877ce46d8ec186abca4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 16:42:43,694 - lava_callback - INFO - Received callback for node 69b19ae1a26b422765ba37d5 INFO: 172.19.0.1:47260 - "POST /node/69b19ae1a26b422765ba37d5 HTTP/1.0" 202 Accepted 2026-03-11 16:42:43,700 - lava_callback - INFO - Starting async job submit for node 69b19ae1a26b422765ba37d5 2026-03-11 16:42:43,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:43,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ae1a26b422765ba37d5 HTTP/1.1" 200 None 2026-03-11 16:42:43,736 - lava_callback - DEBUG - Processing node 69b19ae1a26b422765ba37d5: baseline-arm-pengutronix 2026-03-11 16:42:43,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:42:44,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:42:44,031 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b19ae1a26b422765ba37d5/log.txt.gz 2026-03-11 16:42:44,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:42:44,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:42:44,332 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b19ae1a26b422765ba37d5/lava-logs.yaml 2026-03-11 16:42:44,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:42:44,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:42:44,502 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b19ae1a26b422765ba37d5/lava_callback.json.gz 2026-03-11 16:42:44,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:44,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ae1a26b422765ba37d5 HTTP/1.1" 200 None 2026-03-11 16:42:44,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:44,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:42:44,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:42:44,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ae1a26b422765ba37d5 HTTP/1.1" 200 None 2026-03-11 16:42:44,671 - lava_callback - INFO - Completed processing callback for node 69b19ae1a26b422765ba37d5 INFO: 172.19.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39914 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:43:00,161 - lava_callback - INFO - Received callback for node 69b19adea26b422765ba37ca INFO: 172.19.0.1:48908 - "POST /node/69b19adea26b422765ba37ca HTTP/1.0" 202 Accepted 2026-03-11 16:43:00,167 - lava_callback - INFO - Starting async job submit for node 69b19adea26b422765ba37ca 2026-03-11 16:43:00,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:00,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19adea26b422765ba37ca HTTP/1.1" 200 None 2026-03-11 16:43:00,212 - lava_callback - DEBUG - Processing node 69b19adea26b422765ba37ca: baseline-arm-kontron 2026-03-11 16:43:00,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:43:00,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:43:00,557 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b19adea26b422765ba37ca/log.txt.gz 2026-03-11 16:43:00,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:43:00,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:43:00,858 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b19adea26b422765ba37ca/lava-logs.yaml 2026-03-11 16:43:00,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:43:01,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:43:01,027 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b19adea26b422765ba37ca/lava_callback.json.gz 2026-03-11 16:43:01,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:01,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19adea26b422765ba37ca HTTP/1.1" 200 None 2026-03-11 16:43:01,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:01,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:43:01,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:01,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19adea26b422765ba37ca HTTP/1.1" 200 None 2026-03-11 16:43:01,127 - lava_callback - INFO - Completed processing callback for node 69b19adea26b422765ba37ca INFO: 172.19.0.1:48918 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:43:06,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:07,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 16:43:08,967 - lava_callback - INFO - Received callback for node 69b19ad5a26b422765ba37b5 INFO: 172.19.0.1:48926 - "POST /node/69b19ad5a26b422765ba37b5 HTTP/1.0" 202 Accepted 2026-03-11 16:43:08,973 - lava_callback - INFO - Starting async job submit for node 69b19ad5a26b422765ba37b5 2026-03-11 16:43:08,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:09,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ad5a26b422765ba37b5 HTTP/1.1" 200 None 2026-03-11 16:43:09,012 - lava_callback - DEBUG - Processing node 69b19ad5a26b422765ba37b5: baseline-arm-clabbe 2026-03-11 16:43:09,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:43:09,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:43:09,338 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b19ad5a26b422765ba37b5/log.txt.gz 2026-03-11 16:43:09,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:43:09,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:43:09,672 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b19ad5a26b422765ba37b5/lava-logs.yaml 2026-03-11 16:43:09,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:43:09,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:43:09,840 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b19ad5a26b422765ba37b5/lava_callback.json.gz 2026-03-11 16:43:09,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:09,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ad5a26b422765ba37b5 HTTP/1.1" 200 None 2026-03-11 16:43:09,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:09,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:43:09,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:09,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ad5a26b422765ba37b5 HTTP/1.1" 200 None 2026-03-11 16:43:09,955 - lava_callback - INFO - Completed processing callback for node 69b19ad5a26b422765ba37b5 INFO: 172.19.0.1:39800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39802 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:43:21,408 - lava_callback - INFO - Received callback for node 69aef8a0ce46d8ec186abcfb INFO: 172.19.0.1:52466 - "POST /node/69aef8a0ce46d8ec186abcfb HTTP/1.0" 202 Accepted 2026-03-11 16:43:21,414 - lava_callback - INFO - Starting async job submit for node 69aef8a0ce46d8ec186abcfb 2026-03-11 16:43:21,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:21,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef8a0ce46d8ec186abcfb HTTP/1.1" 200 None 2026-03-11 16:43:21,437 - lava_callback - DEBUG - Processing node 69aef8a0ce46d8ec186abcfb: baseline-arm-baylibre 2026-03-11 16:43:21,437 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef8a0ce46d8ec186abcfb 2026-03-11 16:43:21,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:21,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef8a0ce46d8ec186abcfb HTTP/1.1" 200 None 2026-03-11 16:43:21,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:21,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 16:43:21,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:21,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef8a0ce46d8ec186abcfb HTTP/1.1" 200 None 2026-03-11 16:43:21,495 - lava_callback - ERROR - Error processing callback for node 69aef8a0ce46d8ec186abcfb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58844 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:43:37,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:37,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 16:43:37,191 - lava_callback - INFO - Received callback for node 69b19acaa26b422765ba3799 INFO: 172.19.0.1:58858 - "POST /node/69b19acaa26b422765ba3799 HTTP/1.0" 202 Accepted 2026-03-11 16:43:37,197 - lava_callback - INFO - Starting async job submit for node 69b19acaa26b422765ba3799 2026-03-11 16:43:37,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:37,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19acaa26b422765ba3799 HTTP/1.1" 200 None 2026-03-11 16:43:37,235 - lava_callback - DEBUG - Processing node 69b19acaa26b422765ba3799: baseline-arm-broonie 2026-03-11 16:43:37,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:43:37,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:43:37,787 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b19acaa26b422765ba3799/log.txt.gz 2026-03-11 16:43:38,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:43:38,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:43:38,260 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b19acaa26b422765ba3799/lava-logs.yaml 2026-03-11 16:43:38,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:43:38,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:43:38,397 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b19acaa26b422765ba3799/lava_callback.json.gz 2026-03-11 16:43:38,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:38,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19acaa26b422765ba3799 HTTP/1.1" 200 None 2026-03-11 16:43:38,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:38,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:43:38,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:43:38,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19acaa26b422765ba3799 HTTP/1.1" 200 None 2026-03-11 16:43:38,478 - lava_callback - INFO - Completed processing callback for node 69b19acaa26b422765ba3799 INFO: 172.19.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47560 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:44:01,425 - lava_callback - INFO - Received callback for node 69aef8c6ce46d8ec186abd1e INFO: 172.19.0.1:37792 - "POST /node/69aef8c6ce46d8ec186abd1e HTTP/1.0" 202 Accepted 2026-03-11 16:44:01,431 - lava_callback - INFO - Starting async job submit for node 69aef8c6ce46d8ec186abd1e 2026-03-11 16:44:01,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:44:01,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef8c6ce46d8ec186abd1e HTTP/1.1" 200 None 2026-03-11 16:44:01,447 - lava_callback - DEBUG - Processing node 69aef8c6ce46d8ec186abd1e: baseline-arm-baylibre 2026-03-11 16:44:01,447 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef8c6ce46d8ec186abd1e 2026-03-11 16:44:01,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:44:01,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef8c6ce46d8ec186abd1e HTTP/1.1" 200 None 2026-03-11 16:44:01,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:44:01,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 16:44:01,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:44:01,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef8c6ce46d8ec186abd1e HTTP/1.1" 200 None 2026-03-11 16:44:01,503 - lava_callback - ERROR - Error processing callback for node 69aef8c6ce46d8ec186abd1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37800 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:44:07,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:44:07,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:38618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42328 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:44:41,489 - lava_callback - INFO - Received callback for node 69aef8f0ce46d8ec186abd44 INFO: 172.19.0.1:56124 - "POST /node/69aef8f0ce46d8ec186abd44 HTTP/1.0" 202 Accepted 2026-03-11 16:44:41,495 - lava_callback - INFO - Starting async job submit for node 69aef8f0ce46d8ec186abd44 2026-03-11 16:44:41,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:44:41,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef8f0ce46d8ec186abd44 HTTP/1.1" 200 None 2026-03-11 16:44:41,534 - lava_callback - DEBUG - Processing node 69aef8f0ce46d8ec186abd44: baseline-arm-baylibre 2026-03-11 16:44:41,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef8f0ce46d8ec186abd44 2026-03-11 16:44:41,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:44:41,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef8f0ce46d8ec186abd44 HTTP/1.1" 200 None 2026-03-11 16:44:41,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:44:41,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 16:44:41,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:44:41,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef8f0ce46d8ec186abd44 HTTP/1.1" 200 None 2026-03-11 16:44:41,595 - lava_callback - ERROR - Error processing callback for node 69aef8f0ce46d8ec186abd44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56138 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:44:48,044 - lava_callback - INFO - Received callback for node 69b19ad9a26b422765ba37c1 INFO: 172.19.0.1:56146 - "POST /node/69b19ad9a26b422765ba37c1 HTTP/1.0" 202 Accepted 2026-03-11 16:44:48,050 - lava_callback - INFO - Starting async job submit for node 69b19ad9a26b422765ba37c1 2026-03-11 16:44:48,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:44:48,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ad9a26b422765ba37c1 HTTP/1.1" 200 None 2026-03-11 16:44:48,088 - lava_callback - DEBUG - Processing node 69b19ad9a26b422765ba37c1: baseline-arm-clabbe 2026-03-11 16:44:48,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:44:48,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:44:48,464 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b19ad9a26b422765ba37c1/log.txt.gz 2026-03-11 16:44:48,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:44:48,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:44:48,791 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b19ad9a26b422765ba37c1/lava-logs.yaml 2026-03-11 16:44:48,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:44:48,927 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:44:48,928 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b19ad9a26b422765ba37c1/lava_callback.json.gz 2026-03-11 16:44:48,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:44:48,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ad9a26b422765ba37c1 HTTP/1.1" 200 None 2026-03-11 16:44:48,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:44:48,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:44:48,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:44:49,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ad9a26b422765ba37c1 HTTP/1.1" 200 None 2026-03-11 16:44:49,012 - lava_callback - INFO - Completed processing callback for node 69b19ad9a26b422765ba37c1 INFO: 172.19.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59094 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:45:07,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:45:07,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:36930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36940 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:45:21,923 - lava_callback - INFO - Received callback for node 69aef914ce46d8ec186abd8d INFO: 172.19.0.1:37774 - "POST /node/69aef914ce46d8ec186abd8d HTTP/1.0" 202 Accepted 2026-03-11 16:45:21,933 - lava_callback - INFO - Starting async job submit for node 69aef914ce46d8ec186abd8d 2026-03-11 16:45:21,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:45:21,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef914ce46d8ec186abd8d HTTP/1.1" 200 None 2026-03-11 16:45:21,963 - lava_callback - DEBUG - Processing node 69aef914ce46d8ec186abd8d: baseline-arm-baylibre 2026-03-11 16:45:21,963 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef914ce46d8ec186abd8d 2026-03-11 16:45:21,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:45:21,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef914ce46d8ec186abd8d HTTP/1.1" 200 None 2026-03-11 16:45:21,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:45:22,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 16:45:22,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:45:22,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef914ce46d8ec186abd8d HTTP/1.1" 200 None 2026-03-11 16:45:22,054 - lava_callback - ERROR - Error processing callback for node 69aef914ce46d8ec186abd8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44054 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:46:01,535 - lava_callback - INFO - Received callback for node 69aef93cce46d8ec186abdb0 INFO: 172.19.0.1:36134 - "POST /node/69aef93cce46d8ec186abdb0 HTTP/1.0" 202 Accepted 2026-03-11 16:46:01,541 - lava_callback - INFO - Starting async job submit for node 69aef93cce46d8ec186abdb0 2026-03-11 16:46:01,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:01,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef93cce46d8ec186abdb0 HTTP/1.1" 200 None 2026-03-11 16:46:01,557 - lava_callback - DEBUG - Processing node 69aef93cce46d8ec186abdb0: baseline-arm-baylibre 2026-03-11 16:46:01,557 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef93cce46d8ec186abdb0 2026-03-11 16:46:01,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:01,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef93cce46d8ec186abdb0 HTTP/1.1" 200 None 2026-03-11 16:46:01,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:01,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 16:46:01,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:01,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef93cce46d8ec186abdb0 HTTP/1.1" 200 None 2026-03-11 16:46:01,614 - lava_callback - ERROR - Error processing callback for node 69aef93cce46d8ec186abdb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36138 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:46:11,476 - lava_callback - INFO - Received callback for node 69b19c48a26b422765ba392e INFO: 172.19.0.1:57352 - "POST /node/69b19c48a26b422765ba392e HTTP/1.0" 202 Accepted 2026-03-11 16:46:11,482 - lava_callback - INFO - Starting async job submit for node 69b19c48a26b422765ba392e 2026-03-11 16:46:11,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:11,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19c48a26b422765ba392e HTTP/1.1" 200 None 2026-03-11 16:46:11,500 - lava_callback - DEBUG - Processing node 69b19c48a26b422765ba392e: baseline-arm 2026-03-11 16:46:11,505 - lava_callback - WARNING - Failed to upload log 2026-03-11 16:46:11,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:46:11,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:46:11,681 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b19c48a26b422765ba392e/lava-logs.yaml 2026-03-11 16:46:11,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:46:11,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:46:11,815 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b19c48a26b422765ba392e/lava_callback.json.gz 2026-03-11 16:46:11,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:11,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19c48a26b422765ba392e HTTP/1.1" 200 None 2026-03-11 16:46:11,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:11,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:46:11,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:11,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19c48a26b422765ba392e HTTP/1.1" 200 None 2026-03-11 16:46:11,881 - lava_callback - INFO - Completed processing callback for node 69b19c48a26b422765ba392e INFO: 172.19.0.1:57364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33748 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:46:31,187 - lava_callback - INFO - Received callback for node 69b19adba26b422765ba37c4 INFO: 172.19.0.1:53638 - "POST /node/69b19adba26b422765ba37c4 HTTP/1.0" 202 Accepted 2026-03-11 16:46:31,193 - lava_callback - INFO - Starting async job submit for node 69b19adba26b422765ba37c4 2026-03-11 16:46:31,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:31,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19adba26b422765ba37c4 HTTP/1.1" 200 None 2026-03-11 16:46:31,230 - lava_callback - DEBUG - Processing node 69b19adba26b422765ba37c4: baseline-arm-clabbe 2026-03-11 16:46:31,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:46:31,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:46:31,580 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b19adba26b422765ba37c4/log.txt.gz 2026-03-11 16:46:31,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:46:31,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:46:31,901 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b19adba26b422765ba37c4/lava-logs.yaml 2026-03-11 16:46:31,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:46:32,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:46:32,048 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b19adba26b422765ba37c4/lava_callback.json.gz 2026-03-11 16:46:32,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:32,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19adba26b422765ba37c4 HTTP/1.1" 200 None 2026-03-11 16:46:32,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:32,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:46:32,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:32,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19adba26b422765ba37c4 HTTP/1.1" 200 None 2026-03-11 16:46:32,161 - lava_callback - INFO - Completed processing callback for node 69b19adba26b422765ba37c4 INFO: 172.19.0.1:53648 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:46:37,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:37,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:53664 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:46:41,599 - lava_callback - INFO - Received callback for node 69aef965ce46d8ec186abdd2 INFO: 172.19.0.1:45204 - "POST /node/69aef965ce46d8ec186abdd2 HTTP/1.0" 202 Accepted 2026-03-11 16:46:41,605 - lava_callback - INFO - Starting async job submit for node 69aef965ce46d8ec186abdd2 2026-03-11 16:46:41,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:41,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef965ce46d8ec186abdd2 HTTP/1.1" 200 None 2026-03-11 16:46:41,624 - lava_callback - DEBUG - Processing node 69aef965ce46d8ec186abdd2: baseline-arm-baylibre 2026-03-11 16:46:41,624 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef965ce46d8ec186abdd2 2026-03-11 16:46:41,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:41,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef965ce46d8ec186abdd2 HTTP/1.1" 200 None 2026-03-11 16:46:41,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:41,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 16:46:41,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:46:41,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef965ce46d8ec186abdd2 HTTP/1.1" 200 None 2026-03-11 16:46:41,680 - lava_callback - ERROR - Error processing callback for node 69aef965ce46d8ec186abdd2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37450 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:47:21,628 - lava_callback - INFO - Received callback for node 69aef98ece46d8ec186abe1c INFO: 172.19.0.1:54476 - "POST /node/69aef98ece46d8ec186abe1c HTTP/1.0" 202 Accepted 2026-03-11 16:47:21,633 - lava_callback - INFO - Starting async job submit for node 69aef98ece46d8ec186abe1c 2026-03-11 16:47:21,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:47:21,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef98ece46d8ec186abe1c HTTP/1.1" 200 None 2026-03-11 16:47:21,665 - lava_callback - DEBUG - Processing node 69aef98ece46d8ec186abe1c: baseline-arm-baylibre 2026-03-11 16:47:21,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef98ece46d8ec186abe1c 2026-03-11 16:47:21,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:47:21,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef98ece46d8ec186abe1c HTTP/1.1" 200 None 2026-03-11 16:47:21,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:47:21,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 16:47:21,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:47:21,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef98ece46d8ec186abe1c HTTP/1.1" 200 None 2026-03-11 16:47:21,755 - lava_callback - ERROR - Error processing callback for node 69aef98ece46d8ec186abe1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45560 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:48:01,708 - lava_callback - INFO - Received callback for node 69aef9b9ce46d8ec186abe3a INFO: 172.19.0.1:35426 - "POST /node/69aef9b9ce46d8ec186abe3a HTTP/1.0" 202 Accepted 2026-03-11 16:48:01,714 - lava_callback - INFO - Starting async job submit for node 69aef9b9ce46d8ec186abe3a 2026-03-11 16:48:01,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:48:01,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef9b9ce46d8ec186abe3a HTTP/1.1" 200 None 2026-03-11 16:48:01,735 - lava_callback - DEBUG - Processing node 69aef9b9ce46d8ec186abe3a: baseline-arm-clabbe 2026-03-11 16:48:01,735 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef9b9ce46d8ec186abe3a 2026-03-11 16:48:01,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:48:01,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef9b9ce46d8ec186abe3a HTTP/1.1" 200 None 2026-03-11 16:48:01,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:48:01,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 16:48:01,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:48:01,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef9b9ce46d8ec186abe3a HTTP/1.1" 200 None 2026-03-11 16:48:01,786 - lava_callback - ERROR - Error processing callback for node 69aef9b9ce46d8ec186abe3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50048 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:48:41,731 - lava_callback - INFO - Received callback for node 69aef9e2ce46d8ec186abe7e INFO: 172.19.0.1:48268 - "POST /node/69aef9e2ce46d8ec186abe7e HTTP/1.0" 202 Accepted 2026-03-11 16:48:41,737 - lava_callback - INFO - Starting async job submit for node 69aef9e2ce46d8ec186abe7e 2026-03-11 16:48:41,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:48:41,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef9e2ce46d8ec186abe7e HTTP/1.1" 200 None 2026-03-11 16:48:41,753 - lava_callback - DEBUG - Processing node 69aef9e2ce46d8ec186abe7e: baseline-arm-clabbe 2026-03-11 16:48:41,753 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef9e2ce46d8ec186abe7e 2026-03-11 16:48:41,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:48:41,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef9e2ce46d8ec186abe7e HTTP/1.1" 200 None 2026-03-11 16:48:41,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:48:41,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 16:48:41,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:48:41,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef9e2ce46d8ec186abe7e HTTP/1.1" 200 None 2026-03-11 16:48:41,810 - lava_callback - ERROR - Error processing callback for node 69aef9e2ce46d8ec186abe7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34816 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:48:57,489 - lava_callback - INFO - Received callback for node 69b19b0ca26b422765ba3852 INFO: 172.19.0.1:34828 - "POST /node/69b19b0ca26b422765ba3852 HTTP/1.0" 202 Accepted 2026-03-11 16:48:57,497 - lava_callback - INFO - Starting async job submit for node 69b19b0ca26b422765ba3852 2026-03-11 16:48:57,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:48:57,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b0ca26b422765ba3852 HTTP/1.1" 200 None 2026-03-11 16:48:57,536 - lava_callback - DEBUG - Processing node 69b19b0ca26b422765ba3852: ltp-syscalls 2026-03-11 16:48:58,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:48:58,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:48:58,453 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b19b0ca26b422765ba3852/log.txt.gz 2026-03-11 16:48:58,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:48:59,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:48:59,113 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b19b0ca26b422765ba3852/lava-logs.yaml 2026-03-11 16:48:59,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:48:59,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:48:59,314 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b19b0ca26b422765ba3852/lava_callback.json.gz 2026-03-11 16:48:59,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:48:59,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b0ca26b422765ba3852 HTTP/1.1" 200 None 2026-03-11 16:48:59,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:48:59,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:48:59,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:48:59,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19b0ca26b422765ba3852 HTTP/1.1" 200 None 2026-03-11 16:48:59,413 - lava_callback - INFO - Completed processing callback for node 69b19b0ca26b422765ba3852 INFO: 172.19.0.1:34206 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:49:07,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:07,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39222 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:49:21,783 - lava_callback - INFO - Received callback for node 69aefa0bce46d8ec186abedc INFO: 172.19.0.1:41164 - "POST /node/69aefa0bce46d8ec186abedc HTTP/1.0" 202 Accepted 2026-03-11 16:49:21,788 - lava_callback - INFO - Starting async job submit for node 69aefa0bce46d8ec186abedc 2026-03-11 16:49:21,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:21,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa0bce46d8ec186abedc HTTP/1.1" 200 None 2026-03-11 16:49:21,805 - lava_callback - DEBUG - Processing node 69aefa0bce46d8ec186abedc: baseline-arm-clabbe 2026-03-11 16:49:21,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefa0bce46d8ec186abedc 2026-03-11 16:49:21,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:21,817 - lava_callback - INFO - Received callback for node 69aefa02ce46d8ec186abec3 INFO: 172.19.0.1:41178 - "POST /node/69aefa02ce46d8ec186abec3 HTTP/1.0" 202 Accepted 2026-03-11 16:49:21,823 - lava_callback - INFO - Starting async job submit for node 69aefa02ce46d8ec186abec3 2026-03-11 16:49:21,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:21,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa0bce46d8ec186abedc HTTP/1.1" 200 None 2026-03-11 16:49:21,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa02ce46d8ec186abec3 HTTP/1.1" 200 None 2026-03-11 16:49:21,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:21,841 - lava_callback - DEBUG - Processing node 69aefa02ce46d8ec186abec3: baseline-arm-baylibre 2026-03-11 16:49:21,841 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefa02ce46d8ec186abec3 2026-03-11 16:49:21,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:21,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa02ce46d8ec186abec3 HTTP/1.1" 200 None 2026-03-11 16:49:21,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:21,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 16:49:21,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:21,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefa02ce46d8ec186abec3 HTTP/1.1" 200 None 2026-03-11 16:49:21,912 - lava_callback - ERROR - Error processing callback for node 69aefa02ce46d8ec186abec3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 16:49:21,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 16:49:21,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:22,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefa0bce46d8ec186abedc HTTP/1.1" 200 None 2026-03-11 16:49:22,013 - lava_callback - ERROR - Error processing callback for node 69aefa0bce46d8ec186abedc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 16:49:22,467 - lava_callback - INFO - Received callback for node 69aefa04ce46d8ec186abec6 INFO: 172.19.0.1:41182 - "POST /node/69aefa04ce46d8ec186abec6 HTTP/1.0" 202 Accepted 2026-03-11 16:49:22,473 - lava_callback - INFO - Starting async job submit for node 69aefa04ce46d8ec186abec6 2026-03-11 16:49:22,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:22,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa04ce46d8ec186abec6 HTTP/1.1" 200 None 2026-03-11 16:49:22,490 - lava_callback - DEBUG - Processing node 69aefa04ce46d8ec186abec6: baseline-arm-baylibre 2026-03-11 16:49:22,491 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefa04ce46d8ec186abec6 2026-03-11 16:49:22,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:22,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa04ce46d8ec186abec6 HTTP/1.1" 200 None 2026-03-11 16:49:22,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:22,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 16:49:22,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:22,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefa04ce46d8ec186abec6 HTTP/1.1" 200 None 2026-03-11 16:49:22,565 - lava_callback - ERROR - Error processing callback for node 69aefa04ce46d8ec186abec6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 16:49:23,160 - lava_callback - INFO - Received callback for node 69aefa05ce46d8ec186abec9 INFO: 172.19.0.1:41188 - "POST /node/69aefa05ce46d8ec186abec9 HTTP/1.0" 202 Accepted 2026-03-11 16:49:23,166 - lava_callback - INFO - Starting async job submit for node 69aefa05ce46d8ec186abec9 2026-03-11 16:49:23,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:23,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa05ce46d8ec186abec9 HTTP/1.1" 200 None 2026-03-11 16:49:23,182 - lava_callback - DEBUG - Processing node 69aefa05ce46d8ec186abec9: baseline-arm-baylibre 2026-03-11 16:49:23,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefa05ce46d8ec186abec9 2026-03-11 16:49:23,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:23,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa05ce46d8ec186abec9 HTTP/1.1" 200 None 2026-03-11 16:49:23,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:23,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 16:49:23,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:23,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefa05ce46d8ec186abec9 HTTP/1.1" 200 None 2026-03-11 16:49:23,244 - lava_callback - ERROR - Error processing callback for node 69aefa05ce46d8ec186abec9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 16:49:23,805 - lava_callback - INFO - Received callback for node 69aefa06ce46d8ec186abecc INFO: 172.19.0.1:41192 - "POST /node/69aefa06ce46d8ec186abecc HTTP/1.0" 202 Accepted 2026-03-11 16:49:23,810 - lava_callback - INFO - Starting async job submit for node 69aefa06ce46d8ec186abecc 2026-03-11 16:49:23,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:23,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa06ce46d8ec186abecc HTTP/1.1" 200 None 2026-03-11 16:49:23,826 - lava_callback - DEBUG - Processing node 69aefa06ce46d8ec186abecc: baseline-arm-baylibre 2026-03-11 16:49:23,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefa06ce46d8ec186abecc 2026-03-11 16:49:23,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:23,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa06ce46d8ec186abecc HTTP/1.1" 200 None 2026-03-11 16:49:23,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:23,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 16:49:23,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:23,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefa06ce46d8ec186abecc HTTP/1.1" 200 None 2026-03-11 16:49:23,881 - lava_callback - ERROR - Error processing callback for node 69aefa06ce46d8ec186abecc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 16:49:24,489 - lava_callback - INFO - Received callback for node 69aefa09ce46d8ec186abed7 INFO: 172.19.0.1:41202 - "POST /node/69aefa09ce46d8ec186abed7 HTTP/1.0" 202 Accepted 2026-03-11 16:49:24,495 - lava_callback - INFO - Starting async job submit for node 69aefa09ce46d8ec186abed7 2026-03-11 16:49:24,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:24,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa09ce46d8ec186abed7 HTTP/1.1" 200 None 2026-03-11 16:49:24,511 - lava_callback - DEBUG - Processing node 69aefa09ce46d8ec186abed7: baseline-arm-baylibre 2026-03-11 16:49:24,511 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefa09ce46d8ec186abed7 2026-03-11 16:49:24,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:24,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa09ce46d8ec186abed7 HTTP/1.1" 200 None 2026-03-11 16:49:24,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:24,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 16:49:24,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:24,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefa09ce46d8ec186abed7 HTTP/1.1" 200 None 2026-03-11 16:49:24,582 - lava_callback - ERROR - Error processing callback for node 69aefa09ce46d8ec186abed7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 16:49:25,148 - lava_callback - INFO - Received callback for node 69aefa0bce46d8ec186abeda INFO: 172.19.0.1:41208 - "POST /node/69aefa0bce46d8ec186abeda HTTP/1.0" 202 Accepted 2026-03-11 16:49:25,154 - lava_callback - INFO - Starting async job submit for node 69aefa0bce46d8ec186abeda 2026-03-11 16:49:25,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:25,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa0bce46d8ec186abeda HTTP/1.1" 200 None 2026-03-11 16:49:25,169 - lava_callback - DEBUG - Processing node 69aefa0bce46d8ec186abeda: baseline-arm-baylibre 2026-03-11 16:49:25,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefa0bce46d8ec186abeda 2026-03-11 16:49:25,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:25,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa0bce46d8ec186abeda HTTP/1.1" 200 None 2026-03-11 16:49:25,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:25,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 16:49:25,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:25,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefa0bce46d8ec186abeda HTTP/1.1" 200 None 2026-03-11 16:49:25,242 - lava_callback - ERROR - Error processing callback for node 69aefa0bce46d8ec186abeda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49644 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:49:41,757 - lava_callback - INFO - Received callback for node 69aefa11ce46d8ec186abef1 INFO: 172.19.0.1:52688 - "POST /node/69aefa11ce46d8ec186abef1 HTTP/1.0" 202 Accepted 2026-03-11 16:49:41,762 - lava_callback - INFO - Starting async job submit for node 69aefa11ce46d8ec186abef1 2026-03-11 16:49:41,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:41,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa11ce46d8ec186abef1 HTTP/1.1" 200 None 2026-03-11 16:49:41,779 - lava_callback - DEBUG - Processing node 69aefa11ce46d8ec186abef1: baseline-arm-clabbe 2026-03-11 16:49:41,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefa11ce46d8ec186abef1 2026-03-11 16:49:41,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:41,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa11ce46d8ec186abef1 HTTP/1.1" 200 None 2026-03-11 16:49:41,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:41,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 16:49:41,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:41,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefa11ce46d8ec186abef1 HTTP/1.1" 200 None 2026-03-11 16:49:41,837 - lava_callback - ERROR - Error processing callback for node 69aefa11ce46d8ec186abef1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 16:49:42,408 - lava_callback - INFO - Received callback for node 69aefa14ce46d8ec186abefe INFO: 172.19.0.1:52690 - "POST /node/69aefa14ce46d8ec186abefe HTTP/1.0" 202 Accepted 2026-03-11 16:49:42,414 - lava_callback - INFO - Starting async job submit for node 69aefa14ce46d8ec186abefe 2026-03-11 16:49:42,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:42,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa14ce46d8ec186abefe HTTP/1.1" 200 None 2026-03-11 16:49:42,443 - lava_callback - DEBUG - Processing node 69aefa14ce46d8ec186abefe: baseline-arm-clabbe 2026-03-11 16:49:42,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefa14ce46d8ec186abefe 2026-03-11 16:49:42,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:42,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa14ce46d8ec186abefe HTTP/1.1" 200 None 2026-03-11 16:49:42,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:42,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 16:49:42,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:42,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefa14ce46d8ec186abefe HTTP/1.1" 200 None 2026-03-11 16:49:42,505 - lava_callback - ERROR - Error processing callback for node 69aefa14ce46d8ec186abefe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 16:49:43,075 - lava_callback - INFO - Received callback for node 69aefa15ce46d8ec186abf01 INFO: 172.19.0.1:52694 - "POST /node/69aefa15ce46d8ec186abf01 HTTP/1.0" 202 Accepted 2026-03-11 16:49:43,081 - lava_callback - INFO - Starting async job submit for node 69aefa15ce46d8ec186abf01 2026-03-11 16:49:43,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:43,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa15ce46d8ec186abf01 HTTP/1.1" 200 None 2026-03-11 16:49:43,099 - lava_callback - DEBUG - Processing node 69aefa15ce46d8ec186abf01: baseline-arm-clabbe 2026-03-11 16:49:43,100 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefa15ce46d8ec186abf01 2026-03-11 16:49:43,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:43,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa15ce46d8ec186abf01 HTTP/1.1" 200 None 2026-03-11 16:49:43,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:43,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 16:49:43,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:43,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefa15ce46d8ec186abf01 HTTP/1.1" 200 None 2026-03-11 16:49:43,171 - lava_callback - ERROR - Error processing callback for node 69aefa15ce46d8ec186abf01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 16:49:43,747 - lava_callback - INFO - Received callback for node 69aefa16ce46d8ec186abf04 INFO: 172.19.0.1:52696 - "POST /node/69aefa16ce46d8ec186abf04 HTTP/1.0" 202 Accepted 2026-03-11 16:49:43,753 - lava_callback - INFO - Starting async job submit for node 69aefa16ce46d8ec186abf04 2026-03-11 16:49:43,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:43,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa16ce46d8ec186abf04 HTTP/1.1" 200 None 2026-03-11 16:49:43,769 - lava_callback - DEBUG - Processing node 69aefa16ce46d8ec186abf04: baseline-arm-clabbe 2026-03-11 16:49:43,769 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefa16ce46d8ec186abf04 2026-03-11 16:49:43,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:43,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa16ce46d8ec186abf04 HTTP/1.1" 200 None 2026-03-11 16:49:43,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:43,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 16:49:43,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:43,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefa16ce46d8ec186abf04 HTTP/1.1" 200 None 2026-03-11 16:49:43,827 - lava_callback - ERROR - Error processing callback for node 69aefa16ce46d8ec186abf04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 16:49:44,405 - lava_callback - INFO - Received callback for node 69aefa19ce46d8ec186abf3f INFO: 172.19.0.1:52702 - "POST /node/69aefa19ce46d8ec186abf3f HTTP/1.0" 202 Accepted 2026-03-11 16:49:44,410 - lava_callback - INFO - Starting async job submit for node 69aefa19ce46d8ec186abf3f 2026-03-11 16:49:44,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:44,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa19ce46d8ec186abf3f HTTP/1.1" 200 None 2026-03-11 16:49:44,434 - lava_callback - DEBUG - Processing node 69aefa19ce46d8ec186abf3f: baseline-arm-clabbe 2026-03-11 16:49:44,434 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefa19ce46d8ec186abf3f 2026-03-11 16:49:44,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:44,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa19ce46d8ec186abf3f HTTP/1.1" 200 None 2026-03-11 16:49:44,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:44,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 16:49:44,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:49:44,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefa19ce46d8ec186abf3f HTTP/1.1" 200 None 2026-03-11 16:49:44,496 - lava_callback - ERROR - Error processing callback for node 69aefa19ce46d8ec186abf3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52856 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:50:01,762 - lava_callback - INFO - Received callback for node 69aefa32ce46d8ec186abf9a INFO: 172.19.0.1:42660 - "POST /node/69aefa32ce46d8ec186abf9a HTTP/1.0" 202 Accepted 2026-03-11 16:50:01,767 - lava_callback - INFO - Starting async job submit for node 69aefa32ce46d8ec186abf9a 2026-03-11 16:50:01,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:50:01,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa32ce46d8ec186abf9a HTTP/1.1" 200 None 2026-03-11 16:50:01,810 - lava_callback - DEBUG - Processing node 69aefa32ce46d8ec186abf9a: baseline-arm-baylibre 2026-03-11 16:50:01,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefa32ce46d8ec186abf9a 2026-03-11 16:50:01,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:50:01,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa32ce46d8ec186abf9a HTTP/1.1" 200 None 2026-03-11 16:50:01,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:50:01,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 16:50:01,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:50:01,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefa32ce46d8ec186abf9a HTTP/1.1" 200 None 2026-03-11 16:50:01,875 - lava_callback - ERROR - Error processing callback for node 69aefa32ce46d8ec186abf9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50930 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:50:38,564 - lava_callback - INFO - Received callback for node 69b19ceba26b422765ba396b INFO: 172.19.0.1:50932 - "POST /node/69b19ceba26b422765ba396b HTTP/1.0" 202 Accepted 2026-03-11 16:50:38,570 - lava_callback - INFO - Starting async job submit for node 69b19ceba26b422765ba396b 2026-03-11 16:50:38,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:50:38,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ceba26b422765ba396b HTTP/1.1" 200 None 2026-03-11 16:50:38,608 - lava_callback - DEBUG - Processing node 69b19ceba26b422765ba396b: baseline-arm-pengutronix 2026-03-11 16:50:38,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:50:38,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:50:38,914 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b19ceba26b422765ba396b/log.txt.gz 2026-03-11 16:50:39,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:50:39,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:50:39,227 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b19ceba26b422765ba396b/lava-logs.yaml 2026-03-11 16:50:39,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:50:39,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:50:39,381 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b19ceba26b422765ba396b/lava_callback.json.gz INFO: 172.19.0.1:50946 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:50:39,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:50:39,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ceba26b422765ba396b HTTP/1.1" 200 None 2026-03-11 16:50:39,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:50:39,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:50:39,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:50:39,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ceba26b422765ba396b HTTP/1.1" 200 None 2026-03-11 16:50:39,530 - lava_callback - INFO - Completed processing callback for node 69b19ceba26b422765ba396b 2026-03-11 16:50:41,868 - lava_callback - INFO - Received callback for node 69aefa5cce46d8ec186abff0 INFO: 172.19.0.1:38082 - "POST /node/69aefa5cce46d8ec186abff0 HTTP/1.0" 202 Accepted 2026-03-11 16:50:41,874 - lava_callback - INFO - Starting async job submit for node 69aefa5cce46d8ec186abff0 2026-03-11 16:50:41,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:50:41,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa5cce46d8ec186abff0 HTTP/1.1" 200 None 2026-03-11 16:50:41,890 - lava_callback - DEBUG - Processing node 69aefa5cce46d8ec186abff0: baseline-arm-clabbe 2026-03-11 16:50:41,890 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefa5cce46d8ec186abff0 2026-03-11 16:50:41,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:50:41,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa5cce46d8ec186abff0 HTTP/1.1" 200 None 2026-03-11 16:50:41,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:50:41,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 16:50:41,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:50:41,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefa5cce46d8ec186abff0 HTTP/1.1" 200 None 2026-03-11 16:50:41,942 - lava_callback - ERROR - Error processing callback for node 69aefa5cce46d8ec186abff0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51876 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:51:07,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:51:07,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:58596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58608 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:51:21,801 - lava_callback - INFO - Received callback for node 69aefa86ce46d8ec186ac04a INFO: 172.19.0.1:54282 - "POST /node/69aefa86ce46d8ec186ac04a HTTP/1.0" 202 Accepted 2026-03-11 16:51:21,807 - lava_callback - INFO - Starting async job submit for node 69aefa86ce46d8ec186ac04a 2026-03-11 16:51:21,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:51:21,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa86ce46d8ec186ac04a HTTP/1.1" 200 None 2026-03-11 16:51:21,833 - lava_callback - DEBUG - Processing node 69aefa86ce46d8ec186ac04a: baseline-arm-clabbe 2026-03-11 16:51:21,833 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefa86ce46d8ec186ac04a 2026-03-11 16:51:21,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:51:21,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefa86ce46d8ec186ac04a HTTP/1.1" 200 None 2026-03-11 16:51:21,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:51:21,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 16:51:21,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:51:21,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefa86ce46d8ec186ac04a HTTP/1.1" 200 None 2026-03-11 16:51:21,897 - lava_callback - ERROR - Error processing callback for node 69aefa86ce46d8ec186ac04a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39170 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:52:01,859 - lava_callback - INFO - Received callback for node 69aefaafce46d8ec186ac074 INFO: 172.19.0.1:57514 - "POST /node/69aefaafce46d8ec186ac074 HTTP/1.0" 202 Accepted 2026-03-11 16:52:01,865 - lava_callback - INFO - Starting async job submit for node 69aefaafce46d8ec186ac074 2026-03-11 16:52:01,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:52:01,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefaafce46d8ec186ac074 HTTP/1.1" 200 None 2026-03-11 16:52:01,885 - lava_callback - DEBUG - Processing node 69aefaafce46d8ec186ac074: baseline-arm-clabbe 2026-03-11 16:52:01,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefaafce46d8ec186ac074 2026-03-11 16:52:01,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:52:01,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefaafce46d8ec186ac074 HTTP/1.1" 200 None 2026-03-11 16:52:01,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:52:01,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 16:52:01,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:52:01,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefaafce46d8ec186ac074 HTTP/1.1" 200 None 2026-03-11 16:52:01,955 - lava_callback - ERROR - Error processing callback for node 69aefaafce46d8ec186ac074: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57448 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:52:41,964 - lava_callback - INFO - Received callback for node 69aefad5ce46d8ec186ac0cb INFO: 172.19.0.1:52958 - "POST /node/69aefad5ce46d8ec186ac0cb HTTP/1.0" 202 Accepted 2026-03-11 16:52:41,973 - lava_callback - INFO - Starting async job submit for node 69aefad5ce46d8ec186ac0cb 2026-03-11 16:52:41,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:52:41,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefad5ce46d8ec186ac0cb HTTP/1.1" 200 None 2026-03-11 16:52:41,997 - lava_callback - DEBUG - Processing node 69aefad5ce46d8ec186ac0cb: baseline-arm-baylibre 2026-03-11 16:52:41,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefad5ce46d8ec186ac0cb 2026-03-11 16:52:41,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:52:42,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefad5ce46d8ec186ac0cb HTTP/1.1" 200 None 2026-03-11 16:52:42,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:52:42,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70a4fe31b554803095c08 HTTP/1.1" 200 None 2026-03-11 16:52:42,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:52:42,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefad5ce46d8ec186ac0cb HTTP/1.1" 200 None 2026-03-11 16:52:42,087 - lava_callback - ERROR - Error processing callback for node 69aefad5ce46d8ec186ac0cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59984 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:55:15,128 - lava_callback - INFO - Received callback for node 69b19e67a26b422765ba39fa INFO: 172.19.0.1:38262 - "POST /node/69b19e67a26b422765ba39fa HTTP/1.0" 202 Accepted 2026-03-11 16:55:15,147 - lava_callback - INFO - Starting async job submit for node 69b19e67a26b422765ba39fa 2026-03-11 16:55:15,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:38270 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 16:55:15,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19e67a26b422765ba39fa HTTP/1.1" 200 None 2026-03-11 16:55:15,176 - lava_callback - DEBUG - Processing node 69b19e67a26b422765ba39fa: baseline-arm 2026-03-11 16:55:15,184 - lava_callback - WARNING - Failed to upload log 2026-03-11 16:55:15,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:55:15,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:55:15,632 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b19e67a26b422765ba39fa/lava-logs.yaml 2026-03-11 16:55:15,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:55:15,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:55:15,982 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b19e67a26b422765ba39fa/lava_callback.json.gz 2026-03-11 16:55:15,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:55:16,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19e67a26b422765ba39fa HTTP/1.1" 200 None 2026-03-11 16:55:16,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:55:16,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:55:16,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:55:16,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19e67a26b422765ba39fa HTTP/1.1" 200 None 2026-03-11 16:55:16,080 - lava_callback - INFO - Completed processing callback for node 69b19e67a26b422765ba39fa INFO: 172.19.0.1:38282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34970 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:55:37,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:55:37,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34362 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:56:29,603 - lava_callback - INFO - Received callback for node 69b19ab7a26b422765ba375a INFO: 172.19.0.1:34372 - "POST /node/69b19ab7a26b422765ba375a HTTP/1.0" 202 Accepted 2026-03-11 16:56:29,612 - lava_callback - INFO - Starting async job submit for node 69b19ab7a26b422765ba375a 2026-03-11 16:56:29,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:56:29,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ab7a26b422765ba375a HTTP/1.1" 200 None 2026-03-11 16:56:29,680 - lava_callback - DEBUG - Processing node 69b19ab7a26b422765ba375a: baseline-arm 2026-03-11 16:56:30,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:56:30,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:56:30,410 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b19ab7a26b422765ba375a/log.txt.gz 2026-03-11 16:56:30,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:56:30,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:56:30,992 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b19ab7a26b422765ba375a/lava-logs.yaml 2026-03-11 16:56:31,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 16:56:31,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 16:56:31,198 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b19ab7a26b422765ba375a/lava_callback.json.gz DEBUG: Setup failed for 69b19ab7a26b422765ba375a. Transitting job node result: incomplete -> fail 2026-03-11 16:56:31,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:56:31,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ab7a26b422765ba375a HTTP/1.1" 200 None 2026-03-11 16:56:31,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:56:31,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 16:56:31,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:56:31,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ab7a26b422765ba375a HTTP/1.1" 200 None 2026-03-11 16:56:31,479 - lava_callback - INFO - Completed processing callback for node 69b19ab7a26b422765ba375a INFO: 172.19.0.1:47904 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:56:37,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:56:37,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36292 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:36300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48426 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:04:02,678 - lava_callback - INFO - Received callback for node 69aefd7dce46d8ec186ac3c8 INFO: 172.19.0.1:40834 - "POST /node/69aefd7dce46d8ec186ac3c8 HTTP/1.0" 202 Accepted 2026-03-11 17:04:02,684 - lava_callback - INFO - Starting async job submit for node 69aefd7dce46d8ec186ac3c8 2026-03-11 17:04:02,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:04:02,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefd7dce46d8ec186ac3c8 HTTP/1.1" 200 None 2026-03-11 17:04:02,700 - lava_callback - DEBUG - Processing node 69aefd7dce46d8ec186ac3c8: baseline-arm64-baylibre 2026-03-11 17:04:02,701 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefd7dce46d8ec186ac3c8 2026-03-11 17:04:02,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:04:02,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefd7dce46d8ec186ac3c8 HTTP/1.1" 200 None 2026-03-11 17:04:02,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:04:02,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 17:04:02,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:04:02,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefd7dce46d8ec186ac3c8 HTTP/1.1" 200 None 2026-03-11 17:04:02,768 - lava_callback - ERROR - Error processing callback for node 69aefd7dce46d8ec186ac3c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59288 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:05:22,651 - lava_callback - INFO - Received callback for node 69aefdcece46d8ec186ac3e1 INFO: 172.19.0.1:50098 - "POST /node/69aefdcece46d8ec186ac3e1 HTTP/1.0" 202 Accepted 2026-03-11 17:05:22,657 - lava_callback - INFO - Starting async job submit for node 69aefdcece46d8ec186ac3e1 2026-03-11 17:05:22,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:05:22,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefdcece46d8ec186ac3e1 HTTP/1.1" 200 None 2026-03-11 17:05:22,673 - lava_callback - DEBUG - Processing node 69aefdcece46d8ec186ac3e1: baseline-arm64-baylibre 2026-03-11 17:05:22,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefdcece46d8ec186ac3e1 2026-03-11 17:05:22,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:05:22,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefdcece46d8ec186ac3e1 HTTP/1.1" 200 None 2026-03-11 17:05:22,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:05:22,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 17:05:22,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:05:22,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefdcece46d8ec186ac3e1 HTTP/1.1" 200 None 2026-03-11 17:05:22,728 - lava_callback - ERROR - Error processing callback for node 69aefdcece46d8ec186ac3e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49014 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:06:42,968 - lava_callback - INFO - Received callback for node 69aefe1dce46d8ec186ac3f9 INFO: 172.19.0.1:38696 - "POST /node/69aefe1dce46d8ec186ac3f9 HTTP/1.0" 202 Accepted 2026-03-11 17:06:42,973 - lava_callback - INFO - Starting async job submit for node 69aefe1dce46d8ec186ac3f9 2026-03-11 17:06:42,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:06:42,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefe1dce46d8ec186ac3f9 HTTP/1.1" 200 None 2026-03-11 17:06:42,993 - lava_callback - DEBUG - Processing node 69aefe1dce46d8ec186ac3f9: baseline-arm64-baylibre 2026-03-11 17:06:42,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefe1dce46d8ec186ac3f9 2026-03-11 17:06:42,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:06:43,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefe1dce46d8ec186ac3f9 HTTP/1.1" 200 None 2026-03-11 17:06:43,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:06:43,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 17:06:43,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:06:43,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefe1dce46d8ec186ac3f9 HTTP/1.1" 200 None 2026-03-11 17:06:43,046 - lava_callback - ERROR - Error processing callback for node 69aefe1dce46d8ec186ac3f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37164 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:08:02,935 - lava_callback - INFO - Received callback for node 69aefe6fce46d8ec186ac400 INFO: 172.19.0.1:51272 - "POST /node/69aefe6fce46d8ec186ac400 HTTP/1.0" 202 Accepted 2026-03-11 17:08:02,941 - lava_callback - INFO - Starting async job submit for node 69aefe6fce46d8ec186ac400 2026-03-11 17:08:02,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:08:02,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefe6fce46d8ec186ac400 HTTP/1.1" 200 None 2026-03-11 17:08:02,967 - lava_callback - DEBUG - Processing node 69aefe6fce46d8ec186ac400: baseline-arm64-baylibre 2026-03-11 17:08:02,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefe6fce46d8ec186ac400 2026-03-11 17:08:02,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:08:02,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefe6fce46d8ec186ac400 HTTP/1.1" 200 None 2026-03-11 17:08:02,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:08:03,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 17:08:03,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:08:03,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefe6fce46d8ec186ac400 HTTP/1.1" 200 None 2026-03-11 17:08:03,034 - lava_callback - ERROR - Error processing callback for node 69aefe6fce46d8ec186ac400: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34810 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:09:22,880 - lava_callback - INFO - Received callback for node 69aefec0ce46d8ec186ac40d INFO: 172.19.0.1:50438 - "POST /node/69aefec0ce46d8ec186ac40d HTTP/1.0" 202 Accepted 2026-03-11 17:09:22,886 - lava_callback - INFO - Starting async job submit for node 69aefec0ce46d8ec186ac40d 2026-03-11 17:09:22,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:09:22,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefec0ce46d8ec186ac40d HTTP/1.1" 200 None 2026-03-11 17:09:22,902 - lava_callback - DEBUG - Processing node 69aefec0ce46d8ec186ac40d: baseline-arm64-baylibre 2026-03-11 17:09:22,902 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aefec0ce46d8ec186ac40d 2026-03-11 17:09:22,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:09:22,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aefec0ce46d8ec186ac40d HTTP/1.1" 200 None 2026-03-11 17:09:22,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:09:22,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 17:09:22,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:09:22,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aefec0ce46d8ec186ac40d HTTP/1.1" 200 None 2026-03-11 17:09:22,969 - lava_callback - ERROR - Error processing callback for node 69aefec0ce46d8ec186ac40d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52402 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:10:39,455 - lava_callback - INFO - Received callback for node 69b1a19ea26b422765ba3ae7 INFO: 172.19.0.1:52410 - "POST /node/69b1a19ea26b422765ba3ae7 HTTP/1.0" 202 Accepted 2026-03-11 17:10:39,465 - lava_callback - INFO - Starting async job submit for node 69b1a19ea26b422765ba3ae7 2026-03-11 17:10:39,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:10:39,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a19ea26b422765ba3ae7 HTTP/1.1" 200 None 2026-03-11 17:10:39,505 - lava_callback - DEBUG - Processing node 69b1a19ea26b422765ba3ae7: baseline-arm-pengutronix INFO: 172.19.0.1:46950 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:10:39,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:10:39,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:10:39,898 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1a19ea26b422765ba3ae7/log.txt.gz 2026-03-11 17:10:39,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:10:40,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:10:40,189 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1a19ea26b422765ba3ae7/lava-logs.yaml 2026-03-11 17:10:40,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:10:40,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:10:40,356 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1a19ea26b422765ba3ae7/lava_callback.json.gz 2026-03-11 17:10:40,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:10:40,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a19ea26b422765ba3ae7 HTTP/1.1" 200 None 2026-03-11 17:10:40,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:10:40,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 17:10:40,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:10:40,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a19ea26b422765ba3ae7 HTTP/1.1" 200 None 2026-03-11 17:10:40,508 - lava_callback - INFO - Completed processing callback for node 69b1a19ea26b422765ba3ae7 INFO: 172.19.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50948 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:11:02,971 - lava_callback - INFO - Received callback for node 69aeff13ce46d8ec186ac41a INFO: 172.19.0.1:37220 - "POST /node/69aeff13ce46d8ec186ac41a HTTP/1.0" 202 Accepted 2026-03-11 17:11:02,977 - lava_callback - INFO - Starting async job submit for node 69aeff13ce46d8ec186ac41a 2026-03-11 17:11:02,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:11:02,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeff13ce46d8ec186ac41a HTTP/1.1" 200 None 2026-03-11 17:11:02,993 - lava_callback - DEBUG - Processing node 69aeff13ce46d8ec186ac41a: baseline-arm64-baylibre 2026-03-11 17:11:02,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeff13ce46d8ec186ac41a 2026-03-11 17:11:02,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:11:03,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeff13ce46d8ec186ac41a HTTP/1.1" 200 None 2026-03-11 17:11:03,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:11:03,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 17:11:03,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:11:03,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeff13ce46d8ec186ac41a HTTP/1.1" 200 None 2026-03-11 17:11:03,044 - lava_callback - ERROR - Error processing callback for node 69aeff13ce46d8ec186ac41a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37232 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:11:07,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:11:07,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:58320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56024 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:12:22,815 - lava_callback - INFO - Received callback for node 69aeff67ce46d8ec186ac426 INFO: 172.19.0.1:43426 - "POST /node/69aeff67ce46d8ec186ac426 HTTP/1.0" 202 Accepted 2026-03-11 17:12:22,821 - lava_callback - INFO - Starting async job submit for node 69aeff67ce46d8ec186ac426 2026-03-11 17:12:22,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:12:22,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeff67ce46d8ec186ac426 HTTP/1.1" 200 None 2026-03-11 17:12:22,842 - lava_callback - DEBUG - Processing node 69aeff67ce46d8ec186ac426: baseline-arm64-clabbe 2026-03-11 17:12:22,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeff67ce46d8ec186ac426 2026-03-11 17:12:22,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:12:22,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeff67ce46d8ec186ac426 HTTP/1.1" 200 None 2026-03-11 17:12:22,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:12:22,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 17:12:22,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:12:22,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeff67ce46d8ec186ac426 HTTP/1.1" 200 None 2026-03-11 17:12:22,916 - lava_callback - ERROR - Error processing callback for node 69aeff67ce46d8ec186ac426: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35380 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:13:38,183 - lava_callback - INFO - Received callback for node 69b19af5a26b422765ba3812 INFO: 172.19.0.1:35396 - "POST /node/69b19af5a26b422765ba3812 HTTP/1.0" 202 Accepted 2026-03-11 17:13:38,189 - lava_callback - INFO - Starting async job submit for node 69b19af5a26b422765ba3812 2026-03-11 17:13:38,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:13:38,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19af5a26b422765ba3812 HTTP/1.1" 200 None 2026-03-11 17:13:38,229 - lava_callback - DEBUG - Processing node 69b19af5a26b422765ba3812: ltp-cap_bounds 2026-03-11 17:13:38,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:13:38,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:13:38,754 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b19af5a26b422765ba3812/log.txt.gz 2026-03-11 17:13:38,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:13:39,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:13:39,187 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b19af5a26b422765ba3812/lava-logs.yaml 2026-03-11 17:13:39,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:13:39,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:13:39,348 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b19af5a26b422765ba3812/lava_callback.json.gz 2026-03-11 17:13:39,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:13:39,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19af5a26b422765ba3812 HTTP/1.1" 200 None 2026-03-11 17:13:39,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:13:39,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 17:13:39,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:13:39,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19af5a26b422765ba3812 HTTP/1.1" 200 None 2026-03-11 17:13:39,443 - lava_callback - INFO - Completed processing callback for node 69b19af5a26b422765ba3812 INFO: 172.19.0.1:54400 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:13:42,847 - lava_callback - INFO - Received callback for node 69aeffb8ce46d8ec186ac43d INFO: 172.19.0.1:54410 - "POST /node/69aeffb8ce46d8ec186ac43d HTTP/1.0" 202 Accepted 2026-03-11 17:13:42,853 - lava_callback - INFO - Starting async job submit for node 69aeffb8ce46d8ec186ac43d 2026-03-11 17:13:42,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:13:42,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeffb8ce46d8ec186ac43d HTTP/1.1" 200 None 2026-03-11 17:13:42,869 - lava_callback - DEBUG - Processing node 69aeffb8ce46d8ec186ac43d: baseline-arm64-clabbe 2026-03-11 17:13:42,869 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeffb8ce46d8ec186ac43d 2026-03-11 17:13:42,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:13:42,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeffb8ce46d8ec186ac43d HTTP/1.1" 200 None 2026-03-11 17:13:42,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:13:42,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 17:13:42,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:13:42,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeffb8ce46d8ec186ac43d HTTP/1.1" 200 None 2026-03-11 17:13:42,927 - lava_callback - ERROR - Error processing callback for node 69aeffb8ce46d8ec186ac43d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46422 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:13:58,548 - lava_callback - INFO - Received callback for node 69b19af6a26b422765ba3815 INFO: 172.19.0.1:46434 - "POST /node/69b19af6a26b422765ba3815 HTTP/1.0" 202 Accepted 2026-03-11 17:13:58,554 - lava_callback - INFO - Starting async job submit for node 69b19af6a26b422765ba3815 2026-03-11 17:13:58,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:13:58,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19af6a26b422765ba3815 HTTP/1.1" 200 None 2026-03-11 17:13:58,600 - lava_callback - DEBUG - Processing node 69b19af6a26b422765ba3815: ltp-containers 2026-03-11 17:13:58,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:13:59,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:13:59,103 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69b19af6a26b422765ba3815/log.txt.gz 2026-03-11 17:13:59,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:13:59,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:13:59,614 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69b19af6a26b422765ba3815/lava-logs.yaml 2026-03-11 17:13:59,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:13:59,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:13:59,768 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69b19af6a26b422765ba3815/lava_callback.json.gz 2026-03-11 17:13:59,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:13:59,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19af6a26b422765ba3815 HTTP/1.1" 200 None 2026-03-11 17:13:59,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:13:59,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 17:13:59,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:13:59,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19af6a26b422765ba3815 HTTP/1.1" 200 None 2026-03-11 17:13:59,850 - lava_callback - INFO - Completed processing callback for node 69b19af6a26b422765ba3815 INFO: 172.19.0.1:36200 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:14:07,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:14:07,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54512 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:17:13,332 - lava_callback - INFO - Received callback for node 69b19af8a26b422765ba3818 INFO: 172.19.0.1:40482 - "POST /node/69b19af8a26b422765ba3818 HTTP/1.0" 202 Accepted 2026-03-11 17:17:13,339 - lava_callback - INFO - Starting async job submit for node 69b19af8a26b422765ba3818 2026-03-11 17:17:13,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:17:13,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19af8a26b422765ba3818 HTTP/1.1" 200 None 2026-03-11 17:17:13,415 - lava_callback - DEBUG - Processing node 69b19af8a26b422765ba3818: ltp-controllers 2026-03-11 17:17:13,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:17:14,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:17:14,105 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69b19af8a26b422765ba3818/log.txt.gz 2026-03-11 17:17:14,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:17:14,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:17:14,645 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69b19af8a26b422765ba3818/lava-logs.yaml 2026-03-11 17:17:14,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:17:14,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:17:14,825 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69b19af8a26b422765ba3818/lava_callback.json.gz 2026-03-11 17:17:14,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:17:14,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19af8a26b422765ba3818 HTTP/1.1" 200 None 2026-03-11 17:17:14,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:17:14,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 17:17:14,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:17:14,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19af8a26b422765ba3818 HTTP/1.1" 200 None 2026-03-11 17:17:14,917 - lava_callback - INFO - Completed processing callback for node 69b19af8a26b422765ba3818 INFO: 172.19.0.1:40490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58344 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:17:37,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:17:37,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:32806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33834 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:18:43,209 - lava_callback - INFO - Received callback for node 69b19ae3a26b422765ba37d9 INFO: 172.19.0.1:33848 - "POST /node/69b19ae3a26b422765ba37d9 HTTP/1.0" 202 Accepted 2026-03-11 17:18:43,257 - lava_callback - INFO - Starting async job submit for node 69b19ae3a26b422765ba37d9 2026-03-11 17:18:43,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:18:43,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ae3a26b422765ba37d9 HTTP/1.1" 200 None 2026-03-11 17:18:43,310 - lava_callback - DEBUG - Processing node 69b19ae3a26b422765ba37d9: baseline-arm-pengutronix 2026-03-11 17:18:43,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:18:43,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:18:43,603 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b19ae3a26b422765ba37d9/log.txt.gz 2026-03-11 17:18:43,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:18:43,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:18:43,850 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b19ae3a26b422765ba37d9/lava-logs.yaml 2026-03-11 17:18:43,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:18:43,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:18:43,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b19ae3a26b422765ba37d9/lava_callback.json.gz DEBUG: Setup failed for 69b19ae3a26b422765ba37d9. Transitting job node result: incomplete -> fail 2026-03-11 17:18:44,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:18:44,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19ae3a26b422765ba37d9 HTTP/1.1" 200 None 2026-03-11 17:18:44,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:18:44,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 17:18:44,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:18:44,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19ae3a26b422765ba37d9 HTTP/1.1" 200 None 2026-03-11 17:18:44,176 - lava_callback - INFO - Completed processing callback for node 69b19ae3a26b422765ba37d9 INFO: 172.19.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60724 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:19:07,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:19:07,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:43912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43922 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:19:23,929 - lava_callback - INFO - Received callback for node 69af0112ce46d8ec186ac5c1 INFO: 172.19.0.1:41596 - "POST /node/69af0112ce46d8ec186ac5c1 HTTP/1.0" 202 Accepted 2026-03-11 17:19:23,935 - lava_callback - INFO - Starting async job submit for node 69af0112ce46d8ec186ac5c1 2026-03-11 17:19:23,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:19:23,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af0112ce46d8ec186ac5c1 HTTP/1.1" 200 None 2026-03-11 17:19:23,950 - lava_callback - DEBUG - Processing node 69af0112ce46d8ec186ac5c1: baseline-arm64-baylibre 2026-03-11 17:19:23,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af0112ce46d8ec186ac5c1 2026-03-11 17:19:23,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:19:23,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af0112ce46d8ec186ac5c1 HTTP/1.1" 200 None 2026-03-11 17:19:23,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:19:23,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70a64e31b554803095c1a HTTP/1.1" 200 None 2026-03-11 17:19:23,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:19:24,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af0112ce46d8ec186ac5c1 HTTP/1.1" 200 None 2026-03-11 17:19:24,019 - lava_callback - ERROR - Error processing callback for node 69af0112ce46d8ec186ac5c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34346 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:21:20,886 - lava_callback - INFO - Received callback for node 69b1a415a26b422765ba3b82 INFO: 172.19.0.1:59946 - "POST /node/69b1a415a26b422765ba3b82 HTTP/1.0" 202 Accepted 2026-03-11 17:21:20,892 - lava_callback - INFO - Starting async job submit for node 69b1a415a26b422765ba3b82 2026-03-11 17:21:20,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:21:20,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a415a26b422765ba3b82 HTTP/1.1" 200 None 2026-03-11 17:21:20,930 - lava_callback - DEBUG - Processing node 69b1a415a26b422765ba3b82: baseline-arm-pengutronix 2026-03-11 17:21:21,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:21:21,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:21:21,258 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1a415a26b422765ba3b82/log.txt.gz 2026-03-11 17:21:21,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:21:21,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:21:21,563 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1a415a26b422765ba3b82/lava-logs.yaml 2026-03-11 17:21:21,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:21:21,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:21:21,747 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1a415a26b422765ba3b82/lava_callback.json.gz 2026-03-11 17:21:21,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:21:21,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a415a26b422765ba3b82 HTTP/1.1" 200 None 2026-03-11 17:21:21,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:21:21,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 17:21:21,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:21:21,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a415a26b422765ba3b82 HTTP/1.1" 200 None 2026-03-11 17:21:21,902 - lava_callback - INFO - Completed processing callback for node 69b1a415a26b422765ba3b82 2026-03-11 17:21:23,537 - lava_callback - INFO - Received callback for node 69af018cce46d8ec186ac5f9 INFO: 172.19.0.1:59952 - "POST /node/69af018cce46d8ec186ac5f9 HTTP/1.0" 202 Accepted 2026-03-11 17:21:23,543 - lava_callback - INFO - Starting async job submit for node 69af018cce46d8ec186ac5f9 2026-03-11 17:21:23,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:21:23,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af018cce46d8ec186ac5f9 HTTP/1.1" 200 None 2026-03-11 17:21:23,565 - lava_callback - DEBUG - Processing node 69af018cce46d8ec186ac5f9: baseline-arm64-baylibre 2026-03-11 17:21:23,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af018cce46d8ec186ac5f9 2026-03-11 17:21:23,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:21:23,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af018cce46d8ec186ac5f9 HTTP/1.1" 200 None 2026-03-11 17:21:23,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:21:23,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70a64e31b554803095c1a HTTP/1.1" 200 None 2026-03-11 17:21:23,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:21:23,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af018cce46d8ec186ac5f9 HTTP/1.1" 200 None 2026-03-11 17:21:23,654 - lava_callback - ERROR - Error processing callback for node 69af018cce46d8ec186ac5f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36852 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:21:37,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:21:37,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38060 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:22:03,528 - lava_callback - INFO - Received callback for node 69af01b3ce46d8ec186ac68b INFO: 172.19.0.1:43680 - "POST /node/69af01b3ce46d8ec186ac68b HTTP/1.0" 202 Accepted 2026-03-11 17:22:03,534 - lava_callback - INFO - Starting async job submit for node 69af01b3ce46d8ec186ac68b 2026-03-11 17:22:03,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:03,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01b3ce46d8ec186ac68b HTTP/1.1" 200 None 2026-03-11 17:22:03,550 - lava_callback - DEBUG - Processing node 69af01b3ce46d8ec186ac68b: baseline-arm64-baylibre 2026-03-11 17:22:03,550 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af01b3ce46d8ec186ac68b 2026-03-11 17:22:03,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:03,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01b3ce46d8ec186ac68b HTTP/1.1" 200 None 2026-03-11 17:22:03,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:03,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 17:22:03,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:03,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af01b3ce46d8ec186ac68b HTTP/1.1" 200 None 2026-03-11 17:22:03,657 - lava_callback - ERROR - Error processing callback for node 69af01b3ce46d8ec186ac68b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 17:22:04,183 - lava_callback - INFO - Received callback for node 69af01b5ce46d8ec186ac68e INFO: 172.19.0.1:43692 - "POST /node/69af01b5ce46d8ec186ac68e HTTP/1.0" 202 Accepted 2026-03-11 17:22:04,189 - lava_callback - INFO - Starting async job submit for node 69af01b5ce46d8ec186ac68e 2026-03-11 17:22:04,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:04,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01b5ce46d8ec186ac68e HTTP/1.1" 200 None 2026-03-11 17:22:04,205 - lava_callback - DEBUG - Processing node 69af01b5ce46d8ec186ac68e: baseline-arm64-baylibre 2026-03-11 17:22:04,205 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af01b5ce46d8ec186ac68e 2026-03-11 17:22:04,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:04,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01b5ce46d8ec186ac68e HTTP/1.1" 200 None 2026-03-11 17:22:04,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:04,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 17:22:04,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:04,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af01b5ce46d8ec186ac68e HTTP/1.1" 200 None 2026-03-11 17:22:04,273 - lava_callback - ERROR - Error processing callback for node 69af01b5ce46d8ec186ac68e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 17:22:04,853 - lava_callback - INFO - Received callback for node 69af01b6ce46d8ec186ac692 INFO: 172.19.0.1:43700 - "POST /node/69af01b6ce46d8ec186ac692 HTTP/1.0" 202 Accepted 2026-03-11 17:22:04,859 - lava_callback - INFO - Starting async job submit for node 69af01b6ce46d8ec186ac692 2026-03-11 17:22:04,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:04,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01b6ce46d8ec186ac692 HTTP/1.1" 200 None 2026-03-11 17:22:04,876 - lava_callback - DEBUG - Processing node 69af01b6ce46d8ec186ac692: baseline-arm64-baylibre 2026-03-11 17:22:04,876 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af01b6ce46d8ec186ac692 2026-03-11 17:22:04,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:04,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01b6ce46d8ec186ac692 HTTP/1.1" 200 None 2026-03-11 17:22:04,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:04,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 17:22:04,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:04,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af01b6ce46d8ec186ac692 HTTP/1.1" 200 None 2026-03-11 17:22:04,927 - lava_callback - ERROR - Error processing callback for node 69af01b6ce46d8ec186ac692: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 17:22:05,518 - lava_callback - INFO - Received callback for node 69af01b8ce46d8ec186ac69e INFO: 172.19.0.1:43714 - "POST /node/69af01b8ce46d8ec186ac69e HTTP/1.0" 202 Accepted 2026-03-11 17:22:05,523 - lava_callback - INFO - Starting async job submit for node 69af01b8ce46d8ec186ac69e 2026-03-11 17:22:05,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:05,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01b8ce46d8ec186ac69e HTTP/1.1" 200 None 2026-03-11 17:22:05,539 - lava_callback - DEBUG - Processing node 69af01b8ce46d8ec186ac69e: baseline-arm64-baylibre 2026-03-11 17:22:05,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af01b8ce46d8ec186ac69e 2026-03-11 17:22:05,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:05,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01b8ce46d8ec186ac69e HTTP/1.1" 200 None 2026-03-11 17:22:05,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:05,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 17:22:05,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:05,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af01b8ce46d8ec186ac69e HTTP/1.1" 200 None 2026-03-11 17:22:05,598 - lava_callback - ERROR - Error processing callback for node 69af01b8ce46d8ec186ac69e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38878 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:22:23,520 - lava_callback - INFO - Received callback for node 69af01bace46d8ec186ac6a5 INFO: 172.19.0.1:59416 - "POST /node/69af01bace46d8ec186ac6a5 HTTP/1.0" 202 Accepted 2026-03-11 17:22:23,526 - lava_callback - INFO - Starting async job submit for node 69af01bace46d8ec186ac6a5 2026-03-11 17:22:23,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:23,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01bace46d8ec186ac6a5 HTTP/1.1" 200 None 2026-03-11 17:22:23,542 - lava_callback - DEBUG - Processing node 69af01bace46d8ec186ac6a5: baseline-arm64-baylibre 2026-03-11 17:22:23,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af01bace46d8ec186ac6a5 2026-03-11 17:22:23,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:23,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01bace46d8ec186ac6a5 HTTP/1.1" 200 None 2026-03-11 17:22:23,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:23,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 17:22:23,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:23,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af01bace46d8ec186ac6a5 HTTP/1.1" 200 None 2026-03-11 17:22:23,602 - lava_callback - ERROR - Error processing callback for node 69af01bace46d8ec186ac6a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 17:22:24,263 - lava_callback - INFO - Received callback for node 69af01bcce46d8ec186ac6a8 INFO: 172.19.0.1:59426 - "POST /node/69af01bcce46d8ec186ac6a8 HTTP/1.0" 202 Accepted 2026-03-11 17:22:24,269 - lava_callback - INFO - Starting async job submit for node 69af01bcce46d8ec186ac6a8 2026-03-11 17:22:24,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:24,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01bcce46d8ec186ac6a8 HTTP/1.1" 200 None 2026-03-11 17:22:24,284 - lava_callback - DEBUG - Processing node 69af01bcce46d8ec186ac6a8: baseline-arm64-baylibre 2026-03-11 17:22:24,284 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af01bcce46d8ec186ac6a8 2026-03-11 17:22:24,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:24,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01bcce46d8ec186ac6a8 HTTP/1.1" 200 None 2026-03-11 17:22:24,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:24,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 17:22:24,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:24,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af01bcce46d8ec186ac6a8 HTTP/1.1" 200 None 2026-03-11 17:22:24,345 - lava_callback - ERROR - Error processing callback for node 69af01bcce46d8ec186ac6a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56302 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:22:43,263 - lava_callback - INFO - Received callback for node 69af01cdce46d8ec186ac6f1 INFO: 172.19.0.1:56310 - "POST /node/69af01cdce46d8ec186ac6f1 HTTP/1.0" 202 Accepted 2026-03-11 17:22:43,269 - lava_callback - INFO - Starting async job submit for node 69af01cdce46d8ec186ac6f1 2026-03-11 17:22:43,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:43,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01cdce46d8ec186ac6f1 HTTP/1.1" 200 None 2026-03-11 17:22:43,288 - lava_callback - DEBUG - Processing node 69af01cdce46d8ec186ac6f1: baseline-arm64-clabbe 2026-03-11 17:22:43,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af01cdce46d8ec186ac6f1 2026-03-11 17:22:43,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:43,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01cdce46d8ec186ac6f1 HTTP/1.1" 200 None 2026-03-11 17:22:43,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:43,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 17:22:43,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:43,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af01cdce46d8ec186ac6f1 HTTP/1.1" 200 None 2026-03-11 17:22:43,410 - lava_callback - ERROR - Error processing callback for node 69af01cdce46d8ec186ac6f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 17:22:43,555 - lava_callback - INFO - Received callback for node 69af01dace46d8ec186ac732 INFO: 172.19.0.1:56320 - "POST /node/69af01dace46d8ec186ac732 HTTP/1.0" 202 Accepted 2026-03-11 17:22:43,562 - lava_callback - INFO - Starting async job submit for node 69af01dace46d8ec186ac732 2026-03-11 17:22:43,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:43,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01dace46d8ec186ac732 HTTP/1.1" 200 None 2026-03-11 17:22:43,585 - lava_callback - DEBUG - Processing node 69af01dace46d8ec186ac732: baseline-arm64-baylibre 2026-03-11 17:22:43,585 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af01dace46d8ec186ac732 2026-03-11 17:22:43,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:43,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01dace46d8ec186ac732 HTTP/1.1" 200 None 2026-03-11 17:22:43,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:43,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-11 17:22:43,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:43,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af01dace46d8ec186ac732 HTTP/1.1" 200 None 2026-03-11 17:22:43,643 - lava_callback - ERROR - Error processing callback for node 69af01dace46d8ec186ac732: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 17:22:43,940 - lava_callback - INFO - Received callback for node 69af01cfce46d8ec186ac6f4 INFO: 172.19.0.1:56326 - "POST /node/69af01cfce46d8ec186ac6f4 HTTP/1.0" 202 Accepted 2026-03-11 17:22:43,946 - lava_callback - INFO - Starting async job submit for node 69af01cfce46d8ec186ac6f4 2026-03-11 17:22:43,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:43,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01cfce46d8ec186ac6f4 HTTP/1.1" 200 None 2026-03-11 17:22:43,963 - lava_callback - DEBUG - Processing node 69af01cfce46d8ec186ac6f4: baseline-arm64-clabbe 2026-03-11 17:22:43,963 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af01cfce46d8ec186ac6f4 2026-03-11 17:22:43,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:43,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01cfce46d8ec186ac6f4 HTTP/1.1" 200 None 2026-03-11 17:22:43,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:43,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 17:22:43,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:44,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af01cfce46d8ec186ac6f4 HTTP/1.1" 200 None 2026-03-11 17:22:44,025 - lava_callback - ERROR - Error processing callback for node 69af01cfce46d8ec186ac6f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 17:22:44,607 - lava_callback - INFO - Received callback for node 69af01d0ce46d8ec186ac6f7 INFO: 172.19.0.1:56332 - "POST /node/69af01d0ce46d8ec186ac6f7 HTTP/1.0" 202 Accepted 2026-03-11 17:22:44,612 - lava_callback - INFO - Starting async job submit for node 69af01d0ce46d8ec186ac6f7 2026-03-11 17:22:44,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:44,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01d0ce46d8ec186ac6f7 HTTP/1.1" 200 None 2026-03-11 17:22:44,629 - lava_callback - DEBUG - Processing node 69af01d0ce46d8ec186ac6f7: baseline-arm64-clabbe 2026-03-11 17:22:44,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af01d0ce46d8ec186ac6f7 2026-03-11 17:22:44,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:44,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01d0ce46d8ec186ac6f7 HTTP/1.1" 200 None 2026-03-11 17:22:44,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:44,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 17:22:44,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:44,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af01d0ce46d8ec186ac6f7 HTTP/1.1" 200 None 2026-03-11 17:22:44,686 - lava_callback - ERROR - Error processing callback for node 69af01d0ce46d8ec186ac6f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 17:22:45,284 - lava_callback - INFO - Received callback for node 69af01d0ce46d8ec186ac6fa INFO: 172.19.0.1:56338 - "POST /node/69af01d0ce46d8ec186ac6fa HTTP/1.0" 202 Accepted 2026-03-11 17:22:45,290 - lava_callback - INFO - Starting async job submit for node 69af01d0ce46d8ec186ac6fa 2026-03-11 17:22:45,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:45,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01d0ce46d8ec186ac6fa HTTP/1.1" 200 None 2026-03-11 17:22:45,307 - lava_callback - DEBUG - Processing node 69af01d0ce46d8ec186ac6fa: baseline-arm64-clabbe 2026-03-11 17:22:45,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af01d0ce46d8ec186ac6fa 2026-03-11 17:22:45,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:45,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01d0ce46d8ec186ac6fa HTTP/1.1" 200 None 2026-03-11 17:22:45,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:45,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 17:22:45,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:45,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af01d0ce46d8ec186ac6fa HTTP/1.1" 200 None 2026-03-11 17:22:45,382 - lava_callback - ERROR - Error processing callback for node 69af01d0ce46d8ec186ac6fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 17:22:45,944 - lava_callback - INFO - Received callback for node 69af01d3ce46d8ec186ac703 INFO: 172.19.0.1:56340 - "POST /node/69af01d3ce46d8ec186ac703 HTTP/1.0" 202 Accepted 2026-03-11 17:22:45,950 - lava_callback - INFO - Starting async job submit for node 69af01d3ce46d8ec186ac703 2026-03-11 17:22:45,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:45,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01d3ce46d8ec186ac703 HTTP/1.1" 200 None 2026-03-11 17:22:45,967 - lava_callback - DEBUG - Processing node 69af01d3ce46d8ec186ac703: baseline-arm64-clabbe 2026-03-11 17:22:45,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af01d3ce46d8ec186ac703 2026-03-11 17:22:45,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:45,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01d3ce46d8ec186ac703 HTTP/1.1" 200 None 2026-03-11 17:22:45,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:45,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 17:22:45,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:46,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af01d3ce46d8ec186ac703 HTTP/1.1" 200 None 2026-03-11 17:22:46,032 - lava_callback - ERROR - Error processing callback for node 69af01d3ce46d8ec186ac703: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56350 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:22:46,594 - lava_callback - INFO - Received callback for node 69af01d2ce46d8ec186ac700 INFO: 172.19.0.1:56362 - "POST /node/69af01d2ce46d8ec186ac700 HTTP/1.0" 202 Accepted 2026-03-11 17:22:46,600 - lava_callback - INFO - Starting async job submit for node 69af01d2ce46d8ec186ac700 2026-03-11 17:22:46,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:46,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01d2ce46d8ec186ac700 HTTP/1.1" 200 None 2026-03-11 17:22:46,626 - lava_callback - DEBUG - Processing node 69af01d2ce46d8ec186ac700: baseline-arm64-clabbe 2026-03-11 17:22:46,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af01d2ce46d8ec186ac700 2026-03-11 17:22:46,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:46,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af01d2ce46d8ec186ac700 HTTP/1.1" 200 None 2026-03-11 17:22:46,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:46,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 17:22:46,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:22:46,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af01d2ce46d8ec186ac700 HTTP/1.1" 200 None 2026-03-11 17:22:46,683 - lava_callback - ERROR - Error processing callback for node 69af01d2ce46d8ec186ac700: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38468 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:24:03,665 - lava_callback - INFO - Received callback for node 69af022bce46d8ec186ac779 INFO: 172.19.0.1:43214 - "POST /node/69af022bce46d8ec186ac779 HTTP/1.0" 202 Accepted 2026-03-11 17:24:03,671 - lava_callback - INFO - Starting async job submit for node 69af022bce46d8ec186ac779 2026-03-11 17:24:03,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:24:03,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af022bce46d8ec186ac779 HTTP/1.1" 200 None 2026-03-11 17:24:03,687 - lava_callback - DEBUG - Processing node 69af022bce46d8ec186ac779: baseline-arm64-baylibre 2026-03-11 17:24:03,687 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af022bce46d8ec186ac779 2026-03-11 17:24:03,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:24:03,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af022bce46d8ec186ac779 HTTP/1.1" 200 None 2026-03-11 17:24:03,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:24:03,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-11 17:24:03,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:24:03,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af022bce46d8ec186ac779 HTTP/1.1" 200 None 2026-03-11 17:24:03,745 - lava_callback - ERROR - Error processing callback for node 69af022bce46d8ec186ac779: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47512 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:27:03,847 - lava_callback - INFO - Received callback for node 69af02e4ce46d8ec186ac7f6 INFO: 172.19.0.1:43640 - "POST /node/69af02e4ce46d8ec186ac7f6 HTTP/1.0" 202 Accepted 2026-03-11 17:27:03,853 - lava_callback - INFO - Starting async job submit for node 69af02e4ce46d8ec186ac7f6 2026-03-11 17:27:03,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:27:03,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af02e4ce46d8ec186ac7f6 HTTP/1.1" 200 None 2026-03-11 17:27:03,872 - lava_callback - DEBUG - Processing node 69af02e4ce46d8ec186ac7f6: baseline-arm64-baylibre 2026-03-11 17:27:03,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af02e4ce46d8ec186ac7f6 2026-03-11 17:27:03,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:27:03,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af02e4ce46d8ec186ac7f6 HTTP/1.1" 200 None 2026-03-11 17:27:03,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:27:03,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-11 17:27:03,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:27:03,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af02e4ce46d8ec186ac7f6 HTTP/1.1" 200 None 2026-03-11 17:27:03,923 - lava_callback - ERROR - Error processing callback for node 69af02e4ce46d8ec186ac7f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58920 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:28:48,080 - lava_callback - INFO - Received callback for node 69b1a254a26b422765ba3b29 INFO: 172.19.0.1:58936 - "POST /node/69b1a254a26b422765ba3b29 HTTP/1.0" 202 Accepted 2026-03-11 17:28:48,087 - lava_callback - INFO - Starting async job submit for node 69b1a254a26b422765ba3b29 2026-03-11 17:28:48,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:28:48,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a254a26b422765ba3b29 HTTP/1.1" 200 None 2026-03-11 17:28:48,156 - lava_callback - DEBUG - Processing node 69b1a254a26b422765ba3b29: baseline-arm 2026-03-11 17:28:48,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:28:48,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:28:48,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b1a254a26b422765ba3b29/log.txt.gz 2026-03-11 17:28:49,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:28:49,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:28:49,549 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b1a254a26b422765ba3b29/lava-logs.yaml 2026-03-11 17:28:49,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:28:49,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:28:49,712 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b1a254a26b422765ba3b29/lava_callback.json.gz DEBUG: Setup failed for 69b1a254a26b422765ba3b29. Transitting job node result: incomplete -> fail 2026-03-11 17:28:49,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:28:49,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a254a26b422765ba3b29 HTTP/1.1" 200 None 2026-03-11 17:28:49,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:28:49,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 17:28:49,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:28:49,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a254a26b422765ba3b29 HTTP/1.1" 200 None 2026-03-11 17:28:50,017 - lava_callback - INFO - Completed processing callback for node 69b1a254a26b422765ba3b29 INFO: 172.19.0.1:53052 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:29:03,933 - lava_callback - INFO - Received callback for node 69af035ace46d8ec186ac834 INFO: 172.19.0.1:34468 - "POST /node/69af035ace46d8ec186ac834 HTTP/1.0" 202 Accepted 2026-03-11 17:29:03,938 - lava_callback - INFO - Starting async job submit for node 69af035ace46d8ec186ac834 2026-03-11 17:29:03,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:29:03,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af035ace46d8ec186ac834 HTTP/1.1" 200 None 2026-03-11 17:29:03,966 - lava_callback - DEBUG - Processing node 69af035ace46d8ec186ac834: baseline-arm64-baylibre 2026-03-11 17:29:03,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af035ace46d8ec186ac834 2026-03-11 17:29:03,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:29:03,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af035ace46d8ec186ac834 HTTP/1.1" 200 None 2026-03-11 17:29:03,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:29:04,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-11 17:29:04,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:29:04,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af035ace46d8ec186ac834 HTTP/1.1" 200 None 2026-03-11 17:29:04,048 - lava_callback - ERROR - Error processing callback for node 69af035ace46d8ec186ac834: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34472 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:29:07,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:29:07,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:51912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60550 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:30:43,559 - lava_callback - INFO - Received callback for node 69af03b1ce46d8ec186ac853 INFO: 172.19.0.1:60562 - "POST /node/69af03b1ce46d8ec186ac853 HTTP/1.0" 202 Accepted 2026-03-11 17:30:43,568 - lava_callback - INFO - Starting async job submit for node 69af03b1ce46d8ec186ac853 2026-03-11 17:30:43,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:30:43,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af03b1ce46d8ec186ac853 HTTP/1.1" 200 None 2026-03-11 17:30:43,589 - lava_callback - DEBUG - Processing node 69af03b1ce46d8ec186ac853: baseline-arm64-clabbe 2026-03-11 17:30:43,589 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af03b1ce46d8ec186ac853 2026-03-11 17:30:43,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:30:43,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af03b1ce46d8ec186ac853 HTTP/1.1" 200 None 2026-03-11 17:30:43,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:30:43,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-11 17:30:43,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:30:43,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af03b1ce46d8ec186ac853 HTTP/1.1" 200 None 2026-03-11 17:30:43,656 - lava_callback - ERROR - Error processing callback for node 69af03b1ce46d8ec186ac853: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55940 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:43:23,470 - lava_callback - INFO - Received callback for node 69b1a52ea26b422765ba3bc9 INFO: 172.19.0.1:33932 - "POST /node/69b1a52ea26b422765ba3bc9 HTTP/1.0" 202 Accepted 2026-03-11 17:43:23,517 - lava_callback - INFO - Starting async job submit for node 69b1a52ea26b422765ba3bc9 2026-03-11 17:43:23,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:43:23,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a52ea26b422765ba3bc9 HTTP/1.1" 200 None 2026-03-11 17:43:23,557 - lava_callback - DEBUG - Processing node 69b1a52ea26b422765ba3bc9: baseline-arm-pengutronix 2026-03-11 17:43:23,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:33934 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:43:27,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:43:27,823 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1a52ea26b422765ba3bc9/log.txt.gz 2026-03-11 17:43:27,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:43:28,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:43:28,188 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1a52ea26b422765ba3bc9/lava-logs.yaml 2026-03-11 17:43:28,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:43:28,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:43:28,321 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1a52ea26b422765ba3bc9/lava_callback.json.gz DEBUG: Setup failed for 69b1a52ea26b422765ba3bc9. Transitting job node result: incomplete -> fail 2026-03-11 17:43:28,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:43:28,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1a52ea26b422765ba3bc9 HTTP/1.1" 200 None 2026-03-11 17:43:28,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:43:28,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 17:43:28,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:43:28,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1a52ea26b422765ba3bc9 HTTP/1.1" 200 None 2026-03-11 17:43:28,490 - lava_callback - INFO - Completed processing callback for node 69b1a52ea26b422765ba3bc9 INFO: 172.19.0.1:47162 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:43:37,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:43:37,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46690 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:58:34,480 - lava_callback - INFO - Received callback for node 69b19afaa26b422765ba381b INFO: 172.19.0.1:44670 - "POST /node/69b19afaa26b422765ba381b HTTP/1.0" 202 Accepted 2026-03-11 17:58:34,486 - lava_callback - INFO - Starting async job submit for node 69b19afaa26b422765ba381b 2026-03-11 17:58:34,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:58:34,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19afaa26b422765ba381b HTTP/1.1" 200 None 2026-03-11 17:58:34,549 - lava_callback - DEBUG - Processing node 69b19afaa26b422765ba381b: ltp-cve 2026-03-11 17:58:34,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:58:35,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:58:35,099 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69b19afaa26b422765ba381b/log.txt.gz 2026-03-11 17:58:35,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:58:35,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:58:35,534 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69b19afaa26b422765ba381b/lava-logs.yaml 2026-03-11 17:58:35,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:58:35,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:58:35,731 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69b19afaa26b422765ba381b/lava_callback.json.gz 2026-03-11 17:58:35,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:58:35,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19afaa26b422765ba381b HTTP/1.1" 200 None 2026-03-11 17:58:35,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:58:35,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 17:58:35,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:58:35,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19afaa26b422765ba381b HTTP/1.1" 200 None 2026-03-11 17:58:35,829 - lava_callback - INFO - Completed processing callback for node 69b19afaa26b422765ba381b INFO: 172.19.0.1:44676 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:58:37,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:58:37,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:36304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47488 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:59:00,455 - lava_callback - INFO - Received callback for node 69b19b00a26b422765ba3821 INFO: 172.19.0.1:37194 - "POST /node/69b19b00a26b422765ba3821 HTTP/1.0" 202 Accepted 2026-03-11 17:59:00,462 - lava_callback - INFO - Starting async job submit for node 69b19b00a26b422765ba3821 2026-03-11 17:59:00,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:59:00,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b00a26b422765ba3821 HTTP/1.1" 200 None 2026-03-11 17:59:00,503 - lava_callback - DEBUG - Processing node 69b19b00a26b422765ba3821: ltp-fs_bind 2026-03-11 17:59:00,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:59:01,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:59:01,014 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b19b00a26b422765ba3821/log.txt.gz 2026-03-11 17:59:01,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:59:01,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:59:01,446 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b19b00a26b422765ba3821/lava-logs.yaml 2026-03-11 17:59:01,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 17:59:01,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 17:59:01,619 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b19b00a26b422765ba3821/lava_callback.json.gz 2026-03-11 17:59:01,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:59:01,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b00a26b422765ba3821 HTTP/1.1" 200 None 2026-03-11 17:59:01,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:59:01,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 17:59:01,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:59:01,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19b00a26b422765ba3821 HTTP/1.1" 200 None 2026-03-11 17:59:01,768 - lava_callback - INFO - Completed processing callback for node 69b19b00a26b422765ba3821 INFO: 172.19.0.1:37198 - "GET / HTTP/1.0" 200 OK 2026-03-11 17:59:07,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 17:59:07,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:51348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48502 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:01:14,861 - lava_callback - INFO - Received callback for node 69b1aa27a26b422765ba3c63 INFO: 172.19.0.1:58266 - "POST /node/69b1aa27a26b422765ba3c63 HTTP/1.0" 202 Accepted 2026-03-11 18:01:14,868 - lava_callback - INFO - Starting async job submit for node 69b1aa27a26b422765ba3c63 2026-03-11 18:01:14,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:01:14,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1aa27a26b422765ba3c63 HTTP/1.1" 200 None 2026-03-11 18:01:14,937 - lava_callback - DEBUG - Processing node 69b1aa27a26b422765ba3c63: baseline-arm INFO: 172.19.0.1:58280 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 18:01:15,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:01:15,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:01:15,679 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b1aa27a26b422765ba3c63/log.txt.gz 2026-03-11 18:01:16,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:01:16,291 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:01:16,293 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b1aa27a26b422765ba3c63/lava-logs.yaml 2026-03-11 18:01:16,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:01:16,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:01:16,505 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b1aa27a26b422765ba3c63/lava_callback.json.gz INFO: 172.19.0.1:58284 - "GET / HTTP/1.0" 200 OK DEBUG: Setup failed for 69b1aa27a26b422765ba3c63. Transitting job node result: incomplete -> fail 2026-03-11 18:01:16,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:01:16,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1aa27a26b422765ba3c63 HTTP/1.1" 200 None 2026-03-11 18:01:16,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:01:16,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 18:01:16,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:01:16,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1aa27a26b422765ba3c63 HTTP/1.1" 200 None 2026-03-11 18:01:16,820 - lava_callback - INFO - Completed processing callback for node 69b1aa27a26b422765ba3c63 INFO: 172.19.0.1:46950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60856 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:01:37,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:01:37,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58550 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:02:34,294 - lava_callback - INFO - Received callback for node 69b19b04a26b422765ba383b INFO: 172.19.0.1:55846 - "POST /node/69b19b04a26b422765ba383b HTTP/1.0" 202 Accepted 2026-03-11 18:02:34,301 - lava_callback - INFO - Starting async job submit for node 69b19b04a26b422765ba383b 2026-03-11 18:02:34,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:02:34,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b04a26b422765ba383b HTTP/1.1" 200 None 2026-03-11 18:02:34,341 - lava_callback - DEBUG - Processing node 69b19b04a26b422765ba383b: ltp-input 2026-03-11 18:02:34,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:02:34,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:02:34,825 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69b19b04a26b422765ba383b/log.txt.gz 2026-03-11 18:02:35,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:02:35,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:02:35,302 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69b19b04a26b422765ba383b/lava-logs.yaml 2026-03-11 18:02:35,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:02:35,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:02:35,500 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69b19b04a26b422765ba383b/lava_callback.json.gz 2026-03-11 18:02:35,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:02:35,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b04a26b422765ba383b HTTP/1.1" 200 None 2026-03-11 18:02:35,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:02:35,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 18:02:35,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:02:35,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19b04a26b422765ba383b HTTP/1.1" 200 None 2026-03-11 18:02:35,596 - lava_callback - INFO - Completed processing callback for node 69b19b04a26b422765ba383b INFO: 172.19.0.1:55858 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:02:37,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:02:37,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:50366 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:02:40,639 - lava_callback - INFO - Received callback for node 69b19b02a26b422765ba3824 INFO: 172.19.0.1:50368 - "POST /node/69b19b02a26b422765ba3824 HTTP/1.0" 202 Accepted 2026-03-11 18:02:40,645 - lava_callback - INFO - Starting async job submit for node 69b19b02a26b422765ba3824 2026-03-11 18:02:40,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:02:40,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b02a26b422765ba3824 HTTP/1.1" 200 None 2026-03-11 18:02:40,689 - lava_callback - DEBUG - Processing node 69b19b02a26b422765ba3824: ltp-fsx 2026-03-11 18:02:41,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:02:41,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:02:41,149 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69b19b02a26b422765ba3824/log.txt.gz 2026-03-11 18:02:41,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:02:41,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:02:41,543 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69b19b02a26b422765ba3824/lava-logs.yaml 2026-03-11 18:02:41,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:02:41,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:02:41,706 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69b19b02a26b422765ba3824/lava_callback.json.gz 2026-03-11 18:02:41,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:02:41,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b02a26b422765ba3824 HTTP/1.1" 200 None 2026-03-11 18:02:41,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:02:41,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 18:02:41,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:02:41,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19b02a26b422765ba3824 HTTP/1.1" 200 None 2026-03-11 18:02:41,812 - lava_callback - INFO - Completed processing callback for node 69b19b02a26b422765ba3824 INFO: 172.19.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35600 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:03:00,139 - lava_callback - INFO - Received callback for node 69b19b06a26b422765ba3841 INFO: 172.19.0.1:43562 - "POST /node/69b19b06a26b422765ba3841 HTTP/1.0" 202 Accepted 2026-03-11 18:03:00,146 - lava_callback - INFO - Starting async job submit for node 69b19b06a26b422765ba3841 2026-03-11 18:03:00,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:03:00,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b06a26b422765ba3841 HTTP/1.1" 200 None 2026-03-11 18:03:00,186 - lava_callback - DEBUG - Processing node 69b19b06a26b422765ba3841: ltp-ipc 2026-03-11 18:03:00,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:03:00,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:03:00,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69b19b06a26b422765ba3841/log.txt.gz 2026-03-11 18:03:00,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:03:01,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:03:01,123 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69b19b06a26b422765ba3841/lava-logs.yaml 2026-03-11 18:03:01,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:03:01,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:03:01,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69b19b06a26b422765ba3841/lava_callback.json.gz 2026-03-11 18:03:01,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:03:01,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b06a26b422765ba3841 HTTP/1.1" 200 None 2026-03-11 18:03:01,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:03:01,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 18:03:01,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:03:01,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19b06a26b422765ba3841 HTTP/1.1" 200 None 2026-03-11 18:03:01,404 - lava_callback - INFO - Completed processing callback for node 69b19b06a26b422765ba3841 INFO: 172.19.0.1:43566 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:03:07,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:03:07,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50000 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:04:00,060 - lava_callback - INFO - Received callback for node 69b19b07a26b422765ba3848 INFO: 172.19.0.1:37684 - "POST /node/69b19b07a26b422765ba3848 HTTP/1.0" 202 Accepted 2026-03-11 18:04:00,067 - lava_callback - INFO - Starting async job submit for node 69b19b07a26b422765ba3848 2026-03-11 18:04:00,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:04:00,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b07a26b422765ba3848 HTTP/1.1" 200 None 2026-03-11 18:04:00,114 - lava_callback - DEBUG - Processing node 69b19b07a26b422765ba3848: ltp-pty 2026-03-11 18:04:00,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:04:00,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:04:00,649 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69b19b07a26b422765ba3848/log.txt.gz 2026-03-11 18:04:00,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:04:01,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:04:01,114 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69b19b07a26b422765ba3848/lava-logs.yaml 2026-03-11 18:04:01,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:04:01,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:04:01,301 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69b19b07a26b422765ba3848/lava_callback.json.gz 2026-03-11 18:04:01,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:04:01,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b07a26b422765ba3848 HTTP/1.1" 200 None 2026-03-11 18:04:01,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:04:01,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 18:04:01,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:04:01,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19b07a26b422765ba3848 HTTP/1.1" 200 None 2026-03-11 18:04:01,430 - lava_callback - INFO - Completed processing callback for node 69b19b07a26b422765ba3848 2026-03-11 18:04:05,890 - lava_callback - INFO - Received callback for node 69af0b84ce46d8ec186aca00 INFO: 172.19.0.1:37700 - "POST /node/69af0b84ce46d8ec186aca00 HTTP/1.0" 202 Accepted 2026-03-11 18:04:05,895 - lava_callback - INFO - Starting async job submit for node 69af0b84ce46d8ec186aca00 2026-03-11 18:04:05,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:04:05,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af0b84ce46d8ec186aca00 HTTP/1.1" 200 None 2026-03-11 18:04:05,912 - lava_callback - DEBUG - Processing node 69af0b84ce46d8ec186aca00: baseline-arm64-baylibre 2026-03-11 18:04:05,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af0b84ce46d8ec186aca00 2026-03-11 18:04:05,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:04:05,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af0b84ce46d8ec186aca00 HTTP/1.1" 200 None 2026-03-11 18:04:05,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:04:05,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70a64e31b554803095c1a HTTP/1.1" 200 None 2026-03-11 18:04:05,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:04:05,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af0b84ce46d8ec186aca00 HTTP/1.1" 200 None 2026-03-11 18:04:05,972 - lava_callback - ERROR - Error processing callback for node 69af0b84ce46d8ec186aca00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37702 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:04:07,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:04:07,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:52048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58824 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:06:34,682 - lava_callback - INFO - Received callback for node 69b19b0aa26b422765ba384f INFO: 172.19.0.1:60600 - "POST /node/69b19b0aa26b422765ba384f HTTP/1.0" 202 Accepted 2026-03-11 18:06:34,689 - lava_callback - INFO - Starting async job submit for node 69b19b0aa26b422765ba384f 2026-03-11 18:06:34,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:06:34,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b0aa26b422765ba384f HTTP/1.1" 200 None 2026-03-11 18:06:34,731 - lava_callback - DEBUG - Processing node 69b19b0aa26b422765ba384f: ltp-smoke 2026-03-11 18:06:35,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:06:35,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:06:35,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b19b0aa26b422765ba384f/log.txt.gz 2026-03-11 18:06:35,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:06:35,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:06:35,739 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b19b0aa26b422765ba384f/lava-logs.yaml 2026-03-11 18:06:35,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:06:35,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:06:35,913 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b19b0aa26b422765ba384f/lava_callback.json.gz 2026-03-11 18:06:35,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:06:35,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b0aa26b422765ba384f HTTP/1.1" 200 None 2026-03-11 18:06:35,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:06:35,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 18:06:35,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:06:36,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19b0aa26b422765ba384f HTTP/1.1" 200 None 2026-03-11 18:06:36,016 - lava_callback - INFO - Completed processing callback for node 69b19b0aa26b422765ba384f INFO: 172.19.0.1:60606 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:06:37,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:06:37,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 18:06:40,141 - lava_callback - INFO - Received callback for node 69b19b09a26b422765ba384b INFO: 172.19.0.1:46138 - "POST /node/69b19b09a26b422765ba384b HTTP/1.0" 202 Accepted 2026-03-11 18:06:40,147 - lava_callback - INFO - Starting async job submit for node 69b19b09a26b422765ba384b 2026-03-11 18:06:40,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:06:40,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b09a26b422765ba384b HTTP/1.1" 200 None 2026-03-11 18:06:40,205 - lava_callback - DEBUG - Processing node 69b19b09a26b422765ba384b: ltp-sched 2026-03-11 18:06:40,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:46140 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:06:40,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:06:40,671 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69b19b09a26b422765ba384b/log.txt.gz 2026-03-11 18:06:40,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:06:41,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:06:41,075 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69b19b09a26b422765ba384b/lava-logs.yaml 2026-03-11 18:06:41,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:06:41,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:06:41,231 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69b19b09a26b422765ba384b/lava_callback.json.gz 2026-03-11 18:06:41,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:06:41,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b09a26b422765ba384b HTTP/1.1" 200 None 2026-03-11 18:06:41,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:06:41,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 18:06:41,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:06:41,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19b09a26b422765ba384b HTTP/1.1" 200 None 2026-03-11 18:06:41,336 - lava_callback - INFO - Completed processing callback for node 69b19b09a26b422765ba384b INFO: 172.19.0.1:46150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47340 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:07:00,362 - lava_callback - INFO - Received callback for node 69b19b0da26b422765ba3855 INFO: 172.19.0.1:60332 - "POST /node/69b19b0da26b422765ba3855 HTTP/1.0" 202 Accepted 2026-03-11 18:07:00,368 - lava_callback - INFO - Starting async job submit for node 69b19b0da26b422765ba3855 2026-03-11 18:07:00,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:07:00,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b0da26b422765ba3855 HTTP/1.1" 200 None 2026-03-11 18:07:00,408 - lava_callback - DEBUG - Processing node 69b19b0da26b422765ba3855: ltp-syscalls-ipc 2026-03-11 18:07:00,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:07:00,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:07:00,879 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b19b0da26b422765ba3855/log.txt.gz 2026-03-11 18:07:01,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:07:01,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:07:01,321 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b19b0da26b422765ba3855/lava-logs.yaml 2026-03-11 18:07:01,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:07:01,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:07:01,491 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b19b0da26b422765ba3855/lava_callback.json.gz 2026-03-11 18:07:01,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:07:01,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b0da26b422765ba3855 HTTP/1.1" 200 None 2026-03-11 18:07:01,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:07:01,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 18:07:01,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:07:01,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19b0da26b422765ba3855 HTTP/1.1" 200 None 2026-03-11 18:07:01,585 - lava_callback - INFO - Completed processing callback for node 69b19b0da26b422765ba3855 INFO: 172.19.0.1:60338 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:07:07,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:07:07,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:45708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44702 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:08:20,513 - lava_callback - INFO - Received callback for node 69b19b10a26b422765ba385c INFO: 172.19.0.1:45422 - "POST /node/69b19b10a26b422765ba385c HTTP/1.0" 202 Accepted 2026-03-11 18:08:20,519 - lava_callback - INFO - Starting async job submit for node 69b19b10a26b422765ba385c 2026-03-11 18:08:20,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:08:20,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b10a26b422765ba385c HTTP/1.1" 200 None 2026-03-11 18:08:20,559 - lava_callback - DEBUG - Processing node 69b19b10a26b422765ba385c: ltp-timers 2026-03-11 18:08:20,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:08:21,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:08:21,066 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69b19b10a26b422765ba385c/log.txt.gz 2026-03-11 18:08:21,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:08:21,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:08:21,491 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69b19b10a26b422765ba385c/lava-logs.yaml 2026-03-11 18:08:21,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:08:21,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:08:21,667 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69b19b10a26b422765ba385c/lava_callback.json.gz 2026-03-11 18:08:21,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:08:21,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b10a26b422765ba385c HTTP/1.1" 200 None 2026-03-11 18:08:21,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:08:21,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 18:08:21,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:08:21,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19b10a26b422765ba385c HTTP/1.1" 200 None 2026-03-11 18:08:21,752 - lava_callback - INFO - Completed processing callback for node 69b19b10a26b422765ba385c 2026-03-11 18:08:24,145 - lava_callback - INFO - Received callback for node 69b1ab02a26b422765ba3c7e INFO: 172.19.0.1:45438 - "POST /node/69b1ab02a26b422765ba3c7e HTTP/1.0" 202 Accepted 2026-03-11 18:08:24,193 - lava_callback - INFO - Starting async job submit for node 69b1ab02a26b422765ba3c7e 2026-03-11 18:08:24,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:08:24,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ab02a26b422765ba3c7e HTTP/1.1" 200 None 2026-03-11 18:08:24,233 - lava_callback - DEBUG - Processing node 69b1ab02a26b422765ba3c7e: baseline-arm-pengutronix 2026-03-11 18:08:24,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:08:24,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:08:24,474 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1ab02a26b422765ba3c7e/log.txt.gz 2026-03-11 18:08:24,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:08:24,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:08:24,706 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1ab02a26b422765ba3c7e/lava-logs.yaml 2026-03-11 18:08:24,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:08:24,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:08:24,829 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1ab02a26b422765ba3c7e/lava_callback.json.gz DEBUG: Setup failed for 69b1ab02a26b422765ba3c7e. Transitting job node result: incomplete -> fail 2026-03-11 18:08:24,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:08:24,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ab02a26b422765ba3c7e HTTP/1.1" 200 None 2026-03-11 18:08:24,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:08:24,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 18:08:24,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:08:24,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ab02a26b422765ba3c7e HTTP/1.1" 200 None 2026-03-11 18:08:25,002 - lava_callback - INFO - Completed processing callback for node 69b1ab02a26b422765ba3c7e INFO: 172.19.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47288 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:08:37,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:08:37,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54730 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:10:40,656 - lava_callback - INFO - Received callback for node 69b19b12a26b422765ba385f INFO: 172.19.0.1:54732 - "POST /node/69b19b12a26b422765ba385f HTTP/1.0" 202 Accepted 2026-03-11 18:10:40,663 - lava_callback - INFO - Starting async job submit for node 69b19b12a26b422765ba385f 2026-03-11 18:10:40,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:10:40,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b12a26b422765ba385f HTTP/1.1" 200 None 2026-03-11 18:10:40,720 - lava_callback - DEBUG - Processing node 69b19b12a26b422765ba385f: ltp-watchqueue 2026-03-11 18:10:41,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:10:41,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:10:41,223 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b19b12a26b422765ba385f/log.txt.gz 2026-03-11 18:10:41,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:10:41,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:10:41,727 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b19b12a26b422765ba385f/lava-logs.yaml 2026-03-11 18:10:41,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:10:41,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:10:41,926 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b19b12a26b422765ba385f/lava_callback.json.gz 2026-03-11 18:10:41,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:10:41,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19b12a26b422765ba385f HTTP/1.1" 200 None 2026-03-11 18:10:41,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:10:41,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 18:10:41,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:10:42,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b19b12a26b422765ba385f HTTP/1.1" 200 None 2026-03-11 18:10:42,040 - lava_callback - INFO - Completed processing callback for node 69b19b12a26b422765ba385f INFO: 172.19.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34826 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:11:07,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:11:07,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50944 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:15:37,894 - lava_callback - INFO - Received callback for node 69b1adeda26b422765ba3c9c INFO: 172.19.0.1:50956 - "POST /node/69b1adeda26b422765ba3c9c HTTP/1.0" 202 Accepted 2026-03-11 18:15:37,900 - lava_callback - INFO - Starting async job submit for node 69b1adeda26b422765ba3c9c 2026-03-11 18:15:37,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:15:37,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1adeda26b422765ba3c9c HTTP/1.1" 200 None 2026-03-11 18:15:37,992 - lava_callback - DEBUG - Processing node 69b1adeda26b422765ba3c9c: baseline-arm 2026-03-11 18:15:38,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:15:38,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:15:38,614 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b1adeda26b422765ba3c9c/log.txt.gz 2026-03-11 18:15:38,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:15:39,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:15:39,146 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b1adeda26b422765ba3c9c/lava-logs.yaml 2026-03-11 18:15:39,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:15:39,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:15:39,331 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b1adeda26b422765ba3c9c/lava_callback.json.gz DEBUG: Setup failed for 69b1adeda26b422765ba3c9c. Transitting job node result: incomplete -> fail 2026-03-11 18:15:39,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:15:39,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1adeda26b422765ba3c9c HTTP/1.1" 200 None 2026-03-11 18:15:39,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:15:39,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 18:15:39,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:15:39,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1adeda26b422765ba3c9c HTTP/1.1" 200 None 2026-03-11 18:15:39,615 - lava_callback - INFO - Completed processing callback for node 69b1adeda26b422765ba3c9c INFO: 172.19.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60524 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:16:07,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:16:07,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:48042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37274 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:28:05,488 - lava_callback - INFO - Received callback for node 69b1afa6a26b422765ba3cf1 INFO: 172.19.0.1:39854 - "POST /node/69b1afa6a26b422765ba3cf1 HTTP/1.0" 202 Accepted 2026-03-11 18:28:05,540 - lava_callback - INFO - Starting async job submit for node 69b1afa6a26b422765ba3cf1 2026-03-11 18:28:05,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:28:05,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1afa6a26b422765ba3cf1 HTTP/1.1" 200 None 2026-03-11 18:28:05,621 - lava_callback - DEBUG - Processing node 69b1afa6a26b422765ba3cf1: baseline-arm-pengutronix 2026-03-11 18:28:05,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:28:05,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:28:05,907 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1afa6a26b422765ba3cf1/log.txt.gz 2026-03-11 18:28:05,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 18:28:06,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:28:06,420 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1afa6a26b422765ba3cf1/lava-logs.yaml 2026-03-11 18:28:06,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:39860 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:28:06,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 18:28:06,565 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1afa6a26b422765ba3cf1/lava_callback.json.gz DEBUG: Setup failed for 69b1afa6a26b422765ba3cf1. Transitting job node result: incomplete -> fail 2026-03-11 18:28:06,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:28:06,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1afa6a26b422765ba3cf1 HTTP/1.1" 200 None 2026-03-11 18:28:06,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:28:06,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195f7a26b422765ba3705 HTTP/1.1" 200 None 2026-03-11 18:28:06,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:28:06,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1afa6a26b422765ba3cf1 HTTP/1.1" 200 None 2026-03-11 18:28:06,765 - lava_callback - INFO - Completed processing callback for node 69b1afa6a26b422765ba3cf1 2026-03-11 18:28:07,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:28:07,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:36930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37010 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:38:07,651 - lava_callback - INFO - Received callback for node 69af1382ce46d8ec186acb8e INFO: 172.19.0.1:37012 - "POST /node/69af1382ce46d8ec186acb8e HTTP/1.0" 202 Accepted 2026-03-11 18:38:07,657 - lava_callback - INFO - Starting async job submit for node 69af1382ce46d8ec186acb8e 2026-03-11 18:38:07,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:38:07,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af1382ce46d8ec186acb8e HTTP/1.1" 200 None 2026-03-11 18:38:07,692 - lava_callback - DEBUG - Processing node 69af1382ce46d8ec186acb8e: baseline-arm-baylibre 2026-03-11 18:38:07,692 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af1382ce46d8ec186acb8e 2026-03-11 18:38:07,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:38:07,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af1382ce46d8ec186acb8e HTTP/1.1" 200 None 2026-03-11 18:38:07,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:38:07,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70f87e31b554803095edb HTTP/1.1" 200 None 2026-03-11 18:38:07,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:38:07,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af1382ce46d8ec186acb8e HTTP/1.1" 200 None 2026-03-11 18:38:07,781 - lava_callback - ERROR - Error processing callback for node 69af1382ce46d8ec186acb8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45046 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:38:47,566 - lava_callback - INFO - Received callback for node 69af13aace46d8ec186acb9b INFO: 172.19.0.1:45052 - "POST /node/69af13aace46d8ec186acb9b HTTP/1.0" 202 Accepted 2026-03-11 18:38:47,572 - lava_callback - INFO - Starting async job submit for node 69af13aace46d8ec186acb9b 2026-03-11 18:38:47,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:38:47,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af13aace46d8ec186acb9b HTTP/1.1" 200 None 2026-03-11 18:38:47,596 - lava_callback - DEBUG - Processing node 69af13aace46d8ec186acb9b: baseline-arm-baylibre 2026-03-11 18:38:47,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af13aace46d8ec186acb9b 2026-03-11 18:38:47,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:38:47,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af13aace46d8ec186acb9b HTTP/1.1" 200 None 2026-03-11 18:38:47,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:38:47,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70f87e31b554803095edb HTTP/1.1" 200 None 2026-03-11 18:38:47,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:38:47,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af13aace46d8ec186acb9b HTTP/1.1" 200 None 2026-03-11 18:38:47,720 - lava_callback - ERROR - Error processing callback for node 69af13aace46d8ec186acb9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54642 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:40:47,718 - lava_callback - INFO - Received callback for node 69af1420ce46d8ec186acbbc INFO: 172.19.0.1:54654 - "POST /node/69af1420ce46d8ec186acbbc HTTP/1.0" 202 Accepted 2026-03-11 18:40:47,723 - lava_callback - INFO - Starting async job submit for node 69af1420ce46d8ec186acbbc 2026-03-11 18:40:47,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:40:47,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af1420ce46d8ec186acbbc HTTP/1.1" 200 None 2026-03-11 18:40:47,741 - lava_callback - DEBUG - Processing node 69af1420ce46d8ec186acbbc: baseline-arm-baylibre 2026-03-11 18:40:47,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af1420ce46d8ec186acbbc 2026-03-11 18:40:47,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:40:47,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af1420ce46d8ec186acbbc HTTP/1.1" 200 None 2026-03-11 18:40:47,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:40:47,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70f87e31b554803095edb HTTP/1.1" 200 None 2026-03-11 18:40:47,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:40:47,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af1420ce46d8ec186acbbc HTTP/1.1" 200 None 2026-03-11 18:40:47,802 - lava_callback - ERROR - Error processing callback for node 69af1420ce46d8ec186acbbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60850 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:41:27,717 - lava_callback - INFO - Received callback for node 69af1447ce46d8ec186acbc6 INFO: 172.19.0.1:60860 - "POST /node/69af1447ce46d8ec186acbc6 HTTP/1.0" 202 Accepted 2026-03-11 18:41:27,723 - lava_callback - INFO - Starting async job submit for node 69af1447ce46d8ec186acbc6 2026-03-11 18:41:27,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:41:27,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af1447ce46d8ec186acbc6 HTTP/1.1" 200 None 2026-03-11 18:41:27,739 - lava_callback - DEBUG - Processing node 69af1447ce46d8ec186acbc6: baseline-arm-baylibre 2026-03-11 18:41:27,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af1447ce46d8ec186acbc6 2026-03-11 18:41:27,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:41:27,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af1447ce46d8ec186acbc6 HTTP/1.1" 200 None 2026-03-11 18:41:27,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:41:27,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70f87e31b554803095edb HTTP/1.1" 200 None 2026-03-11 18:41:27,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:41:27,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af1447ce46d8ec186acbc6 HTTP/1.1" 200 None 2026-03-11 18:41:27,808 - lava_callback - ERROR - Error processing callback for node 69af1447ce46d8ec186acbc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58368 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:44:28,194 - lava_callback - INFO - Received callback for node 69af1508ce46d8ec186acbee INFO: 172.19.0.1:58380 - "POST /node/69af1508ce46d8ec186acbee HTTP/1.0" 202 Accepted 2026-03-11 18:44:28,200 - lava_callback - INFO - Starting async job submit for node 69af1508ce46d8ec186acbee 2026-03-11 18:44:28,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:44:28,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af1508ce46d8ec186acbee HTTP/1.1" 200 None 2026-03-11 18:44:28,224 - lava_callback - DEBUG - Processing node 69af1508ce46d8ec186acbee: baseline-arm-baylibre 2026-03-11 18:44:28,224 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af1508ce46d8ec186acbee 2026-03-11 18:44:28,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:44:28,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af1508ce46d8ec186acbee HTTP/1.1" 200 None 2026-03-11 18:44:28,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:44:28,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70f87e31b554803095edb HTTP/1.1" 200 None 2026-03-11 18:44:28,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:44:28,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af1508ce46d8ec186acbee HTTP/1.1" 200 None 2026-03-11 18:44:28,284 - lava_callback - ERROR - Error processing callback for node 69af1508ce46d8ec186acbee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53562 - "GET / HTTP/1.0" 200 OK 2026-03-11 18:45:07,952 - lava_callback - INFO - Received callback for node 69af152fce46d8ec186acbfa INFO: 172.19.0.1:53566 - "POST /node/69af152fce46d8ec186acbfa HTTP/1.0" 202 Accepted 2026-03-11 18:45:07,958 - lava_callback - INFO - Starting async job submit for node 69af152fce46d8ec186acbfa 2026-03-11 18:45:07,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:45:07,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af152fce46d8ec186acbfa HTTP/1.1" 200 None 2026-03-11 18:45:07,981 - lava_callback - DEBUG - Processing node 69af152fce46d8ec186acbfa: baseline-arm-baylibre 2026-03-11 18:45:07,981 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af152fce46d8ec186acbfa 2026-03-11 18:45:07,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:45:08,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af152fce46d8ec186acbfa HTTP/1.1" 200 None 2026-03-11 18:45:08,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:45:08,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70f87e31b554803095edb HTTP/1.1" 200 None 2026-03-11 18:45:08,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 18:45:08,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af152fce46d8ec186acbfa HTTP/1.1" 200 None 2026-03-11 18:45:08,046 - lava_callback - ERROR - Error processing callback for node 69af152fce46d8ec186acbfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37036 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:13:31,691 - lava_callback - INFO - Received callback for node 69b1bec2a26b422765ba3e85 INFO: 172.19.0.1:34992 - "POST /node/69b1bec2a26b422765ba3e85 HTTP/1.0" 202 Accepted 2026-03-11 19:13:31,697 - lava_callback - INFO - Starting async job submit for node 69b1bec2a26b422765ba3e85 2026-03-11 19:13:31,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:13:31,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bec2a26b422765ba3e85 HTTP/1.1" 200 None 2026-03-11 19:13:31,731 - lava_callback - DEBUG - Processing node 69b1bec2a26b422765ba3e85: baseline-x86 2026-03-11 19:13:31,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:13:32,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:13:32,038 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec2a26b422765ba3e85/log.txt.gz 2026-03-11 19:13:32,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:13:32,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:13:32,376 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec2a26b422765ba3e85/lava-logs.yaml 2026-03-11 19:13:32,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:13:32,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:13:32,518 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec2a26b422765ba3e85/lava_callback.json.gz 2026-03-11 19:13:32,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:13:32,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bec2a26b422765ba3e85 HTTP/1.1" 200 None 2026-03-11 19:13:32,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:13:32,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19625a26b422765ba3731 HTTP/1.1" 200 None 2026-03-11 19:13:32,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:13:32,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bec2a26b422765ba3e85 HTTP/1.1" 200 None 2026-03-11 19:13:32,648 - lava_callback - INFO - Completed processing callback for node 69b1bec2a26b422765ba3e85 INFO: 172.19.0.1:34994 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:13:37,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:13:37,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39662 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:13:47,102 - lava_callback - INFO - Received callback for node 69b1bec4a26b422765ba3e8e INFO: 172.19.0.1:39674 - "POST /node/69b1bec4a26b422765ba3e8e HTTP/1.0" 202 Accepted 2026-03-11 19:13:47,108 - lava_callback - INFO - Starting async job submit for node 69b1bec4a26b422765ba3e8e 2026-03-11 19:13:47,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:13:47,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bec4a26b422765ba3e8e HTTP/1.1" 200 None 2026-03-11 19:13:47,139 - lava_callback - DEBUG - Processing node 69b1bec4a26b422765ba3e8e: baseline-x86 2026-03-11 19:13:47,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:13:47,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:13:47,448 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec4a26b422765ba3e8e/log.txt.gz 2026-03-11 19:13:47,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:13:47,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:13:47,736 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec4a26b422765ba3e8e/lava-logs.yaml 2026-03-11 19:13:47,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:13:47,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:13:47,981 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec4a26b422765ba3e8e/lava_callback.json.gz 2026-03-11 19:13:47,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:13:48,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bec4a26b422765ba3e8e HTTP/1.1" 200 None 2026-03-11 19:13:48,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:13:48,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19625a26b422765ba3731 HTTP/1.1" 200 None 2026-03-11 19:13:48,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:13:48,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bec4a26b422765ba3e8e HTTP/1.1" 200 None 2026-03-11 19:13:48,060 - lava_callback - INFO - Completed processing callback for node 69b1bec4a26b422765ba3e8e INFO: 172.19.0.1:52120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56216 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:14:07,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:14:07,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54990 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:14:22,570 - lava_callback - INFO - Received callback for node 69b1bec2a26b422765ba3e88 INFO: 172.19.0.1:39392 - "POST /node/69b1bec2a26b422765ba3e88 HTTP/1.0" 202 Accepted 2026-03-11 19:14:22,576 - lava_callback - INFO - Starting async job submit for node 69b1bec2a26b422765ba3e88 2026-03-11 19:14:22,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:14:22,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bec2a26b422765ba3e88 HTTP/1.1" 200 None 2026-03-11 19:14:22,614 - lava_callback - DEBUG - Processing node 69b1bec2a26b422765ba3e88: baseline-x86 2026-03-11 19:14:22,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:14:23,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:14:23,038 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec2a26b422765ba3e88/log.txt.gz 2026-03-11 19:14:23,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:14:23,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:14:23,451 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec2a26b422765ba3e88/lava-logs.yaml 2026-03-11 19:14:23,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:14:23,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:14:23,598 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec2a26b422765ba3e88/lava_callback.json.gz 2026-03-11 19:14:23,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:14:23,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bec2a26b422765ba3e88 HTTP/1.1" 200 None 2026-03-11 19:14:23,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:14:23,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19625a26b422765ba3731 HTTP/1.1" 200 None 2026-03-11 19:14:23,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:14:23,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bec2a26b422765ba3e88 HTTP/1.1" 200 None 2026-03-11 19:14:23,674 - lava_callback - INFO - Completed processing callback for node 69b1bec2a26b422765ba3e88 2026-03-11 19:14:25,635 - lava_callback - INFO - Received callback for node 69b1bec3a26b422765ba3e8b INFO: 172.19.0.1:39398 - "POST /node/69b1bec3a26b422765ba3e8b HTTP/1.0" 202 Accepted 2026-03-11 19:14:25,641 - lava_callback - INFO - Starting async job submit for node 69b1bec3a26b422765ba3e8b 2026-03-11 19:14:25,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:14:25,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bec3a26b422765ba3e8b HTTP/1.1" 200 None 2026-03-11 19:14:25,676 - lava_callback - DEBUG - Processing node 69b1bec3a26b422765ba3e8b: baseline-x86 2026-03-11 19:14:25,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:14:26,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:14:26,045 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec3a26b422765ba3e8b/log.txt.gz 2026-03-11 19:14:26,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:14:26,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:14:26,393 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec3a26b422765ba3e8b/lava-logs.yaml 2026-03-11 19:14:26,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:39406 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:14:26,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:14:26,541 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b1bec3a26b422765ba3e8b/lava_callback.json.gz 2026-03-11 19:14:26,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:14:26,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bec3a26b422765ba3e8b HTTP/1.1" 200 None 2026-03-11 19:14:26,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:14:26,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b19625a26b422765ba3731 HTTP/1.1" 200 None 2026-03-11 19:14:26,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:14:26,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bec3a26b422765ba3e8b HTTP/1.1" 200 None 2026-03-11 19:14:26,627 - lava_callback - INFO - Completed processing callback for node 69b1bec3a26b422765ba3e8b INFO: 172.19.0.1:44920 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:14:37,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:14:37,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60772 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:18:50,017 - lava_callback - INFO - Received callback for node 69b1bff5a26b422765ba3f2f INFO: 172.19.0.1:33974 - "POST /node/69b1bff5a26b422765ba3f2f HTTP/1.0" 202 Accepted 2026-03-11 19:18:50,023 - lava_callback - INFO - Starting async job submit for node 69b1bff5a26b422765ba3f2f 2026-03-11 19:18:50,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:18:50,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bff5a26b422765ba3f2f HTTP/1.1" 200 None 2026-03-11 19:18:50,151 - lava_callback - DEBUG - Processing node 69b1bff5a26b422765ba3f2f: baseline-arm64 2026-03-11 19:18:50,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:18:50,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:18:50,479 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff5a26b422765ba3f2f/log.txt.gz 2026-03-11 19:18:50,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:18:50,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:18:50,925 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff5a26b422765ba3f2f/lava-logs.yaml 2026-03-11 19:18:50,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:18:51,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:18:51,082 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff5a26b422765ba3f2f/lava_callback.json.gz 2026-03-11 19:18:51,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:18:51,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bff5a26b422765ba3f2f HTTP/1.1" 200 None 2026-03-11 19:18:51,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:18:51,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:18:51,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:18:51,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bff5a26b422765ba3f2f HTTP/1.1" 200 None 2026-03-11 19:18:51,159 - lava_callback - INFO - Completed processing callback for node 69b1bff5a26b422765ba3f2f 2026-03-11 19:18:52,084 - lava_callback - INFO - Received callback for node 69b1c005a26b422765ba3f58 INFO: 172.19.0.1:33976 - "POST /node/69b1c005a26b422765ba3f58 HTTP/1.0" 202 Accepted 2026-03-11 19:18:52,091 - lava_callback - INFO - Starting async job submit for node 69b1c005a26b422765ba3f58 2026-03-11 19:18:52,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:18:52,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c005a26b422765ba3f58 HTTP/1.1" 200 None 2026-03-11 19:18:52,110 - lava_callback - DEBUG - Processing node 69b1c005a26b422765ba3f58: baseline-nfs-arm64 2026-03-11 19:18:52,111 - lava_callback - WARNING - Failed to upload log 2026-03-11 19:18:52,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:18:52,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:18:52,296 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c005a26b422765ba3f58/lava-logs.yaml 2026-03-11 19:18:52,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:18:52,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:18:52,454 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c005a26b422765ba3f58/lava_callback.json.gz 2026-03-11 19:18:52,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:18:52,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c005a26b422765ba3f58 HTTP/1.1" 200 None 2026-03-11 19:18:52,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:18:52,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:18:52,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:18:52,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c005a26b422765ba3f58 HTTP/1.1" 200 None 2026-03-11 19:18:52,549 - lava_callback - INFO - Completed processing callback for node 69b1c005a26b422765ba3f58 INFO: 172.19.0.1:33988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39280 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:19:07,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:07,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 19:19:09,700 - lava_callback - INFO - Received callback for node 69b1bfe9a26b422765ba3f01 INFO: 172.19.0.1:41166 - "POST /node/69b1bfe9a26b422765ba3f01 HTTP/1.0" 202 Accepted 2026-03-11 19:19:09,706 - lava_callback - INFO - Starting async job submit for node 69b1bfe9a26b422765ba3f01 2026-03-11 19:19:09,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:09,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bfe9a26b422765ba3f01 HTTP/1.1" 200 None 2026-03-11 19:19:09,740 - lava_callback - DEBUG - Processing node 69b1bfe9a26b422765ba3f01: baseline-arm64 2026-03-11 19:19:09,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:10,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:10,023 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfe9a26b422765ba3f01/log.txt.gz 2026-03-11 19:19:10,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:10,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:10,304 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfe9a26b422765ba3f01/lava-logs.yaml 2026-03-11 19:19:10,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:10,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:10,457 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfe9a26b422765ba3f01/lava_callback.json.gz 2026-03-11 19:19:10,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:10,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bfe9a26b422765ba3f01 HTTP/1.1" 200 None 2026-03-11 19:19:10,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:10,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:19:10,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:10,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bfe9a26b422765ba3f01 HTTP/1.1" 200 None 2026-03-11 19:19:10,544 - lava_callback - INFO - Completed processing callback for node 69b1bfe9a26b422765ba3f01 INFO: 172.19.0.1:41174 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 19:19:16,039 - lava_callback - INFO - Received callback for node 69b1bfeda26b422765ba3f0d INFO: 172.19.0.1:41188 - "POST /node/69b1bfeda26b422765ba3f0d HTTP/1.0" 202 Accepted 2026-03-11 19:19:16,046 - lava_callback - INFO - Starting async job submit for node 69b1bfeda26b422765ba3f0d 2026-03-11 19:19:16,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:16,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bfeda26b422765ba3f0d HTTP/1.1" 200 None 2026-03-11 19:19:16,108 - lava_callback - DEBUG - Processing node 69b1bfeda26b422765ba3f0d: baseline-arm64 2026-03-11 19:19:16,304 - lava_callback - WARNING - Failed to upload log 2026-03-11 19:19:16,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:41190 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:19:16,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:16,545 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfeda26b422765ba3f0d/lava-logs.yaml 2026-03-11 19:19:16,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:16,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:16,660 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfeda26b422765ba3f0d/lava_callback.json.gz 2026-03-11 19:19:16,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:16,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bfeda26b422765ba3f0d HTTP/1.1" 200 None 2026-03-11 19:19:16,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:16,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:19:16,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:16,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bfeda26b422765ba3f0d HTTP/1.1" 200 None 2026-03-11 19:19:16,810 - lava_callback - INFO - Completed processing callback for node 69b1bfeda26b422765ba3f0d 2026-03-11 19:19:19,172 - lava_callback - INFO - Received callback for node 69b1bff4a26b422765ba3f2c INFO: 172.19.0.1:41198 - "POST /node/69b1bff4a26b422765ba3f2c HTTP/1.0" 202 Accepted 2026-03-11 19:19:19,179 - lava_callback - INFO - Starting async job submit for node 69b1bff4a26b422765ba3f2c 2026-03-11 19:19:19,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:19,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bff4a26b422765ba3f2c HTTP/1.1" 200 None 2026-03-11 19:19:19,217 - lava_callback - DEBUG - Processing node 69b1bff4a26b422765ba3f2c: baseline-arm64 2026-03-11 19:19:19,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:19,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:19,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff4a26b422765ba3f2c/log.txt.gz 2026-03-11 19:19:20,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:20,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:20,272 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff4a26b422765ba3f2c/lava-logs.yaml 2026-03-11 19:19:20,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:20,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:20,422 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff4a26b422765ba3f2c/lava_callback.json.gz 2026-03-11 19:19:20,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:20,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bff4a26b422765ba3f2c HTTP/1.1" 200 None 2026-03-11 19:19:20,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:20,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:19:20,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:20,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bff4a26b422765ba3f2c HTTP/1.1" 200 None 2026-03-11 19:19:20,526 - lava_callback - INFO - Completed processing callback for node 69b1bff4a26b422765ba3f2c 2026-03-11 19:19:20,976 - lava_callback - INFO - Received callback for node 69b1bfeba26b422765ba3f07 INFO: 172.19.0.1:40216 - "POST /node/69b1bfeba26b422765ba3f07 HTTP/1.0" 202 Accepted 2026-03-11 19:19:20,983 - lava_callback - INFO - Starting async job submit for node 69b1bfeba26b422765ba3f07 2026-03-11 19:19:21,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:21,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bfeba26b422765ba3f07 HTTP/1.1" 200 None 2026-03-11 19:19:21,025 - lava_callback - DEBUG - Processing node 69b1bfeba26b422765ba3f07: baseline-arm64 2026-03-11 19:19:21,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:21,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:21,416 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfeba26b422765ba3f07/log.txt.gz 2026-03-11 19:19:21,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:21,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:21,771 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfeba26b422765ba3f07/lava-logs.yaml 2026-03-11 19:19:21,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:21,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:21,909 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfeba26b422765ba3f07/lava_callback.json.gz 2026-03-11 19:19:21,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:21,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bfeba26b422765ba3f07 HTTP/1.1" 200 None 2026-03-11 19:19:21,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:21,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:19:21,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:21,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bfeba26b422765ba3f07 HTTP/1.1" 200 None 2026-03-11 19:19:21,991 - lava_callback - INFO - Completed processing callback for node 69b1bfeba26b422765ba3f07 INFO: 172.19.0.1:40218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57370 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:19:37,672 - lava_callback - INFO - Received callback for node 69b1bfeea26b422765ba3f10 INFO: 172.19.0.1:57374 - "POST /node/69b1bfeea26b422765ba3f10 HTTP/1.0" 202 Accepted 2026-03-11 19:19:37,679 - lava_callback - INFO - Starting async job submit for node 69b1bfeea26b422765ba3f10 2026-03-11 19:19:37,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:37,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:37,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bfeea26b422765ba3f10 HTTP/1.1" 200 None 2026-03-11 19:19:37,730 - lava_callback - DEBUG - Processing node 69b1bfeea26b422765ba3f10: baseline-arm64 2026-03-11 19:19:37,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-11 19:19:37,898 - lava_callback - WARNING - Failed to upload log 2026-03-11 19:19:37,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:38,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:38,204 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfeea26b422765ba3f10/lava-logs.yaml 2026-03-11 19:19:38,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:38,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:38,363 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfeea26b422765ba3f10/lava_callback.json.gz 2026-03-11 19:19:38,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:38,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bfeea26b422765ba3f10 HTTP/1.1" 200 None 2026-03-11 19:19:38,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:38,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:19:38,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:38,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bfeea26b422765ba3f10 HTTP/1.1" 200 None 2026-03-11 19:19:38,521 - lava_callback - INFO - Completed processing callback for node 69b1bfeea26b422765ba3f10 2026-03-11 19:19:41,554 - lava_callback - INFO - Received callback for node 69b1c004a26b422765ba3f55 INFO: 172.19.0.1:41668 - "POST /node/69b1c004a26b422765ba3f55 HTTP/1.0" 202 Accepted 2026-03-11 19:19:41,560 - lava_callback - INFO - Starting async job submit for node 69b1c004a26b422765ba3f55 2026-03-11 19:19:41,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:41,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c004a26b422765ba3f55 HTTP/1.1" 200 None 2026-03-11 19:19:41,608 - lava_callback - DEBUG - Processing node 69b1c004a26b422765ba3f55: baseline-nfs-arm64 INFO: 172.19.0.1:41678 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:19:42,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:42,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:42,233 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c004a26b422765ba3f55/log.txt.gz 2026-03-11 19:19:42,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:42,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:42,720 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c004a26b422765ba3f55/lava-logs.yaml 2026-03-11 19:19:42,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:42,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:42,873 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c004a26b422765ba3f55/lava_callback.json.gz 2026-03-11 19:19:42,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:42,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c004a26b422765ba3f55 HTTP/1.1" 200 None 2026-03-11 19:19:42,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:42,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:19:42,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:42,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c004a26b422765ba3f55 HTTP/1.1" 200 None 2026-03-11 19:19:42,959 - lava_callback - INFO - Completed processing callback for node 69b1c004a26b422765ba3f55 2026-03-11 19:19:45,238 - lava_callback - INFO - Received callback for node 69b1bff0a26b422765ba3f16 INFO: 172.19.0.1:41686 - "POST /node/69b1bff0a26b422765ba3f16 HTTP/1.0" 202 Accepted 2026-03-11 19:19:45,244 - lava_callback - INFO - Starting async job submit for node 69b1bff0a26b422765ba3f16 2026-03-11 19:19:45,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:45,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bff0a26b422765ba3f16 HTTP/1.1" 200 None 2026-03-11 19:19:45,294 - lava_callback - DEBUG - Processing node 69b1bff0a26b422765ba3f16: baseline-arm64 2026-03-11 19:19:45,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:45,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:45,690 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff0a26b422765ba3f16/log.txt.gz 2026-03-11 19:19:45,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:46,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:46,048 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff0a26b422765ba3f16/lava-logs.yaml 2026-03-11 19:19:46,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:46,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:46,188 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff0a26b422765ba3f16/lava_callback.json.gz 2026-03-11 19:19:46,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:46,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bff0a26b422765ba3f16 HTTP/1.1" 200 None 2026-03-11 19:19:46,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:46,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:19:46,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:46,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bff0a26b422765ba3f16 HTTP/1.1" 200 None 2026-03-11 19:19:46,273 - lava_callback - INFO - Completed processing callback for node 69b1bff0a26b422765ba3f16 INFO: 172.19.0.1:41700 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:19:48,115 - lava_callback - INFO - Received callback for node 69b1bfeaa26b422765ba3f04 INFO: 172.19.0.1:41714 - "POST /node/69b1bfeaa26b422765ba3f04 HTTP/1.0" 202 Accepted 2026-03-11 19:19:48,122 - lava_callback - INFO - Starting async job submit for node 69b1bfeaa26b422765ba3f04 2026-03-11 19:19:48,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:48,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bfeaa26b422765ba3f04 HTTP/1.1" 200 None 2026-03-11 19:19:48,159 - lava_callback - DEBUG - Processing node 69b1bfeaa26b422765ba3f04: baseline-arm64 2026-03-11 19:19:48,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:48,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:48,505 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfeaa26b422765ba3f04/log.txt.gz 2026-03-11 19:19:48,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:48,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:48,837 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfeaa26b422765ba3f04/lava-logs.yaml 2026-03-11 19:19:48,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:48,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:48,994 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfeaa26b422765ba3f04/lava_callback.json.gz 2026-03-11 19:19:49,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:49,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bfeaa26b422765ba3f04 HTTP/1.1" 200 None 2026-03-11 19:19:49,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:49,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:19:49,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:49,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bfeaa26b422765ba3f04 HTTP/1.1" 200 None 2026-03-11 19:19:49,105 - lava_callback - INFO - Completed processing callback for node 69b1bfeaa26b422765ba3f04 INFO: 172.19.0.1:34464 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:19:57,659 - lava_callback - INFO - Received callback for node 69b1c017a26b422765ba3f9b INFO: 172.19.0.1:34476 - "POST /node/69b1c017a26b422765ba3f9b HTTP/1.0" 202 Accepted 2026-03-11 19:19:57,665 - lava_callback - INFO - Starting async job submit for node 69b1c017a26b422765ba3f9b 2026-03-11 19:19:57,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:57,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c017a26b422765ba3f9b HTTP/1.1" 200 None 2026-03-11 19:19:57,702 - lava_callback - DEBUG - Processing node 69b1c017a26b422765ba3f9b: baseline-arm64-broonie 2026-03-11 19:19:57,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:58,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:58,054 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c017a26b422765ba3f9b/log.txt.gz 2026-03-11 19:19:58,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:58,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:58,360 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c017a26b422765ba3f9b/lava-logs.yaml 2026-03-11 19:19:58,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:19:58,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:19:58,511 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c017a26b422765ba3f9b/lava_callback.json.gz 2026-03-11 19:19:58,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:58,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c017a26b422765ba3f9b HTTP/1.1" 200 None 2026-03-11 19:19:58,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:58,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:19:58,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:19:58,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c017a26b422765ba3f9b HTTP/1.1" 200 None 2026-03-11 19:19:58,618 - lava_callback - INFO - Completed processing callback for node 69b1c017a26b422765ba3f9b 2026-03-11 19:20:01,350 - lava_callback - INFO - Received callback for node 69b1bffba26b422765ba3f3f INFO: 172.19.0.1:41554 - "POST /node/69b1bffba26b422765ba3f3f HTTP/1.0" 202 Accepted 2026-03-11 19:20:01,357 - lava_callback - INFO - Starting async job submit for node 69b1bffba26b422765ba3f3f 2026-03-11 19:20:01,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:01,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bffba26b422765ba3f3f HTTP/1.1" 200 None 2026-03-11 19:20:01,394 - lava_callback - DEBUG - Processing node 69b1bffba26b422765ba3f3f: baseline-arm64 2026-03-11 19:20:01,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:01,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:01,830 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bffba26b422765ba3f3f/log.txt.gz 2026-03-11 19:20:02,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:02,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:02,228 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bffba26b422765ba3f3f/lava-logs.yaml 2026-03-11 19:20:02,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:02,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:02,383 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bffba26b422765ba3f3f/lava_callback.json.gz 2026-03-11 19:20:02,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:02,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bffba26b422765ba3f3f HTTP/1.1" 200 None 2026-03-11 19:20:02,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:02,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:02,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:02,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bffba26b422765ba3f3f HTTP/1.1" 200 None 2026-03-11 19:20:02,504 - lava_callback - INFO - Completed processing callback for node 69b1bffba26b422765ba3f3f INFO: 172.19.0.1:41568 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:20:07,297 - lava_callback - INFO - Received callback for node 69b1c00ba26b422765ba3f68 INFO: 172.19.0.1:41580 - "POST /node/69b1c00ba26b422765ba3f68 HTTP/1.0" 202 Accepted 2026-03-11 19:20:07,304 - lava_callback - INFO - Starting async job submit for node 69b1c00ba26b422765ba3f68 2026-03-11 19:20:07,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:07,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c00ba26b422765ba3f68 HTTP/1.1" 200 None 2026-03-11 19:20:07,351 - lava_callback - DEBUG - Processing node 69b1c00ba26b422765ba3f68: baseline-nfs-arm64 2026-03-11 19:20:07,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:07,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:07,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-11 19:20:07,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:07,885 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c00ba26b422765ba3f68/log.txt.gz 2026-03-11 19:20:08,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:08,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:08,300 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c00ba26b422765ba3f68/lava-logs.yaml 2026-03-11 19:20:08,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:08,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:08,470 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c00ba26b422765ba3f68/lava_callback.json.gz 2026-03-11 19:20:08,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:08,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c00ba26b422765ba3f68 HTTP/1.1" 200 None 2026-03-11 19:20:08,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:08,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:08,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:08,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c00ba26b422765ba3f68 HTTP/1.1" 200 None 2026-03-11 19:20:08,568 - lava_callback - INFO - Completed processing callback for node 69b1c00ba26b422765ba3f68 2026-03-11 19:20:09,251 - lava_callback - INFO - Received callback for node 69b1c02fa26b422765ba3ffc INFO: 172.19.0.1:41586 - "POST /node/69b1c02fa26b422765ba3ffc HTTP/1.0" 202 Accepted 2026-03-11 19:20:09,258 - lava_callback - INFO - Starting async job submit for node 69b1c02fa26b422765ba3ffc 2026-03-11 19:20:09,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:09,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c02fa26b422765ba3ffc HTTP/1.1" 200 None 2026-03-11 19:20:09,292 - lava_callback - DEBUG - Processing node 69b1c02fa26b422765ba3ffc: baseline-arm64-pengutronix 2026-03-11 19:20:09,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:09,582 - lava_callback - INFO - Received callback for node 69b1c000a26b422765ba3f4b INFO: 172.19.0.1:41596 - "POST /node/69b1c000a26b422765ba3f4b HTTP/1.0" 202 Accepted 2026-03-11 19:20:09,588 - lava_callback - INFO - Starting async job submit for node 69b1c000a26b422765ba3f4b 2026-03-11 19:20:09,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:09,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:09,614 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b1c02fa26b422765ba3ffc/log.txt.gz 2026-03-11 19:20:09,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c000a26b422765ba3f4b HTTP/1.1" 200 None 2026-03-11 19:20:09,687 - lava_callback - DEBUG - Processing node 69b1c000a26b422765ba3f4b: baseline-nfs-arm64 2026-03-11 19:20:09,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:10,003 - lava_callback - INFO - Received callback for node 69b1bff6a26b422765ba3f32 2026-03-11 19:20:10,025 - lava_callback - INFO - Starting async job submit for node 69b1bff6a26b422765ba3f32 INFO: 172.19.0.1:58114 - "POST /node/69b1bff6a26b422765ba3f32 HTTP/1.0" 202 Accepted 2026-03-11 19:20:10,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:10,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:10,092 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b1c02fa26b422765ba3ffc/lava-logs.yaml 2026-03-11 19:20:10,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:10,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:10,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bff6a26b422765ba3f32 HTTP/1.1" 200 None 2026-03-11 19:20:10,116 - lava_callback - DEBUG - Processing node 69b1bff6a26b422765ba3f32: baseline-arm64 2026-03-11 19:20:10,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:10,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c000a26b422765ba3f4b/log.txt.gz 2026-03-11 19:20:10,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:10,519 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b1c02fa26b422765ba3ffc/lava_callback.json.gz 2026-03-11 19:20:10,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:10,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:10,618 - lava_callback - INFO - Received callback for node 69b1c032a26b422765ba4005 2026-03-11 19:20:10,634 - lava_callback - INFO - Starting async job submit for node 69b1c032a26b422765ba4005 INFO: 172.19.0.1:58126 - "POST /node/69b1c032a26b422765ba4005 HTTP/1.0" 202 Accepted 2026-03-11 19:20:10,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c02fa26b422765ba3ffc HTTP/1.1" 200 None 2026-03-11 19:20:10,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:10,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:10,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:10,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c032a26b422765ba4005 HTTP/1.1" 200 None 2026-03-11 19:20:10,691 - lava_callback - DEBUG - Processing node 69b1c032a26b422765ba4005: baseline-arm64-foundriesio 2026-03-11 19:20:10,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:10,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:10,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:10,806 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff6a26b422765ba3f32/log.txt.gz 2026-03-11 19:20:10,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c02fa26b422765ba3ffc HTTP/1.1" 200 None 2026-03-11 19:20:10,893 - lava_callback - INFO - Completed processing callback for node 69b1c02fa26b422765ba3ffc 2026-03-11 19:20:10,955 - lava_callback - INFO - Received callback for node 69b1c033a26b422765ba4008 INFO: 172.19.0.1:58130 - "POST /node/69b1c033a26b422765ba4008 HTTP/1.0" 202 Accepted 2026-03-11 19:20:10,972 - lava_callback - INFO - Starting async job submit for node 69b1c033a26b422765ba4008 2026-03-11 19:20:11,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:11,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:11,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c033a26b422765ba4008 HTTP/1.1" 200 None 2026-03-11 19:20:11,252 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c000a26b422765ba3f4b/lava-logs.yaml 2026-03-11 19:20:11,254 - lava_callback - DEBUG - Processing node 69b1c033a26b422765ba4008: baseline-arm64-foundriesio 2026-03-11 19:20:11,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:11,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:11,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:11,511 - lava_callback - INFO - Received callback for node 69b1bff3a26b422765ba3f29 2026-03-11 19:20:11,531 - lava_callback - INFO - Starting async job submit for node 69b1bff3a26b422765ba3f29 INFO: 172.19.0.1:58142 - "POST /node/69b1bff3a26b422765ba3f29 HTTP/1.0" 202 Accepted 2026-03-11 19:20:11,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:11,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:11,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:11,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:11,653 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b1c032a26b422765ba4005/log.txt.gz 2026-03-11 19:20:11,680 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff6a26b422765ba3f32/lava-logs.yaml 2026-03-11 19:20:11,696 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c000a26b422765ba3f4b/lava_callback.json.gz 2026-03-11 19:20:11,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bff3a26b422765ba3f29 HTTP/1.1" 200 None 2026-03-11 19:20:11,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:11,841 - lava_callback - DEBUG - Processing node 69b1bff3a26b422765ba3f29: baseline-arm64 2026-03-11 19:20:11,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:12,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c000a26b422765ba3f4b HTTP/1.1" 200 None 2026-03-11 19:20:12,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:12,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:12,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:12,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:12,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:12,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:12,256 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff6a26b422765ba3f32/lava_callback.json.gz 2026-03-11 19:20:12,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:12,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:12,371 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b1c033a26b422765ba4008/log.txt.gz 2026-03-11 19:20:12,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c000a26b422765ba3f4b HTTP/1.1" 200 None 2026-03-11 19:20:12,406 - lava_callback - INFO - Completed processing callback for node 69b1c000a26b422765ba3f4b 2026-03-11 19:20:12,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bff6a26b422765ba3f32 HTTP/1.1" 200 None 2026-03-11 19:20:12,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:12,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:12,503 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b1c032a26b422765ba4005/lava-logs.yaml 2026-03-11 19:20:12,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:12,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:12,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:12,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:12,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bff6a26b422765ba3f32 HTTP/1.1" 200 None 2026-03-11 19:20:12,692 - lava_callback - INFO - Completed processing callback for node 69b1bff6a26b422765ba3f32 2026-03-11 19:20:12,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:12,863 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff3a26b422765ba3f29/log.txt.gz 2026-03-11 19:20:12,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:12,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:12,928 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b1c032a26b422765ba4005/lava_callback.json.gz 2026-03-11 19:20:12,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:13,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c032a26b422765ba4005 HTTP/1.1" 200 None 2026-03-11 19:20:13,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:13,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:13,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:13,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:13,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c032a26b422765ba4005 HTTP/1.1" 200 None 2026-03-11 19:20:13,207 - lava_callback - INFO - Completed processing callback for node 69b1c032a26b422765ba4005 2026-03-11 19:20:13,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:13,293 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b1c033a26b422765ba4008/lava-logs.yaml 2026-03-11 19:20:13,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:13,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:13,404 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff3a26b422765ba3f29/lava-logs.yaml 2026-03-11 19:20:13,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:13,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:13,478 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b1c033a26b422765ba4008/lava_callback.json.gz 2026-03-11 19:20:13,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:13,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c033a26b422765ba4008 HTTP/1.1" 200 None 2026-03-11 19:20:13,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:13,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:13,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:13,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:13,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff3a26b422765ba3f29/lava_callback.json.gz 2026-03-11 19:20:13,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c033a26b422765ba4008 HTTP/1.1" 200 None 2026-03-11 19:20:13,622 - lava_callback - INFO - Completed processing callback for node 69b1c033a26b422765ba4008 2026-03-11 19:20:13,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:13,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bff3a26b422765ba3f29 HTTP/1.1" 200 None 2026-03-11 19:20:13,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:13,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:13,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:13,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bff3a26b422765ba3f29 HTTP/1.1" 200 None 2026-03-11 19:20:13,790 - lava_callback - INFO - Completed processing callback for node 69b1bff3a26b422765ba3f29 2026-03-11 19:20:14,793 - lava_callback - INFO - Received callback for node 69b1c003a26b422765ba3f52 INFO: 172.19.0.1:58154 - "POST /node/69b1c003a26b422765ba3f52 HTTP/1.0" 202 Accepted 2026-03-11 19:20:14,801 - lava_callback - INFO - Starting async job submit for node 69b1c003a26b422765ba3f52 2026-03-11 19:20:14,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:14,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c003a26b422765ba3f52 HTTP/1.1" 200 None 2026-03-11 19:20:14,841 - lava_callback - DEBUG - Processing node 69b1c003a26b422765ba3f52: baseline-nfs-arm64 INFO: 172.19.0.1:58166 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 19:20:15,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:15,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:15,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c003a26b422765ba3f52/log.txt.gz 2026-03-11 19:20:15,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:15,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:15,797 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c003a26b422765ba3f52/lava-logs.yaml 2026-03-11 19:20:15,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:15,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:15,977 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c003a26b422765ba3f52/lava_callback.json.gz 2026-03-11 19:20:16,004 - lava_callback - INFO - Received callback for node 69b1c030a26b422765ba3fff INFO: 172.19.0.1:58178 - "POST /node/69b1c030a26b422765ba3fff HTTP/1.0" 202 Accepted 2026-03-11 19:20:16,012 - lava_callback - INFO - Starting async job submit for node 69b1c030a26b422765ba3fff 2026-03-11 19:20:16,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:16,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:16,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c003a26b422765ba3f52 HTTP/1.1" 200 None 2026-03-11 19:20:16,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:16,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c030a26b422765ba3fff HTTP/1.1" 200 None 2026-03-11 19:20:16,062 - lava_callback - DEBUG - Processing node 69b1c030a26b422765ba3fff: baseline-arm64-pengutronix 2026-03-11 19:20:16,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:16,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:16,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c003a26b422765ba3f52 HTTP/1.1" 200 None 2026-03-11 19:20:16,265 - lava_callback - INFO - Completed processing callback for node 69b1c003a26b422765ba3f52 2026-03-11 19:20:16,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:16,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:16,494 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b1c030a26b422765ba3fff/log.txt.gz INFO: 172.19.0.1:58192 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:20:16,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:16,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:16,781 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b1c030a26b422765ba3fff/lava-logs.yaml 2026-03-11 19:20:16,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:16,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:16,925 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b1c030a26b422765ba3fff/lava_callback.json.gz 2026-03-11 19:20:16,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:16,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c030a26b422765ba3fff HTTP/1.1" 200 None 2026-03-11 19:20:16,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:16,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:16,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:17,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c030a26b422765ba3fff HTTP/1.1" 200 None 2026-03-11 19:20:17,010 - lava_callback - INFO - Completed processing callback for node 69b1c030a26b422765ba3fff 2026-03-11 19:20:17,329 - lava_callback - INFO - Received callback for node 69b1c020a26b422765ba3fb3 INFO: 172.19.0.1:58196 - "POST /node/69b1c020a26b422765ba3fb3 HTTP/1.0" 202 Accepted 2026-03-11 19:20:17,336 - lava_callback - INFO - Starting async job submit for node 69b1c020a26b422765ba3fb3 2026-03-11 19:20:17,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:17,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c020a26b422765ba3fb3 HTTP/1.1" 200 None 2026-03-11 19:20:17,377 - lava_callback - DEBUG - Processing node 69b1c020a26b422765ba3fb3: baseline-arm64-broonie 2026-03-11 19:20:17,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:17,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:17,780 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c020a26b422765ba3fb3/log.txt.gz 2026-03-11 19:20:17,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:18,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:18,107 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c020a26b422765ba3fb3/lava-logs.yaml 2026-03-11 19:20:18,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:18,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:18,244 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c020a26b422765ba3fb3/lava_callback.json.gz 2026-03-11 19:20:18,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:18,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c020a26b422765ba3fb3 HTTP/1.1" 200 None 2026-03-11 19:20:18,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:18,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:18,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:18,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c020a26b422765ba3fb3 HTTP/1.1" 200 None 2026-03-11 19:20:18,356 - lava_callback - INFO - Completed processing callback for node 69b1c020a26b422765ba3fb3 2026-03-11 19:20:22,120 - lava_callback - INFO - Received callback for node 69b1c009a26b422765ba3f61 INFO: 172.19.0.1:54078 - "POST /node/69b1c009a26b422765ba3f61 HTTP/1.0" 202 Accepted 2026-03-11 19:20:22,127 - lava_callback - INFO - Starting async job submit for node 69b1c009a26b422765ba3f61 2026-03-11 19:20:22,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:22,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c009a26b422765ba3f61 HTTP/1.1" 200 None 2026-03-11 19:20:22,168 - lava_callback - DEBUG - Processing node 69b1c009a26b422765ba3f61: baseline-nfs-arm64 2026-03-11 19:20:22,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:22,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:22,723 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c009a26b422765ba3f61/log.txt.gz 2026-03-11 19:20:23,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:23,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:23,309 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c009a26b422765ba3f61/lava-logs.yaml 2026-03-11 19:20:23,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:23,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:23,517 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c009a26b422765ba3f61/lava_callback.json.gz 2026-03-11 19:20:23,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:23,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c009a26b422765ba3f61 HTTP/1.1" 200 None 2026-03-11 19:20:23,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:23,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:23,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:23,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c009a26b422765ba3f61 HTTP/1.1" 200 None 2026-03-11 19:20:23,655 - lava_callback - INFO - Completed processing callback for node 69b1c009a26b422765ba3f61 2026-03-11 19:20:24,227 - lava_callback - INFO - Received callback for node 69b1c006a26b422765ba3f5b INFO: 172.19.0.1:54084 - "POST /node/69b1c006a26b422765ba3f5b HTTP/1.0" 202 Accepted 2026-03-11 19:20:24,239 - lava_callback - INFO - Starting async job submit for node 69b1c006a26b422765ba3f5b 2026-03-11 19:20:24,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:24,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c006a26b422765ba3f5b HTTP/1.1" 200 None 2026-03-11 19:20:24,315 - lava_callback - DEBUG - Processing node 69b1c006a26b422765ba3f5b: baseline-nfs-arm64 2026-03-11 19:20:24,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:25,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:25,126 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c006a26b422765ba3f5b/log.txt.gz 2026-03-11 19:20:25,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:25,420 - lava_callback - INFO - Received callback for node 69b1bff9a26b422765ba3f38 INFO: 172.19.0.1:54088 - "POST /node/69b1bff9a26b422765ba3f38 HTTP/1.0" 202 Accepted 2026-03-11 19:20:25,435 - lava_callback - INFO - Starting async job submit for node 69b1bff9a26b422765ba3f38 2026-03-11 19:20:25,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:25,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bff9a26b422765ba3f38 HTTP/1.1" 200 None 2026-03-11 19:20:25,509 - lava_callback - DEBUG - Processing node 69b1bff9a26b422765ba3f38: baseline-arm64 2026-03-11 19:20:25,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:25,658 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c006a26b422765ba3f5b/lava-logs.yaml 2026-03-11 19:20:25,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:25,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:25,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:25,951 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c006a26b422765ba3f5b/lava_callback.json.gz 2026-03-11 19:20:25,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:25,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:25,978 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff9a26b422765ba3f38/log.txt.gz 2026-03-11 19:20:26,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c006a26b422765ba3f5b HTTP/1.1" 200 None 2026-03-11 19:20:26,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:26,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:26,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:26,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:26,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c006a26b422765ba3f5b HTTP/1.1" 200 None 2026-03-11 19:20:26,197 - lava_callback - INFO - Completed processing callback for node 69b1c006a26b422765ba3f5b 2026-03-11 19:20:26,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:26,417 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff9a26b422765ba3f38/lava-logs.yaml 2026-03-11 19:20:26,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:54104 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:20:26,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:26,607 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff9a26b422765ba3f38/lava_callback.json.gz 2026-03-11 19:20:26,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:26,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bff9a26b422765ba3f38 HTTP/1.1" 200 None 2026-03-11 19:20:26,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:26,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:26,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:26,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bff9a26b422765ba3f38 HTTP/1.1" 200 None 2026-03-11 19:20:26,695 - lava_callback - INFO - Completed processing callback for node 69b1bff9a26b422765ba3f38 2026-03-11 19:20:31,877 - lava_callback - INFO - Received callback for node 69b1bfeba26b422765ba3f0a INFO: 172.19.0.1:39154 - "POST /node/69b1bfeba26b422765ba3f0a HTTP/1.0" 202 Accepted 2026-03-11 19:20:31,883 - lava_callback - INFO - Starting async job submit for node 69b1bfeba26b422765ba3f0a 2026-03-11 19:20:31,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:31,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bfeba26b422765ba3f0a HTTP/1.1" 200 None 2026-03-11 19:20:31,936 - lava_callback - DEBUG - Processing node 69b1bfeba26b422765ba3f0a: baseline-arm64 2026-03-11 19:20:32,107 - lava_callback - INFO - Received callback for node 69b1bffda26b422765ba3f45 INFO: 172.19.0.1:39160 - "POST /node/69b1bffda26b422765ba3f45 HTTP/1.0" 202 Accepted 2026-03-11 19:20:32,134 - lava_callback - INFO - Starting async job submit for node 69b1bffda26b422765ba3f45 2026-03-11 19:20:32,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:32,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:32,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bffda26b422765ba3f45 HTTP/1.1" 200 None 2026-03-11 19:20:32,226 - lava_callback - DEBUG - Processing node 69b1bffda26b422765ba3f45: baseline-nfs-arm64 2026-03-11 19:20:32,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:32,413 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfeba26b422765ba3f0a/log.txt.gz 2026-03-11 19:20:32,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:32,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:32,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:32,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:32,876 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfeba26b422765ba3f0a/lava-logs.yaml 2026-03-11 19:20:32,877 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1bffda26b422765ba3f45/log.txt.gz 2026-03-11 19:20:32,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:33,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:33,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:33,138 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfeba26b422765ba3f0a/lava_callback.json.gz 2026-03-11 19:20:33,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:33,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bfeba26b422765ba3f0a HTTP/1.1" 200 None 2026-03-11 19:20:33,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:33,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:33,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:33,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bfeba26b422765ba3f0a HTTP/1.1" 200 None 2026-03-11 19:20:33,227 - lava_callback - INFO - Completed processing callback for node 69b1bfeba26b422765ba3f0a 2026-03-11 19:20:33,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:33,331 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1bffda26b422765ba3f45/lava-logs.yaml 2026-03-11 19:20:33,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:33,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:33,485 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1bffda26b422765ba3f45/lava_callback.json.gz 2026-03-11 19:20:33,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:33,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bffda26b422765ba3f45 HTTP/1.1" 200 None 2026-03-11 19:20:33,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:33,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:33,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:33,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bffda26b422765ba3f45 HTTP/1.1" 200 None 2026-03-11 19:20:33,584 - lava_callback - INFO - Completed processing callback for node 69b1bffda26b422765ba3f45 INFO: 172.19.0.1:39168 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:20:37,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:37,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.19.0.1:48174 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:20:44,035 - lava_callback - INFO - Received callback for node 69b1c024a26b422765ba3fb9 INFO: 172.19.0.1:48176 - "POST /node/69b1c024a26b422765ba3fb9 HTTP/1.0" 202 Accepted 2026-03-11 19:20:44,041 - lava_callback - INFO - Starting async job submit for node 69b1c024a26b422765ba3fb9 2026-03-11 19:20:44,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:44,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c024a26b422765ba3fb9 HTTP/1.1" 200 None 2026-03-11 19:20:44,124 - lava_callback - DEBUG - Processing node 69b1c024a26b422765ba3fb9: baseline-arm64-broonie 2026-03-11 19:20:44,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:44,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:44,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c024a26b422765ba3fb9/log.txt.gz 2026-03-11 19:20:44,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:44,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:44,838 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c024a26b422765ba3fb9/lava-logs.yaml 2026-03-11 19:20:44,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:44,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:44,984 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c024a26b422765ba3fb9/lava_callback.json.gz 2026-03-11 19:20:45,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:45,009 - lava_callback - INFO - Received callback for node 69b1bff8a26b422765ba3f35 INFO: 172.19.0.1:48186 - "POST /node/69b1bff8a26b422765ba3f35 HTTP/1.0" 202 Accepted 2026-03-11 19:20:45,015 - lava_callback - INFO - Starting async job submit for node 69b1bff8a26b422765ba3f35 2026-03-11 19:20:45,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:45,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c024a26b422765ba3fb9 HTTP/1.1" 200 None 2026-03-11 19:20:45,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:45,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:45,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:45,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bff8a26b422765ba3f35 HTTP/1.1" 200 None 2026-03-11 19:20:45,071 - lava_callback - DEBUG - Processing node 69b1bff8a26b422765ba3f35: baseline-arm64 2026-03-11 19:20:45,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c024a26b422765ba3fb9 HTTP/1.1" 200 None 2026-03-11 19:20:45,178 - lava_callback - INFO - Completed processing callback for node 69b1c024a26b422765ba3fb9 2026-03-11 19:20:45,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:45,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:45,675 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff8a26b422765ba3f35/log.txt.gz 2026-03-11 19:20:45,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:46,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:46,085 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff8a26b422765ba3f35/lava-logs.yaml 2026-03-11 19:20:46,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:46,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:46,254 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff8a26b422765ba3f35/lava_callback.json.gz 2026-03-11 19:20:46,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:46,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bff8a26b422765ba3f35 HTTP/1.1" 200 None 2026-03-11 19:20:46,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:46,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:46,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:46,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bff8a26b422765ba3f35 HTTP/1.1" 200 None 2026-03-11 19:20:46,335 - lava_callback - INFO - Completed processing callback for node 69b1bff8a26b422765ba3f35 INFO: 172.19.0.1:48202 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:20:55,195 - lava_callback - INFO - Received callback for node 69b1c02aa26b422765ba3fce INFO: 172.19.0.1:48052 - "POST /node/69b1c02aa26b422765ba3fce HTTP/1.0" 202 Accepted 2026-03-11 19:20:55,201 - lava_callback - INFO - Starting async job submit for node 69b1c02aa26b422765ba3fce 2026-03-11 19:20:55,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:55,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c02aa26b422765ba3fce HTTP/1.1" 200 None 2026-03-11 19:20:55,237 - lava_callback - DEBUG - Processing node 69b1c02aa26b422765ba3fce: baseline-arm64-clabbe 2026-03-11 19:20:55,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:55,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:55,640 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b1c02aa26b422765ba3fce/log.txt.gz 2026-03-11 19:20:55,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:55,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:55,959 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b1c02aa26b422765ba3fce/lava-logs.yaml 2026-03-11 19:20:55,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:56,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:56,100 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b1c02aa26b422765ba3fce/lava_callback.json.gz 2026-03-11 19:20:56,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:56,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c02aa26b422765ba3fce HTTP/1.1" 200 None 2026-03-11 19:20:56,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:56,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:56,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:56,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c02aa26b422765ba3fce HTTP/1.1" 200 None 2026-03-11 19:20:56,178 - lava_callback - INFO - Completed processing callback for node 69b1c02aa26b422765ba3fce INFO: 172.19.0.1:48054 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:20:57,176 - lava_callback - INFO - Received callback for node 69b1c025a26b422765ba3fbc INFO: 172.19.0.1:48056 - "POST /node/69b1c025a26b422765ba3fbc HTTP/1.0" 202 Accepted 2026-03-11 19:20:57,182 - lava_callback - INFO - Starting async job submit for node 69b1c025a26b422765ba3fbc 2026-03-11 19:20:57,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:57,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c025a26b422765ba3fbc HTTP/1.1" 200 None 2026-03-11 19:20:57,218 - lava_callback - DEBUG - Processing node 69b1c025a26b422765ba3fbc: baseline-arm64-broonie 2026-03-11 19:20:57,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:57,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:57,577 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c025a26b422765ba3fbc/log.txt.gz 2026-03-11 19:20:57,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:57,894 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:57,896 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c025a26b422765ba3fbc/lava-logs.yaml 2026-03-11 19:20:57,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:20:58,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:20:58,038 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c025a26b422765ba3fbc/lava_callback.json.gz 2026-03-11 19:20:58,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:58,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c025a26b422765ba3fbc HTTP/1.1" 200 None 2026-03-11 19:20:58,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:58,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:20:58,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:20:58,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c025a26b422765ba3fbc HTTP/1.1" 200 None 2026-03-11 19:20:58,156 - lava_callback - INFO - Completed processing callback for node 69b1c025a26b422765ba3fbc 2026-03-11 19:21:04,955 - lava_callback - INFO - Received callback for node 69b1c01da26b422765ba3fad INFO: 172.19.0.1:37292 - "POST /node/69b1c01da26b422765ba3fad HTTP/1.0" 202 Accepted 2026-03-11 19:21:04,962 - lava_callback - INFO - Starting async job submit for node 69b1c01da26b422765ba3fad 2026-03-11 19:21:04,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:21:05,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c01da26b422765ba3fad HTTP/1.1" 200 None 2026-03-11 19:21:05,025 - lava_callback - DEBUG - Processing node 69b1c01da26b422765ba3fad: baseline-arm64-broonie 2026-03-11 19:21:05,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:21:05,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:21:05,437 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01da26b422765ba3fad/log.txt.gz 2026-03-11 19:21:05,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:21:05,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:21:05,758 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01da26b422765ba3fad/lava-logs.yaml 2026-03-11 19:21:05,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:21:05,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:21:05,893 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01da26b422765ba3fad/lava_callback.json.gz 2026-03-11 19:21:05,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:21:05,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c01da26b422765ba3fad HTTP/1.1" 200 None 2026-03-11 19:21:05,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:21:05,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:21:05,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:21:05,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c01da26b422765ba3fad HTTP/1.1" 200 None 2026-03-11 19:21:05,977 - lava_callback - INFO - Completed processing callback for node 69b1c01da26b422765ba3fad INFO: 172.19.0.1:37300 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:21:07,422 - lava_callback - INFO - Received callback for node 69b1c007a26b422765ba3f5e INFO: 172.19.0.1:37314 - "POST /node/69b1c007a26b422765ba3f5e HTTP/1.0" 202 Accepted 2026-03-11 19:21:07,429 - lava_callback - INFO - Starting async job submit for node 69b1c007a26b422765ba3f5e 2026-03-11 19:21:07,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:21:07,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c007a26b422765ba3f5e HTTP/1.1" 200 None 2026-03-11 19:21:07,464 - lava_callback - DEBUG - Processing node 69b1c007a26b422765ba3f5e: baseline-nfs-arm64 2026-03-11 19:21:07,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:21:07,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-11 19:21:07,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:21:08,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:21:08,029 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c007a26b422765ba3f5e/log.txt.gz 2026-03-11 19:21:08,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:21:08,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:21:08,490 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c007a26b422765ba3f5e/lava-logs.yaml 2026-03-11 19:21:08,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:21:08,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:21:08,680 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c007a26b422765ba3f5e/lava_callback.json.gz 2026-03-11 19:21:08,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:21:08,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c007a26b422765ba3f5e HTTP/1.1" 200 None 2026-03-11 19:21:08,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:21:08,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:21:08,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:21:08,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c007a26b422765ba3f5e HTTP/1.1" 200 None 2026-03-11 19:21:08,798 - lava_callback - INFO - Completed processing callback for node 69b1c007a26b422765ba3f5e INFO: 172.19.0.1:53274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42932 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:21:37,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:21:37,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44962 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:22:37,592 - lava_callback - INFO - Received callback for node 69b1c01ea26b422765ba3fb0 INFO: 172.19.0.1:44978 - "POST /node/69b1c01ea26b422765ba3fb0 HTTP/1.0" 202 Accepted 2026-03-11 19:22:37,598 - lava_callback - INFO - Starting async job submit for node 69b1c01ea26b422765ba3fb0 2026-03-11 19:22:37,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:22:37,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c01ea26b422765ba3fb0 HTTP/1.1" 200 None 2026-03-11 19:22:37,636 - lava_callback - DEBUG - Processing node 69b1c01ea26b422765ba3fb0: baseline-arm64-broonie 2026-03-11 19:22:37,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:22:38,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:22:38,061 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01ea26b422765ba3fb0/log.txt.gz 2026-03-11 19:22:38,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:22:38,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:22:38,439 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01ea26b422765ba3fb0/lava-logs.yaml 2026-03-11 19:22:38,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:22:38,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:22:38,619 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c01ea26b422765ba3fb0/lava_callback.json.gz 2026-03-11 19:22:38,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:22:38,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c01ea26b422765ba3fb0 HTTP/1.1" 200 None 2026-03-11 19:22:38,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:22:38,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:22:38,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:22:38,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c01ea26b422765ba3fb0 HTTP/1.1" 200 None 2026-03-11 19:22:38,708 - lava_callback - INFO - Completed processing callback for node 69b1c01ea26b422765ba3fb0 INFO: 172.19.0.1:55704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34690 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:23:07,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:23:07,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:48254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56528 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:23:50,554 - lava_callback - INFO - Received callback for node 69b1c031a26b422765ba4002 INFO: 172.19.0.1:54338 - "POST /node/69b1c031a26b422765ba4002 HTTP/1.0" 202 Accepted 2026-03-11 19:23:50,560 - lava_callback - INFO - Starting async job submit for node 69b1c031a26b422765ba4002 2026-03-11 19:23:50,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:23:50,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c031a26b422765ba4002 HTTP/1.1" 200 None 2026-03-11 19:23:50,613 - lava_callback - DEBUG - Processing node 69b1c031a26b422765ba4002: baseline-arm64-pengutronix 2026-03-11 19:23:50,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:23:50,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:23:50,984 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b1c031a26b422765ba4002/log.txt.gz 2026-03-11 19:23:51,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:23:51,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:23:51,335 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b1c031a26b422765ba4002/lava-logs.yaml 2026-03-11 19:23:51,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:23:51,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:23:51,492 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b1c031a26b422765ba4002/lava_callback.json.gz 2026-03-11 19:23:51,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:23:51,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c031a26b422765ba4002 HTTP/1.1" 200 None 2026-03-11 19:23:51,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:23:51,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:23:51,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:23:51,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c031a26b422765ba4002 HTTP/1.1" 200 None 2026-03-11 19:23:51,609 - lava_callback - INFO - Completed processing callback for node 69b1c031a26b422765ba4002 INFO: 172.19.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58840 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:24:07,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:24:07,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33858 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:26:06,704 - lava_callback - INFO - Received callback for node 69b1bffca26b422765ba3f42 INFO: 172.19.0.1:33874 - "POST /node/69b1bffca26b422765ba3f42 HTTP/1.0" 202 Accepted 2026-03-11 19:26:06,711 - lava_callback - INFO - Starting async job submit for node 69b1bffca26b422765ba3f42 2026-03-11 19:26:06,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:26:06,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bffca26b422765ba3f42 HTTP/1.1" 200 None 2026-03-11 19:26:06,762 - lava_callback - DEBUG - Processing node 69b1bffca26b422765ba3f42: baseline-arm64 2026-03-11 19:26:07,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:26:07,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:26:07,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bffca26b422765ba3f42/log.txt.gz 2026-03-11 19:26:07,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:26:07,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:26:07,739 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bffca26b422765ba3f42/lava-logs.yaml 2026-03-11 19:26:07,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:26:07,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:26:07,898 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bffca26b422765ba3f42/lava_callback.json.gz DEBUG: Setup failed for 69b1bffca26b422765ba3f42. Transitting job node result: incomplete -> fail 2026-03-11 19:26:07,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:26:07,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bffca26b422765ba3f42 HTTP/1.1" 200 None 2026-03-11 19:26:07,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:26:08,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:26:08,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:26:08,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bffca26b422765ba3f42 HTTP/1.1" 200 None 2026-03-11 19:26:08,116 - lava_callback - INFO - Completed processing callback for node 69b1bffca26b422765ba3f42 INFO: 172.19.0.1:60468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47628 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:26:37,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:26:37,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60192 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:26:52,943 - lava_callback - INFO - Received callback for node 69b1c1e3a26b422765ba413c INFO: 172.19.0.1:50476 - "POST /node/69b1c1e3a26b422765ba413c HTTP/1.0" 202 Accepted 2026-03-11 19:26:52,949 - lava_callback - INFO - Starting async job submit for node 69b1c1e3a26b422765ba413c 2026-03-11 19:26:52,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:26:52,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c1e3a26b422765ba413c HTTP/1.1" 200 None 2026-03-11 19:26:52,967 - lava_callback - DEBUG - Processing node 69b1c1e3a26b422765ba413c: baseline-nfs-arm64 2026-03-11 19:26:52,968 - lava_callback - WARNING - Failed to upload log 2026-03-11 19:26:52,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:26:53,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:26:53,103 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c1e3a26b422765ba413c/lava-logs.yaml 2026-03-11 19:26:53,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:26:53,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:26:53,281 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c1e3a26b422765ba413c/lava_callback.json.gz 2026-03-11 19:26:53,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:26:53,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c1e3a26b422765ba413c HTTP/1.1" 200 None 2026-03-11 19:26:53,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:26:53,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:26:53,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:26:53,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c1e3a26b422765ba413c HTTP/1.1" 200 None 2026-03-11 19:26:53,360 - lava_callback - INFO - Completed processing callback for node 69b1c1e3a26b422765ba413c INFO: 172.19.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51332 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:27:07,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:27:08,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:55208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55362 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:28:51,075 - lava_callback - INFO - Received callback for node 69b1c22aa26b422765ba414b INFO: 172.19.0.1:40740 - "POST /node/69b1c22aa26b422765ba414b HTTP/1.0" 202 Accepted 2026-03-11 19:28:51,083 - lava_callback - INFO - Starting async job submit for node 69b1c22aa26b422765ba414b 2026-03-11 19:28:51,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:28:51,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c22aa26b422765ba414b HTTP/1.1" 200 None 2026-03-11 19:28:51,132 - lava_callback - DEBUG - Processing node 69b1c22aa26b422765ba414b: baseline-arm64 2026-03-11 19:28:51,264 - lava_callback - WARNING - Failed to upload log 2026-03-11 19:28:51,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:28:51,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:28:51,544 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c22aa26b422765ba414b/lava-logs.yaml 2026-03-11 19:28:51,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:28:51,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:28:51,680 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c22aa26b422765ba414b/lava_callback.json.gz 2026-03-11 19:28:51,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:28:51,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c22aa26b422765ba414b HTTP/1.1" 200 None 2026-03-11 19:28:51,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:28:51,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:28:51,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:28:51,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c22aa26b422765ba414b HTTP/1.1" 200 None 2026-03-11 19:28:51,819 - lava_callback - INFO - Completed processing callback for node 69b1c22aa26b422765ba414b INFO: 172.19.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36676 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:29:08,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:29:08,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:51648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52574 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:31:57,696 - lava_callback - INFO - Received callback for node 69b1c2cba26b422765ba416a INFO: 172.19.0.1:52584 - "POST /node/69b1c2cba26b422765ba416a HTTP/1.0" 202 Accepted 2026-03-11 19:31:57,703 - lava_callback - INFO - Starting async job submit for node 69b1c2cba26b422765ba416a 2026-03-11 19:31:57,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:31:57,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c2cba26b422765ba416a HTTP/1.1" 200 None 2026-03-11 19:31:57,753 - lava_callback - DEBUG - Processing node 69b1c2cba26b422765ba416a: baseline-arm64 2026-03-11 19:31:57,970 - lava_callback - WARNING - Failed to upload log 2026-03-11 19:31:58,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:31:58,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:31:58,310 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c2cba26b422765ba416a/lava-logs.yaml 2026-03-11 19:31:58,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:31:58,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:31:58,459 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c2cba26b422765ba416a/lava_callback.json.gz 2026-03-11 19:31:58,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:31:58,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c2cba26b422765ba416a HTTP/1.1" 200 None 2026-03-11 19:31:58,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:31:58,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:31:58,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:31:58,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c2cba26b422765ba416a HTTP/1.1" 200 None 2026-03-11 19:31:58,625 - lava_callback - INFO - Completed processing callback for node 69b1c2cba26b422765ba416a INFO: 172.19.0.1:46420 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:32:08,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:32:08,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59856 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:33:36,991 - lava_callback - INFO - Received callback for node 69b1c31ba26b422765ba4178 INFO: 172.19.0.1:59870 - "POST /node/69b1c31ba26b422765ba4178 HTTP/1.0" 202 Accepted 2026-03-11 19:33:36,997 - lava_callback - INFO - Starting async job submit for node 69b1c31ba26b422765ba4178 2026-03-11 19:33:37,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:33:37,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c31ba26b422765ba4178 HTTP/1.1" 200 None 2026-03-11 19:33:37,034 - lava_callback - DEBUG - Processing node 69b1c31ba26b422765ba4178: baseline-arm64 2026-03-11 19:33:37,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:33:37,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:33:37,519 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c31ba26b422765ba4178/log.txt.gz 2026-03-11 19:33:37,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:33:37,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:33:37,911 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c31ba26b422765ba4178/lava-logs.yaml 2026-03-11 19:33:37,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:33:38,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:33:38,091 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c31ba26b422765ba4178/lava_callback.json.gz 2026-03-11 19:33:38,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:33:38,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c31ba26b422765ba4178 HTTP/1.1" 200 None 2026-03-11 19:33:38,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:33:38,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:33:38,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:33:38,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c31ba26b422765ba4178 HTTP/1.1" 200 None 2026-03-11 19:33:38,289 - lava_callback - INFO - Completed processing callback for node 69b1c31ba26b422765ba4178 INFO: 172.19.0.1:53490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51266 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:34:08,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:34:08,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:37894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56794 - "GET /node/698e2afb952a14bf500e41b5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58122 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:40:58,663 - lava_callback - INFO - Received callback for node 69b1bff1a26b422765ba3f26 INFO: 172.19.0.1:58136 - "POST /node/69b1bff1a26b422765ba3f26 HTTP/1.0" 202 Accepted 2026-03-11 19:40:58,669 - lava_callback - INFO - Starting async job submit for node 69b1bff1a26b422765ba3f26 2026-03-11 19:40:58,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:40:58,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bff1a26b422765ba3f26 HTTP/1.1" 200 None 2026-03-11 19:40:58,706 - lava_callback - DEBUG - Processing node 69b1bff1a26b422765ba3f26: baseline-arm64 2026-03-11 19:40:59,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:40:59,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:40:59,198 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff1a26b422765ba3f26/log.txt.gz 2026-03-11 19:40:59,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:40:59,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:40:59,716 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff1a26b422765ba3f26/lava-logs.yaml 2026-03-11 19:40:59,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:40:59,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:40:59,949 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bff1a26b422765ba3f26/lava_callback.json.gz 2026-03-11 19:40:59,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:40:59,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bff1a26b422765ba3f26 HTTP/1.1" 200 None 2026-03-11 19:40:59,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:41:00,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:41:00,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:41:00,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bff1a26b422765ba3f26 HTTP/1.1" 200 None 2026-03-11 19:41:00,046 - lava_callback - INFO - Completed processing callback for node 69b1bff1a26b422765ba3f26 INFO: 172.19.0.1:58448 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:41:08,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:41:08,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53900 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:44:20,024 - lava_callback - INFO - Received callback for node 69b1c373a26b422765ba4188 INFO: 172.19.0.1:46868 - "POST /node/69b1c373a26b422765ba4188 HTTP/1.0" 202 Accepted 2026-03-11 19:44:20,030 - lava_callback - INFO - Starting async job submit for node 69b1c373a26b422765ba4188 2026-03-11 19:44:20,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:44:20,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c373a26b422765ba4188 HTTP/1.1" 200 None 2026-03-11 19:44:20,070 - lava_callback - DEBUG - Processing node 69b1c373a26b422765ba4188: baseline-arm 2026-03-11 19:44:20,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:44:20,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:44:20,420 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b1c373a26b422765ba4188/log.txt.gz 2026-03-11 19:44:20,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:44:20,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:44:20,733 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b1c373a26b422765ba4188/lava-logs.yaml 2026-03-11 19:44:20,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:44:20,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:44:20,967 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b1c373a26b422765ba4188/lava_callback.json.gz 2026-03-11 19:44:20,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:44:21,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c373a26b422765ba4188 HTTP/1.1" 200 None 2026-03-11 19:44:21,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:44:21,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195ffa26b422765ba370e HTTP/1.1" 200 None 2026-03-11 19:44:21,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:44:21,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c373a26b422765ba4188 HTTP/1.1" 200 None 2026-03-11 19:44:21,052 - lava_callback - INFO - Completed processing callback for node 69b1c373a26b422765ba4188 INFO: 172.19.0.1:46872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54282 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:44:38,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:44:38,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35498 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:46:33,348 - lava_callback - INFO - Received callback for node 69b1c682a26b422765ba422e INFO: 172.19.0.1:34134 - "POST /node/69b1c682a26b422765ba422e HTTP/1.0" 202 Accepted 2026-03-11 19:46:33,353 - lava_callback - INFO - Starting async job submit for node 69b1c682a26b422765ba422e 2026-03-11 19:46:33,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:46:33,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c682a26b422765ba422e HTTP/1.1" 200 None 2026-03-11 19:46:33,370 - lava_callback - DEBUG - Processing node 69b1c682a26b422765ba422e: baseline-nfs-arm64 2026-03-11 19:46:33,372 - lava_callback - WARNING - Failed to upload log 2026-03-11 19:46:33,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:46:33,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:46:33,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c682a26b422765ba422e/lava-logs.yaml 2026-03-11 19:46:33,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:46:33,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:46:33,668 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c682a26b422765ba422e/lava_callback.json.gz 2026-03-11 19:46:33,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:46:33,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c682a26b422765ba422e HTTP/1.1" 200 None 2026-03-11 19:46:33,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:46:33,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:46:33,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:46:33,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c682a26b422765ba422e HTTP/1.1" 200 None 2026-03-11 19:46:33,737 - lava_callback - INFO - Completed processing callback for node 69b1c682a26b422765ba422e INFO: 172.19.0.1:34136 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:46:38,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:46:38,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58556 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:46:51,407 - lava_callback - INFO - Received callback for node 69af23a4ce46d8ec186acf5e INFO: 172.19.0.1:54910 - "POST /node/69af23a4ce46d8ec186acf5e HTTP/1.0" 202 Accepted 2026-03-11 19:46:51,413 - lava_callback - INFO - Starting async job submit for node 69af23a4ce46d8ec186acf5e 2026-03-11 19:46:51,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:46:51,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af23a4ce46d8ec186acf5e HTTP/1.1" 200 None 2026-03-11 19:46:51,430 - lava_callback - DEBUG - Processing node 69af23a4ce46d8ec186acf5e: baseline-arm64-baylibre 2026-03-11 19:46:51,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af23a4ce46d8ec186acf5e 2026-03-11 19:46:51,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:46:51,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af23a4ce46d8ec186acf5e HTTP/1.1" 200 None 2026-03-11 19:46:51,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:46:51,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70fafe31b554803095f11 HTTP/1.1" 200 None 2026-03-11 19:46:51,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:46:51,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af23a4ce46d8ec186acf5e HTTP/1.1" 200 None 2026-03-11 19:46:51,498 - lava_callback - ERROR - Error processing callback for node 69af23a4ce46d8ec186acf5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60332 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:49:41,266 - lava_callback - INFO - Received callback for node 69b1c71ba26b422765ba440f INFO: 172.19.0.1:36018 - "POST /node/69b1c71ba26b422765ba440f HTTP/1.0" 202 Accepted 2026-03-11 19:49:41,272 - lava_callback - INFO - Starting async job submit for node 69b1c71ba26b422765ba440f 2026-03-11 19:49:41,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:49:41,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c71ba26b422765ba440f HTTP/1.1" 200 None 2026-03-11 19:49:41,316 - lava_callback - DEBUG - Processing node 69b1c71ba26b422765ba440f: baseline-arm64 2026-03-11 19:49:41,468 - lava_callback - WARNING - Failed to upload log 2026-03-11 19:49:41,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:49:41,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:49:41,723 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c71ba26b422765ba440f/lava-logs.yaml 2026-03-11 19:49:41,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:49:41,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:49:41,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c71ba26b422765ba440f/lava_callback.json.gz 2026-03-11 19:49:41,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:49:41,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c71ba26b422765ba440f HTTP/1.1" 200 None 2026-03-11 19:49:41,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:49:41,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:49:41,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:49:41,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c71ba26b422765ba440f HTTP/1.1" 200 None 2026-03-11 19:49:42,023 - lava_callback - INFO - Completed processing callback for node 69b1c71ba26b422765ba440f INFO: 172.19.0.1:36026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41422 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:50:08,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:50:08,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53272 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:50:31,577 - lava_callback - INFO - Received callback for node 69af247cce46d8ec186acf82 INFO: 172.19.0.1:47104 - "POST /node/69af247cce46d8ec186acf82 HTTP/1.0" 202 Accepted 2026-03-11 19:50:31,582 - lava_callback - INFO - Starting async job submit for node 69af247cce46d8ec186acf82 2026-03-11 19:50:31,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:50:31,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af247cce46d8ec186acf82 HTTP/1.1" 200 None 2026-03-11 19:50:31,597 - lava_callback - DEBUG - Processing node 69af247cce46d8ec186acf82: baseline-arm64-baylibre 2026-03-11 19:50:31,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af247cce46d8ec186acf82 2026-03-11 19:50:31,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:50:31,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af247cce46d8ec186acf82 HTTP/1.1" 200 None 2026-03-11 19:50:31,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:50:31,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70fafe31b554803095f11 HTTP/1.1" 200 None 2026-03-11 19:50:31,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:50:31,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af247cce46d8ec186acf82 HTTP/1.1" 200 None 2026-03-11 19:50:31,682 - lava_callback - ERROR - Error processing callback for node 69af247cce46d8ec186acf82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33768 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:50:52,968 - lava_callback - INFO - Received callback for node 69b1c5e0a26b422765ba4207 INFO: 172.19.0.1:36466 - "POST /node/69b1c5e0a26b422765ba4207 HTTP/1.0" 202 Accepted 2026-03-11 19:50:52,975 - lava_callback - INFO - Starting async job submit for node 69b1c5e0a26b422765ba4207 2026-03-11 19:50:53,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:50:53,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c5e0a26b422765ba4207 HTTP/1.1" 200 None 2026-03-11 19:50:53,027 - lava_callback - DEBUG - Processing node 69b1c5e0a26b422765ba4207: baseline-arm64 2026-03-11 19:50:53,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:50:53,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:50:53,548 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c5e0a26b422765ba4207/log.txt.gz 2026-03-11 19:50:53,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:50:53,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:50:54,001 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c5e0a26b422765ba4207/lava-logs.yaml 2026-03-11 19:50:54,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:50:54,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:50:54,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c5e0a26b422765ba4207/lava_callback.json.gz DEBUG: Setup failed for 69b1c5e0a26b422765ba4207. Transitting job node result: incomplete -> fail 2026-03-11 19:50:54,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:50:54,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c5e0a26b422765ba4207 HTTP/1.1" 200 None 2026-03-11 19:50:54,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:50:54,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:50:54,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:50:54,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c5e0a26b422765ba4207 HTTP/1.1" 200 None 2026-03-11 19:50:54,410 - lava_callback - INFO - Completed processing callback for node 69b1c5e0a26b422765ba4207 INFO: 172.19.0.1:36478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57352 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:51:08,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:51:08,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:48948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48696 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:53:31,719 - lava_callback - INFO - Received callback for node 69af252dce46d8ec186acfa1 INFO: 172.19.0.1:46190 - "POST /node/69af252dce46d8ec186acfa1 HTTP/1.0" 202 Accepted 2026-03-11 19:53:31,724 - lava_callback - INFO - Starting async job submit for node 69af252dce46d8ec186acfa1 2026-03-11 19:53:31,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:53:31,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af252dce46d8ec186acfa1 HTTP/1.1" 200 None 2026-03-11 19:53:31,739 - lava_callback - DEBUG - Processing node 69af252dce46d8ec186acfa1: baseline-arm64-baylibre 2026-03-11 19:53:31,739 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af252dce46d8ec186acfa1 2026-03-11 19:53:31,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:53:31,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af252dce46d8ec186acfa1 HTTP/1.1" 200 None 2026-03-11 19:53:31,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:53:31,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70fafe31b554803095f11 HTTP/1.1" 200 None 2026-03-11 19:53:31,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:53:31,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af252dce46d8ec186acfa1 HTTP/1.1" 200 None 2026-03-11 19:53:31,795 - lava_callback - ERROR - Error processing callback for node 69af252dce46d8ec186acfa1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45256 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:53:50,428 - lava_callback - INFO - Received callback for node 69b1c80ca26b422765ba443d INFO: 172.19.0.1:40504 - "POST /node/69b1c80ca26b422765ba443d HTTP/1.0" 202 Accepted 2026-03-11 19:53:50,435 - lava_callback - INFO - Starting async job submit for node 69b1c80ca26b422765ba443d 2026-03-11 19:53:50,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:53:50,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c80ca26b422765ba443d HTTP/1.1" 200 None 2026-03-11 19:53:50,479 - lava_callback - DEBUG - Processing node 69b1c80ca26b422765ba443d: baseline-arm64 2026-03-11 19:53:50,690 - lava_callback - WARNING - Failed to upload log 2026-03-11 19:53:50,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:53:50,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:53:50,995 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c80ca26b422765ba443d/lava-logs.yaml 2026-03-11 19:53:50,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:53:51,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:53:51,143 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c80ca26b422765ba443d/lava_callback.json.gz 2026-03-11 19:53:51,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:53:51,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c80ca26b422765ba443d HTTP/1.1" 200 None 2026-03-11 19:53:51,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:53:51,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:53:51,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:53:51,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c80ca26b422765ba443d HTTP/1.1" 200 None 2026-03-11 19:53:51,291 - lava_callback - INFO - Completed processing callback for node 69b1c80ca26b422765ba443d INFO: 172.19.0.1:40508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34620 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:54:08,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:54:08,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60542 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:56:51,830 - lava_callback - INFO - Received callback for node 69af25efce46d8ec186acfc0 INFO: 172.19.0.1:59188 - "POST /node/69af25efce46d8ec186acfc0 HTTP/1.0" 202 Accepted 2026-03-11 19:56:51,836 - lava_callback - INFO - Starting async job submit for node 69af25efce46d8ec186acfc0 2026-03-11 19:56:51,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:56:51,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af25efce46d8ec186acfc0 HTTP/1.1" 200 None 2026-03-11 19:56:51,856 - lava_callback - DEBUG - Processing node 69af25efce46d8ec186acfc0: baseline-arm64-baylibre 2026-03-11 19:56:51,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af25efce46d8ec186acfc0 2026-03-11 19:56:51,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:56:51,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af25efce46d8ec186acfc0 HTTP/1.1" 200 None 2026-03-11 19:56:51,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:56:51,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70fafe31b554803095f11 HTTP/1.1" 200 None 2026-03-11 19:56:51,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:56:51,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af25efce46d8ec186acfc0 HTTP/1.1" 200 None 2026-03-11 19:56:51,915 - lava_callback - ERROR - Error processing callback for node 69af25efce46d8ec186acfc0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58938 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:57:51,865 - lava_callback - INFO - Received callback for node 69af2631ce46d8ec186acfc7 INFO: 172.19.0.1:40780 - "POST /node/69af2631ce46d8ec186acfc7 HTTP/1.0" 202 Accepted 2026-03-11 19:57:51,870 - lava_callback - INFO - Starting async job submit for node 69af2631ce46d8ec186acfc7 2026-03-11 19:57:51,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:57:51,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2631ce46d8ec186acfc7 HTTP/1.1" 200 None 2026-03-11 19:57:51,885 - lava_callback - DEBUG - Processing node 69af2631ce46d8ec186acfc7: baseline-arm-baylibre 2026-03-11 19:57:51,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af2631ce46d8ec186acfc7 2026-03-11 19:57:51,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:57:51,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2631ce46d8ec186acfc7 HTTP/1.1" 200 None 2026-03-11 19:57:51,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:57:51,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 19:57:51,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:57:51,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af2631ce46d8ec186acfc7 HTTP/1.1" 200 None 2026-03-11 19:57:51,944 - lava_callback - ERROR - Error processing callback for node 69af2631ce46d8ec186acfc7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44214 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:58:32,060 - lava_callback - INFO - Received callback for node 69af2665ce46d8ec186acfd1 INFO: 172.19.0.1:44300 - "POST /node/69af2665ce46d8ec186acfd1 HTTP/1.0" 202 Accepted 2026-03-11 19:58:32,065 - lava_callback - INFO - Starting async job submit for node 69af2665ce46d8ec186acfd1 2026-03-11 19:58:32,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:58:32,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2665ce46d8ec186acfd1 HTTP/1.1" 200 None 2026-03-11 19:58:32,099 - lava_callback - DEBUG - Processing node 69af2665ce46d8ec186acfd1: baseline-arm64-baylibre 2026-03-11 19:58:32,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af2665ce46d8ec186acfd1 2026-03-11 19:58:32,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:58:32,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2665ce46d8ec186acfd1 HTTP/1.1" 200 None 2026-03-11 19:58:32,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:58:32,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70fafe31b554803095f11 HTTP/1.1" 200 None 2026-03-11 19:58:32,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:58:32,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af2665ce46d8ec186acfd1 HTTP/1.1" 200 None 2026-03-11 19:58:32,162 - lava_callback - ERROR - Error processing callback for node 69af2665ce46d8ec186acfd1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44304 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:58:40,520 - lava_callback - INFO - Received callback for node 69b1c902a26b422765ba4463 INFO: 172.19.0.1:53086 - "POST /node/69b1c902a26b422765ba4463 HTTP/1.0" 202 Accepted 2026-03-11 19:58:40,526 - lava_callback - INFO - Starting async job submit for node 69b1c902a26b422765ba4463 2026-03-11 19:58:40,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:58:40,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c902a26b422765ba4463 HTTP/1.1" 200 None 2026-03-11 19:58:40,566 - lava_callback - DEBUG - Processing node 69b1c902a26b422765ba4463: baseline-arm64 2026-03-11 19:58:40,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:58:41,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:58:41,076 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c902a26b422765ba4463/log.txt.gz 2026-03-11 19:58:41,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:58:41,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:58:41,492 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c902a26b422765ba4463/lava-logs.yaml 2026-03-11 19:58:41,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 19:58:41,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 19:58:41,629 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1c902a26b422765ba4463/lava_callback.json.gz 2026-03-11 19:58:41,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:58:41,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c902a26b422765ba4463 HTTP/1.1" 200 None 2026-03-11 19:58:41,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:58:41,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 19:58:41,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:58:41,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c902a26b422765ba4463 HTTP/1.1" 200 None 2026-03-11 19:58:41,780 - lava_callback - INFO - Completed processing callback for node 69b1c902a26b422765ba4463 INFO: 172.19.0.1:53090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37766 - "GET / HTTP/1.0" 200 OK 2026-03-11 19:59:08,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 19:59:08,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56940 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 20:00:15,891 - lava_callback - INFO - Received callback for node 69b1c001a26b422765ba3f4f INFO: 172.19.0.1:56948 - "POST /node/69b1c001a26b422765ba3f4f HTTP/1.0" 202 Accepted 2026-03-11 20:00:15,899 - lava_callback - INFO - Starting async job submit for node 69b1c001a26b422765ba3f4f 2026-03-11 20:00:15,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:00:15,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c001a26b422765ba3f4f HTTP/1.1" 200 None 2026-03-11 20:00:15,957 - lava_callback - DEBUG - Processing node 69b1c001a26b422765ba3f4f: baseline-nfs-arm64 INFO: 172.19.0.1:56952 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:00:17,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:00:17,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:00:17,217 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c001a26b422765ba3f4f/log.txt.gz 2026-03-11 20:00:17,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:00:18,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:00:18,033 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c001a26b422765ba3f4f/lava-logs.yaml 2026-03-11 20:00:18,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:00:18,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:00:18,256 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1c001a26b422765ba3f4f/lava_callback.json.gz DEBUG: Setup failed for 69b1c001a26b422765ba3f4f. Transitting job node result: incomplete -> fail 2026-03-11 20:00:18,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:00:18,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c001a26b422765ba3f4f HTTP/1.1" 200 None 2026-03-11 20:00:18,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:00:18,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 20:00:18,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:00:18,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c001a26b422765ba3f4f HTTP/1.1" 200 None 2026-03-11 20:00:18,495 - lava_callback - INFO - Completed processing callback for node 69b1c001a26b422765ba3f4f INFO: 172.19.0.1:45556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56212 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:00:38,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:00:38,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60294 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:01:12,105 - lava_callback - INFO - Received callback for node 69af26f6ce46d8ec186acfe2 INFO: 172.19.0.1:40504 - "POST /node/69af26f6ce46d8ec186acfe2 HTTP/1.0" 202 Accepted 2026-03-11 20:01:12,110 - lava_callback - INFO - Starting async job submit for node 69af26f6ce46d8ec186acfe2 2026-03-11 20:01:12,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:01:12,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af26f6ce46d8ec186acfe2 HTTP/1.1" 200 None 2026-03-11 20:01:12,127 - lava_callback - DEBUG - Processing node 69af26f6ce46d8ec186acfe2: baseline-arm-baylibre 2026-03-11 20:01:12,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af26f6ce46d8ec186acfe2 2026-03-11 20:01:12,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:01:12,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af26f6ce46d8ec186acfe2 HTTP/1.1" 200 None 2026-03-11 20:01:12,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:01:12,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 20:01:12,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:01:12,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af26f6ce46d8ec186acfe2 HTTP/1.1" 200 None 2026-03-11 20:01:12,197 - lava_callback - ERROR - Error processing callback for node 69af26f6ce46d8ec186acfe2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60084 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:02:00,362 - lava_callback - INFO - Received callback for node 69b1c374a26b422765ba418b INFO: 172.19.0.1:43044 - "POST /node/69b1c374a26b422765ba418b HTTP/1.0" 202 Accepted 2026-03-11 20:02:00,369 - lava_callback - INFO - Starting async job submit for node 69b1c374a26b422765ba418b 2026-03-11 20:02:00,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:02:00,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c374a26b422765ba418b HTTP/1.1" 200 None 2026-03-11 20:02:00,443 - lava_callback - DEBUG - Processing node 69b1c374a26b422765ba418b: ltp-smoke 2026-03-11 20:02:00,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:02:01,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:02:01,039 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1c374a26b422765ba418b/log.txt.gz 2026-03-11 20:02:01,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:02:01,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:02:01,530 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1c374a26b422765ba418b/lava-logs.yaml 2026-03-11 20:02:01,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:02:01,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:02:01,718 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1c374a26b422765ba418b/lava_callback.json.gz 2026-03-11 20:02:01,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:02:01,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c374a26b422765ba418b HTTP/1.1" 200 None 2026-03-11 20:02:01,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:02:01,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195ffa26b422765ba370e HTTP/1.1" 200 None 2026-03-11 20:02:01,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:02:01,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c374a26b422765ba418b HTTP/1.1" 200 None 2026-03-11 20:02:02,009 - lava_callback - INFO - Completed processing callback for node 69b1c374a26b422765ba418b INFO: 172.19.0.1:43050 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:02:08,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:02:08,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:49916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39112 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:03:12,220 - lava_callback - INFO - Received callback for node 69af276cce46d8ec186acffe INFO: 172.19.0.1:32934 - "POST /node/69af276cce46d8ec186acffe HTTP/1.0" 202 Accepted 2026-03-11 20:03:12,225 - lava_callback - INFO - Starting async job submit for node 69af276cce46d8ec186acffe 2026-03-11 20:03:12,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:03:12,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af276cce46d8ec186acffe HTTP/1.1" 200 None 2026-03-11 20:03:12,246 - lava_callback - DEBUG - Processing node 69af276cce46d8ec186acffe: baseline-arm-baylibre 2026-03-11 20:03:12,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af276cce46d8ec186acffe 2026-03-11 20:03:12,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:03:12,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af276cce46d8ec186acffe HTTP/1.1" 200 None 2026-03-11 20:03:12,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:03:12,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 20:03:12,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:03:12,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af276cce46d8ec186acffe HTTP/1.1" 200 None 2026-03-11 20:03:12,298 - lava_callback - ERROR - Error processing callback for node 69af276cce46d8ec186acffe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:32944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60116 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:03:52,172 - lava_callback - INFO - Received callback for node 69af2794ce46d8ec186ad007 INFO: 172.19.0.1:43120 - "POST /node/69af2794ce46d8ec186ad007 HTTP/1.0" 202 Accepted 2026-03-11 20:03:52,177 - lava_callback - INFO - Starting async job submit for node 69af2794ce46d8ec186ad007 2026-03-11 20:03:52,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:03:52,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2794ce46d8ec186ad007 HTTP/1.1" 200 None 2026-03-11 20:03:52,194 - lava_callback - DEBUG - Processing node 69af2794ce46d8ec186ad007: baseline-arm-baylibre 2026-03-11 20:03:52,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af2794ce46d8ec186ad007 2026-03-11 20:03:52,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:03:52,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2794ce46d8ec186ad007 HTTP/1.1" 200 None 2026-03-11 20:03:52,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:03:52,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 20:03:52,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:03:52,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af2794ce46d8ec186ad007 HTTP/1.1" 200 None 2026-03-11 20:03:52,255 - lava_callback - ERROR - Error processing callback for node 69af2794ce46d8ec186ad007: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56994 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:04:32,249 - lava_callback - INFO - Received callback for node 69af27bbce46d8ec186ad012 INFO: 172.19.0.1:38358 - "POST /node/69af27bbce46d8ec186ad012 HTTP/1.0" 202 Accepted 2026-03-11 20:04:32,254 - lava_callback - INFO - Starting async job submit for node 69af27bbce46d8ec186ad012 2026-03-11 20:04:32,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:04:32,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af27bbce46d8ec186ad012 HTTP/1.1" 200 None 2026-03-11 20:04:32,271 - lava_callback - DEBUG - Processing node 69af27bbce46d8ec186ad012: baseline-arm-baylibre 2026-03-11 20:04:32,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af27bbce46d8ec186ad012 2026-03-11 20:04:32,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:04:32,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af27bbce46d8ec186ad012 HTTP/1.1" 200 None 2026-03-11 20:04:32,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:04:32,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 20:04:32,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:04:32,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af27bbce46d8ec186ad012 HTTP/1.1" 200 None 2026-03-11 20:04:32,342 - lava_callback - ERROR - Error processing callback for node 69af27bbce46d8ec186ad012: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43672 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:05:12,236 - lava_callback - INFO - Received callback for node 69af27e3ce46d8ec186ad020 INFO: 172.19.0.1:49220 - "POST /node/69af27e3ce46d8ec186ad020 HTTP/1.0" 202 Accepted 2026-03-11 20:05:12,241 - lava_callback - INFO - Starting async job submit for node 69af27e3ce46d8ec186ad020 2026-03-11 20:05:12,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:05:12,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af27e3ce46d8ec186ad020 HTTP/1.1" 200 None 2026-03-11 20:05:12,257 - lava_callback - DEBUG - Processing node 69af27e3ce46d8ec186ad020: baseline-arm-baylibre 2026-03-11 20:05:12,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af27e3ce46d8ec186ad020 2026-03-11 20:05:12,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:05:12,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af27e3ce46d8ec186ad020 HTTP/1.1" 200 None 2026-03-11 20:05:12,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:05:12,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 20:05:12,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:05:12,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af27e3ce46d8ec186ad020 HTTP/1.1" 200 None 2026-03-11 20:05:12,323 - lava_callback - ERROR - Error processing callback for node 69af27e3ce46d8ec186ad020: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50588 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:07:32,715 - lava_callback - INFO - Received callback for node 69af287bce46d8ec186ad03a INFO: 172.19.0.1:53668 - "POST /node/69af287bce46d8ec186ad03a HTTP/1.0" 202 Accepted 2026-03-11 20:07:32,721 - lava_callback - INFO - Starting async job submit for node 69af287bce46d8ec186ad03a 2026-03-11 20:07:32,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:07:32,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af287bce46d8ec186ad03a HTTP/1.1" 200 None 2026-03-11 20:07:32,737 - lava_callback - DEBUG - Processing node 69af287bce46d8ec186ad03a: baseline-arm-baylibre 2026-03-11 20:07:32,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af287bce46d8ec186ad03a 2026-03-11 20:07:32,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:07:32,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af287bce46d8ec186ad03a HTTP/1.1" 200 None 2026-03-11 20:07:32,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:07:32,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 20:07:32,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:07:32,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af287bce46d8ec186ad03a HTTP/1.1" 200 None 2026-03-11 20:07:32,833 - lava_callback - ERROR - Error processing callback for node 69af287bce46d8ec186ad03a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43758 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:09:30,457 - lava_callback - INFO - Received callback for node 69af28efce46d8ec186ad055 INFO: 172.19.0.1:59720 - "POST /node/69af28efce46d8ec186ad055 HTTP/1.0" 202 Accepted 2026-03-11 20:09:30,463 - lava_callback - INFO - Starting async job submit for node 69af28efce46d8ec186ad055 2026-03-11 20:09:30,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:09:30,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af28efce46d8ec186ad055 HTTP/1.1" 200 None 2026-03-11 20:09:30,479 - lava_callback - DEBUG - Processing node 69af28efce46d8ec186ad055: baseline-arm-clabbe 2026-03-11 20:09:30,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af28efce46d8ec186ad055 2026-03-11 20:09:30,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:09:30,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af28efce46d8ec186ad055 HTTP/1.1" 200 None 2026-03-11 20:09:30,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:09:30,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 20:09:30,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:09:30,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af28efce46d8ec186ad055 HTTP/1.1" 200 None 2026-03-11 20:09:30,546 - lava_callback - ERROR - Error processing callback for node 69af28efce46d8ec186ad055: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 20:09:34,079 - lava_callback - INFO - Received callback for node 69b1cbdca26b422765ba44e1 INFO: 172.19.0.1:59732 - "POST /node/69b1cbdca26b422765ba44e1 HTTP/1.0" 202 Accepted 2026-03-11 20:09:34,089 - lava_callback - INFO - Starting async job submit for node 69b1cbdca26b422765ba44e1 2026-03-11 20:09:34,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:09:34,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cbdca26b422765ba44e1 HTTP/1.1" 200 None 2026-03-11 20:09:34,107 - lava_callback - DEBUG - Processing node 69b1cbdca26b422765ba44e1: baseline-nfs-arm64 2026-03-11 20:09:34,108 - lava_callback - WARNING - Failed to upload log 2026-03-11 20:09:34,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:09:34,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:09:34,260 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1cbdca26b422765ba44e1/lava-logs.yaml 2026-03-11 20:09:34,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:09:34,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:09:34,398 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1cbdca26b422765ba44e1/lava_callback.json.gz 2026-03-11 20:09:34,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:09:34,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cbdca26b422765ba44e1 HTTP/1.1" 200 None 2026-03-11 20:09:34,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:09:34,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 20:09:34,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:09:34,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1cbdca26b422765ba44e1 HTTP/1.1" 200 None 2026-03-11 20:09:34,469 - lava_callback - INFO - Completed processing callback for node 69b1cbdca26b422765ba44e1 INFO: 172.19.0.1:59748 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:09:38,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:09:38,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52088 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:10:10,531 - lava_callback - INFO - Received callback for node 69af2917ce46d8ec186ad05e INFO: 172.19.0.1:54062 - "POST /node/69af2917ce46d8ec186ad05e HTTP/1.0" 202 Accepted 2026-03-11 20:10:10,537 - lava_callback - INFO - Starting async job submit for node 69af2917ce46d8ec186ad05e 2026-03-11 20:10:10,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:10:10,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2917ce46d8ec186ad05e HTTP/1.1" 200 None 2026-03-11 20:10:10,554 - lava_callback - DEBUG - Processing node 69af2917ce46d8ec186ad05e: baseline-arm-clabbe 2026-03-11 20:10:10,555 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af2917ce46d8ec186ad05e 2026-03-11 20:10:10,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:10:10,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2917ce46d8ec186ad05e HTTP/1.1" 200 None 2026-03-11 20:10:10,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:10:10,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 20:10:10,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:10:10,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af2917ce46d8ec186ad05e HTTP/1.1" 200 None 2026-03-11 20:10:10,614 - lava_callback - ERROR - Error processing callback for node 69af2917ce46d8ec186ad05e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45948 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:10:50,513 - lava_callback - INFO - Received callback for node 69af293ece46d8ec186ad067 INFO: 172.19.0.1:46472 - "POST /node/69af293ece46d8ec186ad067 HTTP/1.0" 202 Accepted 2026-03-11 20:10:50,518 - lava_callback - INFO - Starting async job submit for node 69af293ece46d8ec186ad067 2026-03-11 20:10:50,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:10:50,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af293ece46d8ec186ad067 HTTP/1.1" 200 None 2026-03-11 20:10:50,533 - lava_callback - DEBUG - Processing node 69af293ece46d8ec186ad067: baseline-arm-clabbe 2026-03-11 20:10:50,533 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af293ece46d8ec186ad067 2026-03-11 20:10:50,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:10:50,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af293ece46d8ec186ad067 HTTP/1.1" 200 None 2026-03-11 20:10:50,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:10:50,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 20:10:50,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:10:50,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af293ece46d8ec186ad067 HTTP/1.1" 200 None 2026-03-11 20:10:50,599 - lava_callback - ERROR - Error processing callback for node 69af293ece46d8ec186ad067: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46486 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:10:59,269 - lava_callback - INFO - Received callback for node 69b1cc25a26b422765ba44f0 INFO: 172.19.0.1:46490 - "POST /node/69b1cc25a26b422765ba44f0 HTTP/1.0" 202 Accepted 2026-03-11 20:10:59,276 - lava_callback - INFO - Starting async job submit for node 69b1cc25a26b422765ba44f0 2026-03-11 20:10:59,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:10:59,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cc25a26b422765ba44f0 HTTP/1.1" 200 None 2026-03-11 20:10:59,320 - lava_callback - DEBUG - Processing node 69b1cc25a26b422765ba44f0: baseline-arm64 2026-03-11 20:10:59,473 - lava_callback - WARNING - Failed to upload log 2026-03-11 20:10:59,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:10:59,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:10:59,823 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1cc25a26b422765ba44f0/lava-logs.yaml 2026-03-11 20:10:59,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:10:59,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:10:59,971 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1cc25a26b422765ba44f0/lava_callback.json.gz 2026-03-11 20:11:00,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:11:00,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cc25a26b422765ba44f0 HTTP/1.1" 200 None 2026-03-11 20:11:00,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:11:00,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 20:11:00,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:11:00,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1cc25a26b422765ba44f0 HTTP/1.1" 200 None 2026-03-11 20:11:00,140 - lava_callback - INFO - Completed processing callback for node 69b1cc25a26b422765ba44f0 INFO: 172.19.0.1:36158 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:11:08,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:11:08,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46820 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:11:30,505 - lava_callback - INFO - Received callback for node 69af2965ce46d8ec186ad071 INFO: 172.19.0.1:49660 - "POST /node/69af2965ce46d8ec186ad071 HTTP/1.0" 202 Accepted 2026-03-11 20:11:30,510 - lava_callback - INFO - Starting async job submit for node 69af2965ce46d8ec186ad071 2026-03-11 20:11:30,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:11:30,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2965ce46d8ec186ad071 HTTP/1.1" 200 None 2026-03-11 20:11:30,536 - lava_callback - DEBUG - Processing node 69af2965ce46d8ec186ad071: baseline-arm-clabbe 2026-03-11 20:11:30,536 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af2965ce46d8ec186ad071 2026-03-11 20:11:30,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:11:30,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2965ce46d8ec186ad071 HTTP/1.1" 200 None 2026-03-11 20:11:30,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:11:30,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 20:11:30,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:11:30,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af2965ce46d8ec186ad071 HTTP/1.1" 200 None 2026-03-11 20:11:30,592 - lava_callback - ERROR - Error processing callback for node 69af2965ce46d8ec186ad071: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44416 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:12:10,572 - lava_callback - INFO - Received callback for node 69af298cce46d8ec186ad079 INFO: 172.19.0.1:55084 - "POST /node/69af298cce46d8ec186ad079 HTTP/1.0" 202 Accepted 2026-03-11 20:12:10,577 - lava_callback - INFO - Starting async job submit for node 69af298cce46d8ec186ad079 2026-03-11 20:12:10,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:12:10,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af298cce46d8ec186ad079 HTTP/1.1" 200 None 2026-03-11 20:12:10,608 - lava_callback - DEBUG - Processing node 69af298cce46d8ec186ad079: baseline-arm-clabbe 2026-03-11 20:12:10,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af298cce46d8ec186ad079 2026-03-11 20:12:10,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:12:10,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af298cce46d8ec186ad079 HTTP/1.1" 200 None 2026-03-11 20:12:10,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:12:10,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 20:12:10,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:12:10,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af298cce46d8ec186ad079 HTTP/1.1" 200 None 2026-03-11 20:12:10,732 - lava_callback - ERROR - Error processing callback for node 69af298cce46d8ec186ad079: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42170 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:12:52,693 - lava_callback - INFO - Received callback for node 69af29afce46d8ec186ad082 INFO: 172.19.0.1:34748 - "POST /node/69af29afce46d8ec186ad082 HTTP/1.0" 202 Accepted 2026-03-11 20:12:52,699 - lava_callback - INFO - Starting async job submit for node 69af29afce46d8ec186ad082 2026-03-11 20:12:52,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:12:52,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af29afce46d8ec186ad082 HTTP/1.1" 200 None 2026-03-11 20:12:52,719 - lava_callback - DEBUG - Processing node 69af29afce46d8ec186ad082: baseline-arm-baylibre 2026-03-11 20:12:52,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af29afce46d8ec186ad082 2026-03-11 20:12:52,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:12:52,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af29afce46d8ec186ad082 HTTP/1.1" 200 None 2026-03-11 20:12:52,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:12:52,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 20:12:52,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:12:52,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af29afce46d8ec186ad082 HTTP/1.1" 200 None 2026-03-11 20:12:52,777 - lava_callback - ERROR - Error processing callback for node 69af29afce46d8ec186ad082: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52850 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:13:32,643 - lava_callback - INFO - Received callback for node 69af29e1ce46d8ec186ad08c INFO: 172.19.0.1:38168 - "POST /node/69af29e1ce46d8ec186ad08c HTTP/1.0" 202 Accepted 2026-03-11 20:13:32,649 - lava_callback - INFO - Starting async job submit for node 69af29e1ce46d8ec186ad08c 2026-03-11 20:13:32,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:13:32,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af29e1ce46d8ec186ad08c HTTP/1.1" 200 None 2026-03-11 20:13:32,675 - lava_callback - DEBUG - Processing node 69af29e1ce46d8ec186ad08c: baseline-arm64-baylibre 2026-03-11 20:13:32,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af29e1ce46d8ec186ad08c 2026-03-11 20:13:32,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:13:32,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af29e1ce46d8ec186ad08c HTTP/1.1" 200 None 2026-03-11 20:13:32,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:13:32,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70fafe31b554803095f11 HTTP/1.1" 200 None 2026-03-11 20:13:32,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:13:32,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af29e1ce46d8ec186ad08c HTTP/1.1" 200 None 2026-03-11 20:13:32,750 - lava_callback - ERROR - Error processing callback for node 69af29e1ce46d8ec186ad08c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35888 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:15:31,468 - lava_callback - INFO - Received callback for node 69b1ccc9a26b422765ba450a INFO: 172.19.0.1:42852 - "POST /node/69b1ccc9a26b422765ba450a HTTP/1.0" 202 Accepted 2026-03-11 20:15:31,475 - lava_callback - INFO - Starting async job submit for node 69b1ccc9a26b422765ba450a 2026-03-11 20:15:31,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:15:31,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ccc9a26b422765ba450a HTTP/1.1" 200 None 2026-03-11 20:15:31,520 - lava_callback - DEBUG - Processing node 69b1ccc9a26b422765ba450a: baseline-arm64 2026-03-11 20:15:31,713 - lava_callback - WARNING - Failed to upload log 2026-03-11 20:15:31,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:15:32,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:15:32,114 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1ccc9a26b422765ba450a/lava-logs.yaml 2026-03-11 20:15:32,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:15:32,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:15:32,263 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1ccc9a26b422765ba450a/lava_callback.json.gz 2026-03-11 20:15:32,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:15:32,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1ccc9a26b422765ba450a HTTP/1.1" 200 None 2026-03-11 20:15:32,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:15:32,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 20:15:32,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:15:32,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1ccc9a26b422765ba450a HTTP/1.1" 200 None 2026-03-11 20:15:32,437 - lava_callback - INFO - Completed processing callback for node 69b1ccc9a26b422765ba450a INFO: 172.19.0.1:42866 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:15:38,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:15:38,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46630 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:15:52,821 - lava_callback - INFO - Received callback for node 69af2a70ce46d8ec186ad09d INFO: 172.19.0.1:45282 - "POST /node/69af2a70ce46d8ec186ad09d HTTP/1.0" 202 Accepted 2026-03-11 20:15:52,826 - lava_callback - INFO - Starting async job submit for node 69af2a70ce46d8ec186ad09d 2026-03-11 20:15:52,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:15:52,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2a70ce46d8ec186ad09d HTTP/1.1" 200 None 2026-03-11 20:15:52,842 - lava_callback - DEBUG - Processing node 69af2a70ce46d8ec186ad09d: baseline-arm-baylibre 2026-03-11 20:15:52,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af2a70ce46d8ec186ad09d 2026-03-11 20:15:52,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:15:52,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2a70ce46d8ec186ad09d HTTP/1.1" 200 None 2026-03-11 20:15:52,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:15:52,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 20:15:52,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:15:52,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af2a70ce46d8ec186ad09d HTTP/1.1" 200 None 2026-03-11 20:15:52,917 - lava_callback - ERROR - Error processing callback for node 69af2a70ce46d8ec186ad09d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42580 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 20:16:16,068 - lava_callback - INFO - Received callback for node 69b1cd1da26b422765ba4514 INFO: 172.19.0.1:42590 - "POST /node/69b1cd1da26b422765ba4514 HTTP/1.0" 202 Accepted 2026-03-11 20:16:16,074 - lava_callback - INFO - Starting async job submit for node 69b1cd1da26b422765ba4514 2026-03-11 20:16:16,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:16:16,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cd1da26b422765ba4514 HTTP/1.1" 200 None 2026-03-11 20:16:16,111 - lava_callback - DEBUG - Processing node 69b1cd1da26b422765ba4514: baseline-arm64 2026-03-11 20:16:16,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:42600 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:16:16,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:16:16,561 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1cd1da26b422765ba4514/log.txt.gz 2026-03-11 20:16:16,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:16:16,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:16:16,985 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1cd1da26b422765ba4514/lava-logs.yaml 2026-03-11 20:16:16,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:16:17,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:16:17,140 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1cd1da26b422765ba4514/lava_callback.json.gz 2026-03-11 20:16:17,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:16:17,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cd1da26b422765ba4514 HTTP/1.1" 200 None 2026-03-11 20:16:17,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:16:17,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 20:16:17,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:16:17,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1cd1da26b422765ba4514 HTTP/1.1" 200 None 2026-03-11 20:16:17,288 - lava_callback - INFO - Completed processing callback for node 69b1cd1da26b422765ba4514 INFO: 172.19.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33460 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:16:38,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:16:38,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:48408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44350 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:21:53,416 - lava_callback - INFO - Received callback for node 69af2bcdce46d8ec186ad0de INFO: 172.19.0.1:36808 - "POST /node/69af2bcdce46d8ec186ad0de HTTP/1.0" 202 Accepted 2026-03-11 20:21:53,422 - lava_callback - INFO - Starting async job submit for node 69af2bcdce46d8ec186ad0de 2026-03-11 20:21:53,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:21:53,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2bcdce46d8ec186ad0de HTTP/1.1" 200 None 2026-03-11 20:21:53,453 - lava_callback - DEBUG - Processing node 69af2bcdce46d8ec186ad0de: baseline-arm-baylibre 2026-03-11 20:21:53,453 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af2bcdce46d8ec186ad0de 2026-03-11 20:21:53,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:21:53,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2bcdce46d8ec186ad0de HTTP/1.1" 200 None 2026-03-11 20:21:53,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:21:53,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 20:21:53,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:21:53,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af2bcdce46d8ec186ad0de HTTP/1.1" 200 None 2026-03-11 20:21:53,520 - lava_callback - ERROR - Error processing callback for node 69af2bcdce46d8ec186ad0de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36820 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:22:06,089 - lava_callback - INFO - Received callback for node 69b1cc7ca26b422765ba44fd INFO: 172.19.0.1:46174 - "POST /node/69b1cc7ca26b422765ba44fd HTTP/1.0" 202 Accepted 2026-03-11 20:22:06,096 - lava_callback - INFO - Starting async job submit for node 69b1cc7ca26b422765ba44fd 2026-03-11 20:22:06,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:22:06,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cc7ca26b422765ba44fd HTTP/1.1" 200 None 2026-03-11 20:22:06,146 - lava_callback - DEBUG - Processing node 69b1cc7ca26b422765ba44fd: baseline-arm64 2026-03-11 20:22:06,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:46180 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:22:06,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:22:06,664 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1cc7ca26b422765ba44fd/log.txt.gz 2026-03-11 20:22:06,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:22:07,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:22:07,095 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1cc7ca26b422765ba44fd/lava-logs.yaml 2026-03-11 20:22:07,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:22:07,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:22:07,285 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1cc7ca26b422765ba44fd/lava_callback.json.gz DEBUG: Setup failed for 69b1cc7ca26b422765ba44fd. Transitting job node result: incomplete -> fail 2026-03-11 20:22:07,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:22:07,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cc7ca26b422765ba44fd HTTP/1.1" 200 None 2026-03-11 20:22:07,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:22:07,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 20:22:07,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:22:07,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1cc7ca26b422765ba44fd HTTP/1.1" 200 None 2026-03-11 20:22:07,506 - lava_callback - INFO - Completed processing callback for node 69b1cc7ca26b422765ba44fd 2026-03-11 20:22:08,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:22:08,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50148 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:26:11,249 - lava_callback - INFO - Received callback for node 69af2cd6ce46d8ec186ad120 INFO: 172.19.0.1:45276 - "POST /node/69af2cd6ce46d8ec186ad120 HTTP/1.0" 202 Accepted 2026-03-11 20:26:11,255 - lava_callback - INFO - Starting async job submit for node 69af2cd6ce46d8ec186ad120 2026-03-11 20:26:11,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:26:11,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2cd6ce46d8ec186ad120 HTTP/1.1" 200 None 2026-03-11 20:26:11,271 - lava_callback - DEBUG - Processing node 69af2cd6ce46d8ec186ad120: baseline-arm-clabbe 2026-03-11 20:26:11,272 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af2cd6ce46d8ec186ad120 2026-03-11 20:26:11,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:26:11,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2cd6ce46d8ec186ad120 HTTP/1.1" 200 None 2026-03-11 20:26:11,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:26:11,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 20:26:11,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:26:11,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af2cd6ce46d8ec186ad120 HTTP/1.1" 200 None 2026-03-11 20:26:11,363 - lava_callback - ERROR - Error processing callback for node 69af2cd6ce46d8ec186ad120: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47260 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:28:11,274 - lava_callback - INFO - Received callback for node 69af2d49ce46d8ec186ad137 INFO: 172.19.0.1:54976 - "POST /node/69af2d49ce46d8ec186ad137 HTTP/1.0" 202 Accepted 2026-03-11 20:28:11,280 - lava_callback - INFO - Starting async job submit for node 69af2d49ce46d8ec186ad137 2026-03-11 20:28:11,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:28:11,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2d49ce46d8ec186ad137 HTTP/1.1" 200 None 2026-03-11 20:28:11,299 - lava_callback - DEBUG - Processing node 69af2d49ce46d8ec186ad137: baseline-arm-clabbe 2026-03-11 20:28:11,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af2d49ce46d8ec186ad137 2026-03-11 20:28:11,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:28:11,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2d49ce46d8ec186ad137 HTTP/1.1" 200 None 2026-03-11 20:28:11,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:28:11,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 20:28:11,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:28:11,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af2d49ce46d8ec186ad137 HTTP/1.1" 200 None 2026-03-11 20:28:11,361 - lava_callback - ERROR - Error processing callback for node 69af2d49ce46d8ec186ad137: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51932 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:28:51,265 - lava_callback - INFO - Received callback for node 69af2d70ce46d8ec186ad143 INFO: 172.19.0.1:35576 - "POST /node/69af2d70ce46d8ec186ad143 HTTP/1.0" 202 Accepted 2026-03-11 20:28:51,270 - lava_callback - INFO - Starting async job submit for node 69af2d70ce46d8ec186ad143 2026-03-11 20:28:51,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:28:51,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2d70ce46d8ec186ad143 HTTP/1.1" 200 None 2026-03-11 20:28:51,286 - lava_callback - DEBUG - Processing node 69af2d70ce46d8ec186ad143: baseline-arm-clabbe 2026-03-11 20:28:51,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af2d70ce46d8ec186ad143 2026-03-11 20:28:51,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:28:51,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2d70ce46d8ec186ad143 HTTP/1.1" 200 None 2026-03-11 20:28:51,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:28:51,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 20:28:51,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:28:51,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af2d70ce46d8ec186ad143 HTTP/1.1" 200 None 2026-03-11 20:28:51,373 - lava_callback - ERROR - Error processing callback for node 69af2d70ce46d8ec186ad143: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36080 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:29:25,025 - lava_callback - INFO - Received callback for node 69b1cf63a26b422765ba4599 INFO: 172.19.0.1:56418 - "POST /node/69b1cf63a26b422765ba4599 HTTP/1.0" 202 Accepted 2026-03-11 20:29:25,032 - lava_callback - INFO - Starting async job submit for node 69b1cf63a26b422765ba4599 2026-03-11 20:29:25,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:29:25,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cf63a26b422765ba4599 HTTP/1.1" 200 None 2026-03-11 20:29:25,095 - lava_callback - DEBUG - Processing node 69b1cf63a26b422765ba4599: baseline-arm64 2026-03-11 20:29:25,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:29:25,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:29:25,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1cf63a26b422765ba4599/log.txt.gz 2026-03-11 20:29:25,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:29:26,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:29:26,145 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1cf63a26b422765ba4599/lava-logs.yaml 2026-03-11 20:29:26,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:29:26,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:29:26,320 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1cf63a26b422765ba4599/lava_callback.json.gz DEBUG: Setup failed for 69b1cf63a26b422765ba4599. Transitting job node result: incomplete -> fail 2026-03-11 20:29:26,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:29:26,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cf63a26b422765ba4599 HTTP/1.1" 200 None 2026-03-11 20:29:26,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:29:26,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 20:29:26,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:29:26,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1cf63a26b422765ba4599 HTTP/1.1" 200 None INFO: 172.19.0.1:56428 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:29:26,533 - lava_callback - INFO - Completed processing callback for node 69b1cf63a26b422765ba4599 INFO: 172.19.0.1:58726 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:29:38,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:29:38,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49852 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:31:51,513 - lava_callback - INFO - Received callback for node 69af2e33ce46d8ec186ad168 INFO: 172.19.0.1:46216 - "POST /node/69af2e33ce46d8ec186ad168 HTTP/1.0" 202 Accepted 2026-03-11 20:31:51,518 - lava_callback - INFO - Starting async job submit for node 69af2e33ce46d8ec186ad168 2026-03-11 20:31:51,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:31:51,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2e33ce46d8ec186ad168 HTTP/1.1" 200 None 2026-03-11 20:31:51,534 - lava_callback - DEBUG - Processing node 69af2e33ce46d8ec186ad168: baseline-arm-clabbe 2026-03-11 20:31:51,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af2e33ce46d8ec186ad168 2026-03-11 20:31:51,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:31:51,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2e33ce46d8ec186ad168 HTTP/1.1" 200 None 2026-03-11 20:31:51,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:31:51,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 20:31:51,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:31:51,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af2e33ce46d8ec186ad168 HTTP/1.1" 200 None 2026-03-11 20:31:51,587 - lava_callback - ERROR - Error processing callback for node 69af2e33ce46d8ec186ad168: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48146 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:33:51,519 - lava_callback - INFO - Received callback for node 69af2ea6ce46d8ec186ad185 INFO: 172.19.0.1:51254 - "POST /node/69af2ea6ce46d8ec186ad185 HTTP/1.0" 202 Accepted 2026-03-11 20:33:51,525 - lava_callback - INFO - Starting async job submit for node 69af2ea6ce46d8ec186ad185 2026-03-11 20:33:51,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:33:51,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2ea6ce46d8ec186ad185 HTTP/1.1" 200 None 2026-03-11 20:33:51,543 - lava_callback - DEBUG - Processing node 69af2ea6ce46d8ec186ad185: baseline-arm-clabbe 2026-03-11 20:33:51,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af2ea6ce46d8ec186ad185 2026-03-11 20:33:51,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:33:51,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af2ea6ce46d8ec186ad185 HTTP/1.1" 200 None 2026-03-11 20:33:51,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:33:51,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 20:33:51,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:33:51,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af2ea6ce46d8ec186ad185 HTTP/1.1" 200 None 2026-03-11 20:33:51,613 - lava_callback - ERROR - Error processing callback for node 69af2ea6ce46d8ec186ad185: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45656 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:34:20,130 - lava_callback - INFO - Received callback for node 69b1cdb4a26b422765ba452d INFO: 172.19.0.1:51778 - "POST /node/69b1cdb4a26b422765ba452d HTTP/1.0" 202 Accepted 2026-03-11 20:34:20,136 - lava_callback - INFO - Starting async job submit for node 69b1cdb4a26b422765ba452d 2026-03-11 20:34:20,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:34:20,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cdb4a26b422765ba452d HTTP/1.1" 200 None 2026-03-11 20:34:20,209 - lava_callback - DEBUG - Processing node 69b1cdb4a26b422765ba452d: ltp-smoke 2026-03-11 20:34:20,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:34:20,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:34:20,864 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1cdb4a26b422765ba452d/log.txt.gz 2026-03-11 20:34:21,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:34:21,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:34:21,425 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1cdb4a26b422765ba452d/lava-logs.yaml 2026-03-11 20:34:21,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:34:21,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:34:21,645 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1cdb4a26b422765ba452d/lava_callback.json.gz 2026-03-11 20:34:21,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:34:21,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cdb4a26b422765ba452d HTTP/1.1" 200 None 2026-03-11 20:34:21,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:34:21,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195ffa26b422765ba370e HTTP/1.1" 200 None 2026-03-11 20:34:21,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:34:21,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1cdb4a26b422765ba452d HTTP/1.1" 200 None 2026-03-11 20:34:21,932 - lava_callback - INFO - Completed processing callback for node 69b1cdb4a26b422765ba452d INFO: 172.19.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36346 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:34:38,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:34:38,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:37136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39492 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:35:35,731 - lava_callback - INFO - Received callback for node 69b1cd70a26b422765ba4520 INFO: 172.19.0.1:46192 - "POST /node/69b1cd70a26b422765ba4520 HTTP/1.0" 202 Accepted 2026-03-11 20:35:35,739 - lava_callback - INFO - Starting async job submit for node 69b1cd70a26b422765ba4520 2026-03-11 20:35:35,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:35:35,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cd70a26b422765ba4520 HTTP/1.1" 200 None 2026-03-11 20:35:35,827 - lava_callback - DEBUG - Processing node 69b1cd70a26b422765ba4520: baseline-nfs-arm64 INFO: 172.19.0.1:46204 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:35:36,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:35:37,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:35:37,076 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1cd70a26b422765ba4520/log.txt.gz 2026-03-11 20:35:37,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:35:37,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:35:37,914 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1cd70a26b422765ba4520/lava-logs.yaml 2026-03-11 20:35:37,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:35:38,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:35:38,141 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1cd70a26b422765ba4520/lava_callback.json.gz DEBUG: Setup failed for 69b1cd70a26b422765ba4520. Transitting job node result: incomplete -> fail 2026-03-11 20:35:38,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:35:38,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1cd70a26b422765ba4520 HTTP/1.1" 200 None 2026-03-11 20:35:38,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:35:38,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 20:35:38,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:35:38,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1cd70a26b422765ba4520 HTTP/1.1" 200 None 2026-03-11 20:35:38,388 - lava_callback - INFO - Completed processing callback for node 69b1cd70a26b422765ba4520 2026-03-11 20:35:38,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:35:38,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39384 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 20:48:15,438 - lava_callback - INFO - Received callback for node 69b1bfefa26b422765ba3f13 INFO: 172.19.0.1:39400 - "POST /node/69b1bfefa26b422765ba3f13 HTTP/1.0" 202 Accepted 2026-03-11 20:48:15,444 - lava_callback - INFO - Starting async job submit for node 69b1bfefa26b422765ba3f13 2026-03-11 20:48:15,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:48:15,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bfefa26b422765ba3f13 HTTP/1.1" 200 None 2026-03-11 20:48:15,476 - lava_callback - DEBUG - Processing node 69b1bfefa26b422765ba3f13: baseline-arm64 2026-03-11 20:48:15,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:48:15,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:48:15,999 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfefa26b422765ba3f13/log.txt.gz 2026-03-11 20:48:16,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:48:16,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:48:16,430 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfefa26b422765ba3f13/lava-logs.yaml 2026-03-11 20:48:16,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:39404 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:48:16,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:48:16,591 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1bfefa26b422765ba3f13/lava_callback.json.gz 2026-03-11 20:48:16,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:48:16,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bfefa26b422765ba3f13 HTTP/1.1" 200 None 2026-03-11 20:48:16,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:48:16,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 20:48:16,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:48:16,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bfefa26b422765ba3f13 HTTP/1.1" 200 None 2026-03-11 20:48:16,678 - lava_callback - INFO - Completed processing callback for node 69b1bfefa26b422765ba3f13 INFO: 172.19.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41014 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40204 - "GET /.well-known/security.txt HTTP/1.0" 404 Not Found 2026-03-11 20:48:38,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:48:38,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44682 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 20:49:15,237 - lava_callback - INFO - Received callback for node 69af3236ce46d8ec186ad22d INFO: 172.19.0.1:44684 - "POST /node/69af3236ce46d8ec186ad22d HTTP/1.0" 202 Accepted 2026-03-11 20:49:15,242 - lava_callback - INFO - Starting async job submit for node 69af3236ce46d8ec186ad22d 2026-03-11 20:49:15,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:49:15,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3236ce46d8ec186ad22d HTTP/1.1" 200 None 2026-03-11 20:49:15,258 - lava_callback - DEBUG - Processing node 69af3236ce46d8ec186ad22d: baseline-arm64-baylibre 2026-03-11 20:49:15,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3236ce46d8ec186ad22d 2026-03-11 20:49:15,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:49:15,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3236ce46d8ec186ad22d HTTP/1.1" 200 None 2026-03-11 20:49:15,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:49:15,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 20:49:15,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:49:15,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3236ce46d8ec186ad22d HTTP/1.1" 200 None 2026-03-11 20:49:15,354 - lava_callback - ERROR - Error processing callback for node 69af3236ce46d8ec186ad22d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44108 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:50:23,165 - lava_callback - INFO - Received callback for node 69b1bfffa26b422765ba3f48 INFO: 172.19.0.1:43126 - "POST /node/69b1bfffa26b422765ba3f48 HTTP/1.0" 202 Accepted 2026-03-11 20:50:23,175 - lava_callback - INFO - Starting async job submit for node 69b1bfffa26b422765ba3f48 2026-03-11 20:50:23,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:50:23,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bfffa26b422765ba3f48 HTTP/1.1" 200 None 2026-03-11 20:50:23,212 - lava_callback - DEBUG - Processing node 69b1bfffa26b422765ba3f48: baseline-nfs-arm64 2026-03-11 20:50:23,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:50:23,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:50:23,787 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1bfffa26b422765ba3f48/log.txt.gz 2026-03-11 20:50:24,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:50:25,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:50:25,304 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1bfffa26b422765ba3f48/lava-logs.yaml 2026-03-11 20:50:25,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:50:25,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:50:25,476 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1bfffa26b422765ba3f48/lava_callback.json.gz 2026-03-11 20:50:25,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:50:25,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1bfffa26b422765ba3f48 HTTP/1.1" 200 None 2026-03-11 20:50:25,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:50:25,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 20:50:25,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:50:25,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1bfffa26b422765ba3f48 HTTP/1.1" 200 None 2026-03-11 20:50:25,557 - lava_callback - INFO - Completed processing callback for node 69b1bfffa26b422765ba3f48 INFO: 172.19.0.1:43128 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:50:34,717 - lava_callback - INFO - Received callback for node 69af3286ce46d8ec186ad23d INFO: 172.19.0.1:41814 - "POST /node/69af3286ce46d8ec186ad23d HTTP/1.0" 202 Accepted 2026-03-11 20:50:34,723 - lava_callback - INFO - Starting async job submit for node 69af3286ce46d8ec186ad23d 2026-03-11 20:50:34,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:50:34,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3286ce46d8ec186ad23d HTTP/1.1" 200 None 2026-03-11 20:50:34,740 - lava_callback - DEBUG - Processing node 69af3286ce46d8ec186ad23d: baseline-arm64-baylibre 2026-03-11 20:50:34,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3286ce46d8ec186ad23d 2026-03-11 20:50:34,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:50:34,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3286ce46d8ec186ad23d HTTP/1.1" 200 None 2026-03-11 20:50:34,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:50:34,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 20:50:34,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:50:34,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3286ce46d8ec186ad23d HTTP/1.1" 200 None 2026-03-11 20:50:34,797 - lava_callback - ERROR - Error processing callback for node 69af3286ce46d8ec186ad23d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41818 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:50:38,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:50:38,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:34370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35472 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:51:54,784 - lava_callback - INFO - Received callback for node 69af32d6ce46d8ec186ad246 INFO: 172.19.0.1:37500 - "POST /node/69af32d6ce46d8ec186ad246 HTTP/1.0" 202 Accepted 2026-03-11 20:51:54,790 - lava_callback - INFO - Starting async job submit for node 69af32d6ce46d8ec186ad246 2026-03-11 20:51:54,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:51:54,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af32d6ce46d8ec186ad246 HTTP/1.1" 200 None 2026-03-11 20:51:54,807 - lava_callback - DEBUG - Processing node 69af32d6ce46d8ec186ad246: baseline-arm64-baylibre 2026-03-11 20:51:54,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af32d6ce46d8ec186ad246 2026-03-11 20:51:54,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:51:54,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af32d6ce46d8ec186ad246 HTTP/1.1" 200 None 2026-03-11 20:51:54,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:51:54,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 20:51:54,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:51:54,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af32d6ce46d8ec186ad246 HTTP/1.1" 200 None 2026-03-11 20:51:54,865 - lava_callback - ERROR - Error processing callback for node 69af32d6ce46d8ec186ad246: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37506 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:52:01,830 - lava_callback - INFO - Received callback for node 69b1d1cfa26b422765ba45b6 INFO: 172.19.0.1:35904 - "POST /node/69b1d1cfa26b422765ba45b6 HTTP/1.0" 202 Accepted 2026-03-11 20:52:01,837 - lava_callback - INFO - Starting async job submit for node 69b1d1cfa26b422765ba45b6 2026-03-11 20:52:01,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:52:01,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d1cfa26b422765ba45b6 HTTP/1.1" 200 None 2026-03-11 20:52:01,915 - lava_callback - DEBUG - Processing node 69b1d1cfa26b422765ba45b6: ltp-smoke 2026-03-11 20:52:02,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:52:02,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:52:02,564 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1d1cfa26b422765ba45b6/log.txt.gz 2026-03-11 20:52:02,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:52:03,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:52:03,075 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1d1cfa26b422765ba45b6/lava-logs.yaml 2026-03-11 20:52:03,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:52:03,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:52:03,262 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1d1cfa26b422765ba45b6/lava_callback.json.gz 2026-03-11 20:52:03,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:52:03,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d1cfa26b422765ba45b6 HTTP/1.1" 200 None 2026-03-11 20:52:03,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:52:03,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195ffa26b422765ba370e HTTP/1.1" 200 None 2026-03-11 20:52:03,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:52:03,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d1cfa26b422765ba45b6 HTTP/1.1" 200 None 2026-03-11 20:52:03,586 - lava_callback - INFO - Completed processing callback for node 69b1d1cfa26b422765ba45b6 INFO: 172.19.0.1:35916 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:52:08,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:52:08,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:46392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53484 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:53:14,837 - lava_callback - INFO - Received callback for node 69af3328ce46d8ec186ad24f INFO: 172.19.0.1:35610 - "POST /node/69af3328ce46d8ec186ad24f HTTP/1.0" 202 Accepted 2026-03-11 20:53:14,843 - lava_callback - INFO - Starting async job submit for node 69af3328ce46d8ec186ad24f 2026-03-11 20:53:14,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:53:14,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3328ce46d8ec186ad24f HTTP/1.1" 200 None 2026-03-11 20:53:14,860 - lava_callback - DEBUG - Processing node 69af3328ce46d8ec186ad24f: baseline-arm64-baylibre 2026-03-11 20:53:14,860 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3328ce46d8ec186ad24f 2026-03-11 20:53:14,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:53:14,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3328ce46d8ec186ad24f HTTP/1.1" 200 None 2026-03-11 20:53:14,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:53:14,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 20:53:14,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:53:14,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3328ce46d8ec186ad24f HTTP/1.1" 200 None 2026-03-11 20:53:14,923 - lava_callback - ERROR - Error processing callback for node 69af3328ce46d8ec186ad24f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39888 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:39900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50268 - "GET /wiki HTTP/1.0" 404 Not Found INFO: 172.19.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47724 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:54:35,173 - lava_callback - INFO - Received callback for node 69af3378ce46d8ec186ad25d INFO: 172.19.0.1:56490 - "POST /node/69af3378ce46d8ec186ad25d HTTP/1.0" 202 Accepted 2026-03-11 20:54:35,178 - lava_callback - INFO - Starting async job submit for node 69af3378ce46d8ec186ad25d 2026-03-11 20:54:35,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:54:35,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3378ce46d8ec186ad25d HTTP/1.1" 200 None 2026-03-11 20:54:35,227 - lava_callback - DEBUG - Processing node 69af3378ce46d8ec186ad25d: baseline-arm64-baylibre 2026-03-11 20:54:35,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3378ce46d8ec186ad25d 2026-03-11 20:54:35,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:54:35,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3378ce46d8ec186ad25d HTTP/1.1" 200 None 2026-03-11 20:54:35,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:54:35,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 20:54:35,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:54:35,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3378ce46d8ec186ad25d HTTP/1.1" 200 None 2026-03-11 20:54:35,283 - lava_callback - ERROR - Error processing callback for node 69af3378ce46d8ec186ad25d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58480 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:55:36,029 - lava_callback - INFO - Received callback for node 69b1d223a26b422765ba45c6 INFO: 172.19.0.1:34098 - "POST /node/69b1d223a26b422765ba45c6 HTTP/1.0" 202 Accepted 2026-03-11 20:55:36,037 - lava_callback - INFO - Starting async job submit for node 69b1d223a26b422765ba45c6 2026-03-11 20:55:36,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:55:36,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d223a26b422765ba45c6 HTTP/1.1" 200 None 2026-03-11 20:55:36,109 - lava_callback - DEBUG - Processing node 69b1d223a26b422765ba45c6: baseline-nfs-arm64 INFO: 172.19.0.1:34106 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:55:37,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:55:37,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:55:37,352 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1d223a26b422765ba45c6/log.txt.gz 2026-03-11 20:55:37,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:55:38,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:55:38,185 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1d223a26b422765ba45c6/lava-logs.yaml 2026-03-11 20:55:38,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 20:55:38,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 20:55:38,411 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1d223a26b422765ba45c6/lava_callback.json.gz DEBUG: Setup failed for 69b1d223a26b422765ba45c6. Transitting job node result: incomplete -> fail 2026-03-11 20:55:38,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:55:38,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d223a26b422765ba45c6 HTTP/1.1" 200 None 2026-03-11 20:55:38,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:55:38,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 20:55:38,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:55:38,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d223a26b422765ba45c6 HTTP/1.1" 200 None 2026-03-11 20:55:38,650 - lava_callback - INFO - Completed processing callback for node 69b1d223a26b422765ba45c6 INFO: 172.19.0.1:40280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40292 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:55:55,114 - lava_callback - INFO - Received callback for node 69af33c6ce46d8ec186ad26a INFO: 172.19.0.1:46894 - "POST /node/69af33c6ce46d8ec186ad26a HTTP/1.0" 202 Accepted 2026-03-11 20:55:55,120 - lava_callback - INFO - Starting async job submit for node 69af33c6ce46d8ec186ad26a 2026-03-11 20:55:55,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:55:55,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af33c6ce46d8ec186ad26a HTTP/1.1" 200 None 2026-03-11 20:55:55,136 - lava_callback - DEBUG - Processing node 69af33c6ce46d8ec186ad26a: baseline-arm64-baylibre 2026-03-11 20:55:55,136 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af33c6ce46d8ec186ad26a 2026-03-11 20:55:55,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:55:55,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af33c6ce46d8ec186ad26a HTTP/1.1" 200 None 2026-03-11 20:55:55,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:55:55,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 20:55:55,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:55:55,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af33c6ce46d8ec186ad26a HTTP/1.1" 200 None 2026-03-11 20:55:55,195 - lava_callback - ERROR - Error processing callback for node 69af33c6ce46d8ec186ad26a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35684 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:56:08,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:56:08,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:47156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53420 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:58:32,562 - lava_callback - INFO - Received callback for node 69af3463ce46d8ec186ad283 INFO: 172.19.0.1:56774 - "POST /node/69af3463ce46d8ec186ad283 HTTP/1.0" 202 Accepted 2026-03-11 20:58:32,568 - lava_callback - INFO - Starting async job submit for node 69af3463ce46d8ec186ad283 2026-03-11 20:58:32,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:58:32,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3463ce46d8ec186ad283 HTTP/1.1" 200 None 2026-03-11 20:58:32,584 - lava_callback - DEBUG - Processing node 69af3463ce46d8ec186ad283: baseline-arm64-clabbe 2026-03-11 20:58:32,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3463ce46d8ec186ad283 2026-03-11 20:58:32,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:58:32,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3463ce46d8ec186ad283 HTTP/1.1" 200 None 2026-03-11 20:58:32,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:58:32,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 20:58:32,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:58:32,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3463ce46d8ec186ad283 HTTP/1.1" 200 None 2026-03-11 20:58:32,651 - lava_callback - ERROR - Error processing callback for node 69af3463ce46d8ec186ad283: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33004 - "GET / HTTP/1.0" 200 OK 2026-03-11 20:59:32,584 - lava_callback - INFO - Received callback for node 69af34afce46d8ec186ad295 INFO: 172.19.0.1:60178 - "POST /node/69af34afce46d8ec186ad295 HTTP/1.0" 202 Accepted 2026-03-11 20:59:32,590 - lava_callback - INFO - Starting async job submit for node 69af34afce46d8ec186ad295 2026-03-11 20:59:32,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:59:32,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af34afce46d8ec186ad295 HTTP/1.1" 200 None 2026-03-11 20:59:32,606 - lava_callback - DEBUG - Processing node 69af34afce46d8ec186ad295: baseline-arm64-clabbe 2026-03-11 20:59:32,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af34afce46d8ec186ad295 2026-03-11 20:59:32,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:59:32,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af34afce46d8ec186ad295 HTTP/1.1" 200 None 2026-03-11 20:59:32,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:59:32,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 20:59:32,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 20:59:32,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af34afce46d8ec186ad295 HTTP/1.1" 200 None 2026-03-11 20:59:32,661 - lava_callback - ERROR - Error processing callback for node 69af34afce46d8ec186ad295: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60364 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:00:52,642 - lava_callback - INFO - Received callback for node 69af34fcce46d8ec186ad2a6 INFO: 172.19.0.1:51734 - "POST /node/69af34fcce46d8ec186ad2a6 HTTP/1.0" 202 Accepted 2026-03-11 21:00:52,647 - lava_callback - INFO - Starting async job submit for node 69af34fcce46d8ec186ad2a6 2026-03-11 21:00:52,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:00:52,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af34fcce46d8ec186ad2a6 HTTP/1.1" 200 None 2026-03-11 21:00:52,667 - lava_callback - DEBUG - Processing node 69af34fcce46d8ec186ad2a6: baseline-arm64-clabbe 2026-03-11 21:00:52,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af34fcce46d8ec186ad2a6 2026-03-11 21:00:52,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:00:52,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af34fcce46d8ec186ad2a6 HTTP/1.1" 200 None 2026-03-11 21:00:52,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:00:52,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 21:00:52,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:00:52,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af34fcce46d8ec186ad2a6 HTTP/1.1" 200 None 2026-03-11 21:00:52,729 - lava_callback - ERROR - Error processing callback for node 69af34fcce46d8ec186ad2a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60888 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:02:12,683 - lava_callback - INFO - Received callback for node 69af3549ce46d8ec186ad2ae INFO: 172.19.0.1:43110 - "POST /node/69af3549ce46d8ec186ad2ae HTTP/1.0" 202 Accepted 2026-03-11 21:02:12,688 - lava_callback - INFO - Starting async job submit for node 69af3549ce46d8ec186ad2ae 2026-03-11 21:02:12,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:02:12,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3549ce46d8ec186ad2ae HTTP/1.1" 200 None 2026-03-11 21:02:12,705 - lava_callback - DEBUG - Processing node 69af3549ce46d8ec186ad2ae: baseline-arm64-clabbe 2026-03-11 21:02:12,705 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3549ce46d8ec186ad2ae 2026-03-11 21:02:12,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:02:12,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3549ce46d8ec186ad2ae HTTP/1.1" 200 None 2026-03-11 21:02:12,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:02:12,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 21:02:12,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:02:12,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3549ce46d8ec186ad2ae HTTP/1.1" 200 None 2026-03-11 21:02:12,770 - lava_callback - ERROR - Error processing callback for node 69af3549ce46d8ec186ad2ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47912 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:03:32,732 - lava_callback - INFO - Received callback for node 69af3593ce46d8ec186ad2bb INFO: 172.19.0.1:47050 - "POST /node/69af3593ce46d8ec186ad2bb HTTP/1.0" 202 Accepted 2026-03-11 21:03:32,737 - lava_callback - INFO - Starting async job submit for node 69af3593ce46d8ec186ad2bb 2026-03-11 21:03:32,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:03:32,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3593ce46d8ec186ad2bb HTTP/1.1" 200 None 2026-03-11 21:03:32,754 - lava_callback - DEBUG - Processing node 69af3593ce46d8ec186ad2bb: baseline-arm64-clabbe 2026-03-11 21:03:32,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3593ce46d8ec186ad2bb 2026-03-11 21:03:32,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:03:32,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3593ce46d8ec186ad2bb HTTP/1.1" 200 None 2026-03-11 21:03:32,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:03:32,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 21:03:32,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:03:32,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3593ce46d8ec186ad2bb HTTP/1.1" 200 None 2026-03-11 21:03:32,840 - lava_callback - ERROR - Error processing callback for node 69af3593ce46d8ec186ad2bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41582 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:04:52,800 - lava_callback - INFO - Received callback for node 69af35dfce46d8ec186ad2c1 INFO: 172.19.0.1:42290 - "POST /node/69af35dfce46d8ec186ad2c1 HTTP/1.0" 202 Accepted 2026-03-11 21:04:52,805 - lava_callback - INFO - Starting async job submit for node 69af35dfce46d8ec186ad2c1 2026-03-11 21:04:52,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:04:52,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af35dfce46d8ec186ad2c1 HTTP/1.1" 200 None 2026-03-11 21:04:52,823 - lava_callback - DEBUG - Processing node 69af35dfce46d8ec186ad2c1: baseline-arm64-clabbe 2026-03-11 21:04:52,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af35dfce46d8ec186ad2c1 2026-03-11 21:04:52,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:04:52,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af35dfce46d8ec186ad2c1 HTTP/1.1" 200 None 2026-03-11 21:04:52,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:04:52,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 21:04:52,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:04:52,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af35dfce46d8ec186ad2c1 HTTP/1.1" 200 None 2026-03-11 21:04:52,918 - lava_callback - ERROR - Error processing callback for node 69af35dfce46d8ec186ad2c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39968 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:13:41,683 - lava_callback - INFO - Received callback for node 69b1d6dda26b422765ba467e INFO: 172.19.0.1:41456 - "POST /node/69b1d6dda26b422765ba467e HTTP/1.0" 202 Accepted 2026-03-11 21:13:41,690 - lava_callback - INFO - Starting async job submit for node 69b1d6dda26b422765ba467e 2026-03-11 21:13:41,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:13:41,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d6dda26b422765ba467e HTTP/1.1" 200 None 2026-03-11 21:13:41,762 - lava_callback - DEBUG - Processing node 69b1d6dda26b422765ba467e: ltp-smoke 2026-03-11 21:13:42,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 21:13:42,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 21:13:42,427 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1d6dda26b422765ba467e/log.txt.gz 2026-03-11 21:13:42,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 21:13:42,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 21:13:42,955 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1d6dda26b422765ba467e/lava-logs.yaml 2026-03-11 21:13:42,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 21:13:43,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 21:13:43,168 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1d6dda26b422765ba467e/lava_callback.json.gz 2026-03-11 21:13:43,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:13:43,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d6dda26b422765ba467e HTTP/1.1" 200 None 2026-03-11 21:13:43,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:13:43,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b195ffa26b422765ba370e HTTP/1.1" 200 None 2026-03-11 21:13:43,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:13:43,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d6dda26b422765ba467e HTTP/1.1" 200 None INFO: 172.19.0.1:41464 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:13:43,485 - lava_callback - INFO - Completed processing callback for node 69b1d6dda26b422765ba467e INFO: 172.19.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48998 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:14:08,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:14:08,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45722 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:18:36,070 - lava_callback - INFO - Received callback for node 69b1d790a26b422765ba4699 INFO: 172.19.0.1:53606 - "POST /node/69b1d790a26b422765ba4699 HTTP/1.0" 202 Accepted 2026-03-11 21:18:36,078 - lava_callback - INFO - Starting async job submit for node 69b1d790a26b422765ba4699 2026-03-11 21:18:36,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:18:36,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d790a26b422765ba4699 HTTP/1.1" 200 None 2026-03-11 21:18:36,136 - lava_callback - DEBUG - Processing node 69b1d790a26b422765ba4699: baseline-nfs-arm64 2026-03-11 21:18:36,341 - lava_callback - INFO - Received callback for node 69af3929ce46d8ec186ad33f INFO: 172.19.0.1:53616 - "POST /node/69af3929ce46d8ec186ad33f HTTP/1.0" 202 Accepted 2026-03-11 21:18:36,367 - lava_callback - INFO - Starting async job submit for node 69af3929ce46d8ec186ad33f 2026-03-11 21:18:36,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:18:36,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3929ce46d8ec186ad33f HTTP/1.1" 200 None 2026-03-11 21:18:36,476 - lava_callback - DEBUG - Processing node 69af3929ce46d8ec186ad33f: baseline-arm64-baylibre 2026-03-11 21:18:36,476 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3929ce46d8ec186ad33f 2026-03-11 21:18:36,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:53624 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:18:36,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3929ce46d8ec186ad33f HTTP/1.1" 200 None 2026-03-11 21:18:36,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:18:36,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 21:18:36,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:18:36,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3929ce46d8ec186ad33f HTTP/1.1" 200 None 2026-03-11 21:18:36,792 - lava_callback - ERROR - Error processing callback for node 69af3929ce46d8ec186ad33f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 21:18:37,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 21:18:37,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 21:18:37,522 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1d790a26b422765ba4699/log.txt.gz 2026-03-11 21:18:38,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 21:18:38,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 21:18:38,331 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1d790a26b422765ba4699/lava-logs.yaml 2026-03-11 21:18:38,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 21:18:38,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 21:18:38,534 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b1d790a26b422765ba4699/lava_callback.json.gz DEBUG: Setup failed for 69b1d790a26b422765ba4699. Transitting job node result: incomplete -> fail 2026-03-11 21:18:38,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:18:38,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1d790a26b422765ba4699 HTTP/1.1" 200 None 2026-03-11 21:18:38,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:18:38,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 21:18:38,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:18:38,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1d790a26b422765ba4699 HTTP/1.1" 200 None 2026-03-11 21:18:38,775 - lava_callback - INFO - Completed processing callback for node 69b1d790a26b422765ba4699 INFO: 172.19.0.1:47860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48158 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:19:08,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:19:08,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:45702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36712 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:19:56,339 - lava_callback - INFO - Received callback for node 69af3978ce46d8ec186ad352 INFO: 172.19.0.1:48758 - "POST /node/69af3978ce46d8ec186ad352 HTTP/1.0" 202 Accepted 2026-03-11 21:19:56,345 - lava_callback - INFO - Starting async job submit for node 69af3978ce46d8ec186ad352 2026-03-11 21:19:56,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:19:56,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3978ce46d8ec186ad352 HTTP/1.1" 200 None 2026-03-11 21:19:56,362 - lava_callback - DEBUG - Processing node 69af3978ce46d8ec186ad352: baseline-arm64-baylibre 2026-03-11 21:19:56,362 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3978ce46d8ec186ad352 2026-03-11 21:19:56,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:19:56,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3978ce46d8ec186ad352 HTTP/1.1" 200 None 2026-03-11 21:19:56,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:19:56,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 21:19:56,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:19:56,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3978ce46d8ec186ad352 HTTP/1.1" 200 None 2026-03-11 21:19:56,426 - lava_callback - ERROR - Error processing callback for node 69af3978ce46d8ec186ad352: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59620 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 21:21:16,379 - lava_callback - INFO - Received callback for node 69af39c8ce46d8ec186ad360 INFO: 172.19.0.1:59622 - "POST /node/69af39c8ce46d8ec186ad360 HTTP/1.0" 202 Accepted 2026-03-11 21:21:16,384 - lava_callback - INFO - Starting async job submit for node 69af39c8ce46d8ec186ad360 2026-03-11 21:21:16,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:21:16,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af39c8ce46d8ec186ad360 HTTP/1.1" 200 None 2026-03-11 21:21:16,400 - lava_callback - DEBUG - Processing node 69af39c8ce46d8ec186ad360: baseline-arm64-baylibre 2026-03-11 21:21:16,400 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af39c8ce46d8ec186ad360 2026-03-11 21:21:16,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:21:16,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af39c8ce46d8ec186ad360 HTTP/1.1" 200 None 2026-03-11 21:21:16,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:21:16,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 21:21:16,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:21:16,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af39c8ce46d8ec186ad360 HTTP/1.1" 200 None 2026-03-11 21:21:16,456 - lava_callback - ERROR - Error processing callback for node 69af39c8ce46d8ec186ad360: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56660 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:22:36,629 - lava_callback - INFO - Received callback for node 69af3a19ce46d8ec186ad36e INFO: 172.19.0.1:56662 - "POST /node/69af3a19ce46d8ec186ad36e HTTP/1.0" 202 Accepted 2026-03-11 21:22:36,635 - lava_callback - INFO - Starting async job submit for node 69af3a19ce46d8ec186ad36e 2026-03-11 21:22:36,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:22:36,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3a19ce46d8ec186ad36e HTTP/1.1" 200 None 2026-03-11 21:22:36,650 - lava_callback - DEBUG - Processing node 69af3a19ce46d8ec186ad36e: baseline-arm64-baylibre 2026-03-11 21:22:36,650 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3a19ce46d8ec186ad36e 2026-03-11 21:22:36,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:22:36,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3a19ce46d8ec186ad36e HTTP/1.1" 200 None 2026-03-11 21:22:36,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:22:36,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 21:22:36,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:22:36,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3a19ce46d8ec186ad36e HTTP/1.1" 200 None 2026-03-11 21:22:36,712 - lava_callback - ERROR - Error processing callback for node 69af3a19ce46d8ec186ad36e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47574 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:23:56,813 - lava_callback - INFO - Received callback for node 69af3a69ce46d8ec186ad38a INFO: 172.19.0.1:47580 - "POST /node/69af3a69ce46d8ec186ad38a HTTP/1.0" 202 Accepted 2026-03-11 21:23:56,819 - lava_callback - INFO - Starting async job submit for node 69af3a69ce46d8ec186ad38a 2026-03-11 21:23:56,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:23:56,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3a69ce46d8ec186ad38a HTTP/1.1" 200 None 2026-03-11 21:23:56,835 - lava_callback - DEBUG - Processing node 69af3a69ce46d8ec186ad38a: baseline-arm64-baylibre 2026-03-11 21:23:56,835 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3a69ce46d8ec186ad38a 2026-03-11 21:23:56,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:23:56,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3a69ce46d8ec186ad38a HTTP/1.1" 200 None 2026-03-11 21:23:56,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:23:56,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 21:23:56,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:23:56,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3a69ce46d8ec186ad38a HTTP/1.1" 200 None 2026-03-11 21:23:56,930 - lava_callback - ERROR - Error processing callback for node 69af3a69ce46d8ec186ad38a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54472 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:25:33,772 - lava_callback - INFO - Received callback for node 69af3ac0ce46d8ec186ad396 INFO: 172.19.0.1:51484 - "POST /node/69af3ac0ce46d8ec186ad396 HTTP/1.0" 202 Accepted 2026-03-11 21:25:33,777 - lava_callback - INFO - Starting async job submit for node 69af3ac0ce46d8ec186ad396 2026-03-11 21:25:33,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:25:33,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3ac0ce46d8ec186ad396 HTTP/1.1" 200 None 2026-03-11 21:25:33,803 - lava_callback - DEBUG - Processing node 69af3ac0ce46d8ec186ad396: baseline-arm64-clabbe 2026-03-11 21:25:33,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3ac0ce46d8ec186ad396 2026-03-11 21:25:33,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:25:33,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3ac0ce46d8ec186ad396 HTTP/1.1" 200 None 2026-03-11 21:25:33,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:25:33,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 21:25:33,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:25:33,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3ac0ce46d8ec186ad396 HTTP/1.1" 200 None 2026-03-11 21:25:33,868 - lava_callback - ERROR - Error processing callback for node 69af3ac0ce46d8ec186ad396: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53586 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:26:53,777 - lava_callback - INFO - Received callback for node 69af3b0fce46d8ec186ad3a1 INFO: 172.19.0.1:51510 - "POST /node/69af3b0fce46d8ec186ad3a1 HTTP/1.0" 202 Accepted 2026-03-11 21:26:53,783 - lava_callback - INFO - Starting async job submit for node 69af3b0fce46d8ec186ad3a1 2026-03-11 21:26:53,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:26:53,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3b0fce46d8ec186ad3a1 HTTP/1.1" 200 None 2026-03-11 21:26:53,800 - lava_callback - DEBUG - Processing node 69af3b0fce46d8ec186ad3a1: baseline-arm64-clabbe 2026-03-11 21:26:53,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3b0fce46d8ec186ad3a1 2026-03-11 21:26:53,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:26:53,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3b0fce46d8ec186ad3a1 HTTP/1.1" 200 None 2026-03-11 21:26:53,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:26:53,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 21:26:53,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:26:53,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3b0fce46d8ec186ad3a1 HTTP/1.1" 200 None 2026-03-11 21:26:53,860 - lava_callback - ERROR - Error processing callback for node 69af3b0fce46d8ec186ad3a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41492 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:28:13,870 - lava_callback - INFO - Received callback for node 69af3b5fce46d8ec186ad3b8 INFO: 172.19.0.1:46956 - "POST /node/69af3b5fce46d8ec186ad3b8 HTTP/1.0" 202 Accepted 2026-03-11 21:28:13,876 - lava_callback - INFO - Starting async job submit for node 69af3b5fce46d8ec186ad3b8 2026-03-11 21:28:13,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:28:13,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3b5fce46d8ec186ad3b8 HTTP/1.1" 200 None 2026-03-11 21:28:13,895 - lava_callback - DEBUG - Processing node 69af3b5fce46d8ec186ad3b8: baseline-arm64-clabbe 2026-03-11 21:28:13,896 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3b5fce46d8ec186ad3b8 2026-03-11 21:28:13,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:28:13,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3b5fce46d8ec186ad3b8 HTTP/1.1" 200 None 2026-03-11 21:28:13,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:28:13,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 21:28:13,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:28:13,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3b5fce46d8ec186ad3b8 HTTP/1.1" 200 None 2026-03-11 21:28:13,952 - lava_callback - ERROR - Error processing callback for node 69af3b5fce46d8ec186ad3b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39788 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:29:33,942 - lava_callback - INFO - Received callback for node 69af3badce46d8ec186ad3c5 INFO: 172.19.0.1:48756 - "POST /node/69af3badce46d8ec186ad3c5 HTTP/1.0" 202 Accepted 2026-03-11 21:29:33,948 - lava_callback - INFO - Starting async job submit for node 69af3badce46d8ec186ad3c5 2026-03-11 21:29:33,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:29:33,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3badce46d8ec186ad3c5 HTTP/1.1" 200 None 2026-03-11 21:29:33,973 - lava_callback - DEBUG - Processing node 69af3badce46d8ec186ad3c5: baseline-arm64-clabbe 2026-03-11 21:29:33,973 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3badce46d8ec186ad3c5 2026-03-11 21:29:33,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:29:33,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3badce46d8ec186ad3c5 HTTP/1.1" 200 None 2026-03-11 21:29:33,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:29:34,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 21:29:34,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:29:34,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3badce46d8ec186ad3c5 HTTP/1.1" 200 None 2026-03-11 21:29:34,025 - lava_callback - ERROR - Error processing callback for node 69af3badce46d8ec186ad3c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53134 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:30:53,973 - lava_callback - INFO - Received callback for node 69af3bfdce46d8ec186ad3cc INFO: 172.19.0.1:38362 - "POST /node/69af3bfdce46d8ec186ad3cc HTTP/1.0" 202 Accepted 2026-03-11 21:30:53,979 - lava_callback - INFO - Starting async job submit for node 69af3bfdce46d8ec186ad3cc 2026-03-11 21:30:53,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:30:53,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3bfdce46d8ec186ad3cc HTTP/1.1" 200 None 2026-03-11 21:30:53,995 - lava_callback - DEBUG - Processing node 69af3bfdce46d8ec186ad3cc: baseline-arm64-clabbe 2026-03-11 21:30:53,995 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3bfdce46d8ec186ad3cc 2026-03-11 21:30:53,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:30:54,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3bfdce46d8ec186ad3cc HTTP/1.1" 200 None 2026-03-11 21:30:54,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:30:54,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 21:30:54,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:30:54,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3bfdce46d8ec186ad3cc HTTP/1.1" 200 None 2026-03-11 21:30:54,063 - lava_callback - ERROR - Error processing callback for node 69af3bfdce46d8ec186ad3cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35194 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:31:57,303 - lava_callback - INFO - Received callback for node 69af3c39ce46d8ec186ad3dc INFO: 172.19.0.1:35210 - "POST /node/69af3c39ce46d8ec186ad3dc HTTP/1.0" 202 Accepted 2026-03-11 21:31:57,309 - lava_callback - INFO - Starting async job submit for node 69af3c39ce46d8ec186ad3dc 2026-03-11 21:31:57,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:31:57,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3c39ce46d8ec186ad3dc HTTP/1.1" 200 None 2026-03-11 21:31:57,325 - lava_callback - DEBUG - Processing node 69af3c39ce46d8ec186ad3dc: baseline-arm-baylibre 2026-03-11 21:31:57,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3c39ce46d8ec186ad3dc 2026-03-11 21:31:57,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:31:57,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3c39ce46d8ec186ad3dc HTTP/1.1" 200 None 2026-03-11 21:31:57,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:31:57,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 21:31:57,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:31:57,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3c39ce46d8ec186ad3dc HTTP/1.1" 200 None 2026-03-11 21:31:57,378 - lava_callback - ERROR - Error processing callback for node 69af3c39ce46d8ec186ad3dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38460 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:32:17,002 - lava_callback - INFO - Received callback for node 69af3c5dce46d8ec186ad3e8 INFO: 172.19.0.1:38468 - "POST /node/69af3c5dce46d8ec186ad3e8 HTTP/1.0" 202 Accepted 2026-03-11 21:32:17,008 - lava_callback - INFO - Starting async job submit for node 69af3c5dce46d8ec186ad3e8 2026-03-11 21:32:17,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:32:17,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3c5dce46d8ec186ad3e8 HTTP/1.1" 200 None 2026-03-11 21:32:17,054 - lava_callback - DEBUG - Processing node 69af3c5dce46d8ec186ad3e8: baseline-arm-baylibre 2026-03-11 21:32:17,054 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3c5dce46d8ec186ad3e8 2026-03-11 21:32:17,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:32:17,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3c5dce46d8ec186ad3e8 HTTP/1.1" 200 None 2026-03-11 21:32:17,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:32:17,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 21:32:17,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:32:17,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3c5dce46d8ec186ad3e8 HTTP/1.1" 200 None 2026-03-11 21:32:17,119 - lava_callback - ERROR - Error processing callback for node 69af3c5dce46d8ec186ad3e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50960 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:32:57,027 - lava_callback - INFO - Received callback for node 69af3c81ce46d8ec186ad3ef INFO: 172.19.0.1:50964 - "POST /node/69af3c81ce46d8ec186ad3ef HTTP/1.0" 202 Accepted 2026-03-11 21:32:57,033 - lava_callback - INFO - Starting async job submit for node 69af3c81ce46d8ec186ad3ef 2026-03-11 21:32:57,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:32:57,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3c81ce46d8ec186ad3ef HTTP/1.1" 200 None 2026-03-11 21:32:57,049 - lava_callback - DEBUG - Processing node 69af3c81ce46d8ec186ad3ef: baseline-arm-baylibre 2026-03-11 21:32:57,049 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3c81ce46d8ec186ad3ef 2026-03-11 21:32:57,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:32:57,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3c81ce46d8ec186ad3ef HTTP/1.1" 200 None 2026-03-11 21:32:57,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:32:57,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 21:32:57,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:32:57,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3c81ce46d8ec186ad3ef HTTP/1.1" 200 None 2026-03-11 21:32:57,114 - lava_callback - ERROR - Error processing callback for node 69af3c81ce46d8ec186ad3ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44766 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:33:37,125 - lava_callback - INFO - Received callback for node 69af3ca4ce46d8ec186ad3f8 INFO: 172.19.0.1:44776 - "POST /node/69af3ca4ce46d8ec186ad3f8 HTTP/1.0" 202 Accepted 2026-03-11 21:33:37,131 - lava_callback - INFO - Starting async job submit for node 69af3ca4ce46d8ec186ad3f8 2026-03-11 21:33:37,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:33:37,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3ca4ce46d8ec186ad3f8 HTTP/1.1" 200 None 2026-03-11 21:33:37,147 - lava_callback - DEBUG - Processing node 69af3ca4ce46d8ec186ad3f8: baseline-arm-baylibre 2026-03-11 21:33:37,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3ca4ce46d8ec186ad3f8 2026-03-11 21:33:37,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:33:37,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3ca4ce46d8ec186ad3f8 HTTP/1.1" 200 None 2026-03-11 21:33:37,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:33:37,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 21:33:37,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:33:37,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3ca4ce46d8ec186ad3f8 HTTP/1.1" 200 None 2026-03-11 21:33:37,221 - lava_callback - ERROR - Error processing callback for node 69af3ca4ce46d8ec186ad3f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36684 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:34:17,083 - lava_callback - INFO - Received callback for node 69af3cc9ce46d8ec186ad404 INFO: 172.19.0.1:36688 - "POST /node/69af3cc9ce46d8ec186ad404 HTTP/1.0" 202 Accepted 2026-03-11 21:34:17,089 - lava_callback - INFO - Starting async job submit for node 69af3cc9ce46d8ec186ad404 2026-03-11 21:34:17,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:34:17,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3cc9ce46d8ec186ad404 HTTP/1.1" 200 None 2026-03-11 21:34:17,106 - lava_callback - DEBUG - Processing node 69af3cc9ce46d8ec186ad404: baseline-arm-baylibre 2026-03-11 21:34:17,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3cc9ce46d8ec186ad404 2026-03-11 21:34:17,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:34:17,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3cc9ce46d8ec186ad404 HTTP/1.1" 200 None 2026-03-11 21:34:17,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:34:17,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 21:34:17,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:34:17,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3cc9ce46d8ec186ad404 HTTP/1.1" 200 None 2026-03-11 21:34:17,157 - lava_callback - ERROR - Error processing callback for node 69af3cc9ce46d8ec186ad404: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33468 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:35:34,252 - lava_callback - INFO - Received callback for node 69af3d21ce46d8ec186ad41d INFO: 172.19.0.1:33784 - "POST /node/69af3d21ce46d8ec186ad41d HTTP/1.0" 202 Accepted 2026-03-11 21:35:34,258 - lava_callback - INFO - Starting async job submit for node 69af3d21ce46d8ec186ad41d 2026-03-11 21:35:34,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:35:34,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3d21ce46d8ec186ad41d HTTP/1.1" 200 None 2026-03-11 21:35:34,276 - lava_callback - DEBUG - Processing node 69af3d21ce46d8ec186ad41d: baseline-arm64-clabbe 2026-03-11 21:35:34,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3d21ce46d8ec186ad41d 2026-03-11 21:35:34,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:35:34,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3d21ce46d8ec186ad41d HTTP/1.1" 200 None 2026-03-11 21:35:34,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:35:34,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 21:35:34,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:35:34,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3d21ce46d8ec186ad41d HTTP/1.1" 200 None 2026-03-11 21:35:34,352 - lava_callback - ERROR - Error processing callback for node 69af3d21ce46d8ec186ad41d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60380 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:36:54,228 - lava_callback - INFO - Received callback for node 69af3d61ce46d8ec186ad426 INFO: 172.19.0.1:45096 - "POST /node/69af3d61ce46d8ec186ad426 HTTP/1.0" 202 Accepted 2026-03-11 21:36:54,234 - lava_callback - INFO - Starting async job submit for node 69af3d61ce46d8ec186ad426 2026-03-11 21:36:54,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:36:54,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3d61ce46d8ec186ad426 HTTP/1.1" 200 None 2026-03-11 21:36:54,250 - lava_callback - DEBUG - Processing node 69af3d61ce46d8ec186ad426: baseline-arm-clabbe 2026-03-11 21:36:54,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3d61ce46d8ec186ad426 2026-03-11 21:36:54,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:36:54,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3d61ce46d8ec186ad426 HTTP/1.1" 200 None 2026-03-11 21:36:54,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:36:54,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 21:36:54,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:36:54,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3d61ce46d8ec186ad426 HTTP/1.1" 200 None 2026-03-11 21:36:54,358 - lava_callback - ERROR - Error processing callback for node 69af3d61ce46d8ec186ad426: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35062 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:37:14,227 - lava_callback - INFO - Received callback for node 69af3d85ce46d8ec186ad434 INFO: 172.19.0.1:44704 - "POST /node/69af3d85ce46d8ec186ad434 HTTP/1.0" 202 Accepted 2026-03-11 21:37:14,232 - lava_callback - INFO - Starting async job submit for node 69af3d85ce46d8ec186ad434 2026-03-11 21:37:14,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:37:14,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3d85ce46d8ec186ad434 HTTP/1.1" 200 None 2026-03-11 21:37:14,248 - lava_callback - DEBUG - Processing node 69af3d85ce46d8ec186ad434: baseline-arm-clabbe 2026-03-11 21:37:14,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3d85ce46d8ec186ad434 2026-03-11 21:37:14,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:37:14,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3d85ce46d8ec186ad434 HTTP/1.1" 200 None 2026-03-11 21:37:14,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:37:14,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 21:37:14,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:37:14,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3d85ce46d8ec186ad434 HTTP/1.1" 200 None 2026-03-11 21:37:14,299 - lava_callback - ERROR - Error processing callback for node 69af3d85ce46d8ec186ad434: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33764 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:37:54,289 - lava_callback - INFO - Received callback for node 69af3daace46d8ec186ad441 INFO: 172.19.0.1:56878 - "POST /node/69af3daace46d8ec186ad441 HTTP/1.0" 202 Accepted 2026-03-11 21:37:54,295 - lava_callback - INFO - Starting async job submit for node 69af3daace46d8ec186ad441 2026-03-11 21:37:54,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:37:54,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3daace46d8ec186ad441 HTTP/1.1" 200 None 2026-03-11 21:37:54,310 - lava_callback - DEBUG - Processing node 69af3daace46d8ec186ad441: baseline-arm-clabbe 2026-03-11 21:37:54,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3daace46d8ec186ad441 2026-03-11 21:37:54,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:37:54,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3daace46d8ec186ad441 HTTP/1.1" 200 None 2026-03-11 21:37:54,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:37:54,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 21:37:54,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:37:54,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3daace46d8ec186ad441 HTTP/1.1" 200 None 2026-03-11 21:37:54,366 - lava_callback - ERROR - Error processing callback for node 69af3daace46d8ec186ad441: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52128 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:38:37,515 - lava_callback - INFO - Received callback for node 69af3dd4ce46d8ec186ad44c INFO: 172.19.0.1:52130 - "POST /node/69af3dd4ce46d8ec186ad44c HTTP/1.0" 202 Accepted 2026-03-11 21:38:37,520 - lava_callback - INFO - Starting async job submit for node 69af3dd4ce46d8ec186ad44c 2026-03-11 21:38:37,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:38:37,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3dd4ce46d8ec186ad44c HTTP/1.1" 200 None 2026-03-11 21:38:37,536 - lava_callback - DEBUG - Processing node 69af3dd4ce46d8ec186ad44c: baseline-arm64-baylibre 2026-03-11 21:38:37,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3dd4ce46d8ec186ad44c 2026-03-11 21:38:37,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:38:37,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3dd4ce46d8ec186ad44c HTTP/1.1" 200 None 2026-03-11 21:38:37,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:38:37,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a744905a0c0e10c4819cd5 HTTP/1.1" 200 None 2026-03-11 21:38:37,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:38:37,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3dd4ce46d8ec186ad44c HTTP/1.1" 200 None 2026-03-11 21:38:37,613 - lava_callback - ERROR - Error processing callback for node 69af3dd4ce46d8ec186ad44c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37976 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:39:57,512 - lava_callback - INFO - Received callback for node 69af3e22ce46d8ec186ad458 INFO: 172.19.0.1:37984 - "POST /node/69af3e22ce46d8ec186ad458 HTTP/1.0" 202 Accepted 2026-03-11 21:39:57,517 - lava_callback - INFO - Starting async job submit for node 69af3e22ce46d8ec186ad458 2026-03-11 21:39:57,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:39:57,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3e22ce46d8ec186ad458 HTTP/1.1" 200 None 2026-03-11 21:39:57,534 - lava_callback - DEBUG - Processing node 69af3e22ce46d8ec186ad458: baseline-arm64-baylibre 2026-03-11 21:39:57,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3e22ce46d8ec186ad458 2026-03-11 21:39:57,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:39:57,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3e22ce46d8ec186ad458 HTTP/1.1" 200 None 2026-03-11 21:39:57,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:39:57,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a744905a0c0e10c4819cd5 HTTP/1.1" 200 None 2026-03-11 21:39:57,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:39:57,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3e22ce46d8ec186ad458 HTTP/1.1" 200 None 2026-03-11 21:39:57,615 - lava_callback - ERROR - Error processing callback for node 69af3e22ce46d8ec186ad458: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34868 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:41:17,548 - lava_callback - INFO - Received callback for node 69af3e70ce46d8ec186ad45d INFO: 172.19.0.1:34880 - "POST /node/69af3e70ce46d8ec186ad45d HTTP/1.0" 202 Accepted 2026-03-11 21:41:17,554 - lava_callback - INFO - Starting async job submit for node 69af3e70ce46d8ec186ad45d 2026-03-11 21:41:17,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:41:17,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3e70ce46d8ec186ad45d HTTP/1.1" 200 None 2026-03-11 21:41:17,576 - lava_callback - DEBUG - Processing node 69af3e70ce46d8ec186ad45d: baseline-arm64-baylibre 2026-03-11 21:41:17,576 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3e70ce46d8ec186ad45d 2026-03-11 21:41:17,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:41:17,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3e70ce46d8ec186ad45d HTTP/1.1" 200 None 2026-03-11 21:41:17,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:41:17,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a744905a0c0e10c4819cd5 HTTP/1.1" 200 None 2026-03-11 21:41:17,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:41:17,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3e70ce46d8ec186ad45d HTTP/1.1" 200 None 2026-03-11 21:41:17,687 - lava_callback - ERROR - Error processing callback for node 69af3e70ce46d8ec186ad45d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53798 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:42:37,647 - lava_callback - INFO - Received callback for node 69af3ebdce46d8ec186ad46a INFO: 172.19.0.1:53810 - "POST /node/69af3ebdce46d8ec186ad46a HTTP/1.0" 202 Accepted 2026-03-11 21:42:37,653 - lava_callback - INFO - Starting async job submit for node 69af3ebdce46d8ec186ad46a 2026-03-11 21:42:37,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:42:37,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3ebdce46d8ec186ad46a HTTP/1.1" 200 None 2026-03-11 21:42:37,669 - lava_callback - DEBUG - Processing node 69af3ebdce46d8ec186ad46a: baseline-arm64-baylibre 2026-03-11 21:42:37,669 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3ebdce46d8ec186ad46a 2026-03-11 21:42:37,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:42:37,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3ebdce46d8ec186ad46a HTTP/1.1" 200 None 2026-03-11 21:42:37,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:42:37,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 21:42:37,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:42:37,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3ebdce46d8ec186ad46a HTTP/1.1" 200 None 2026-03-11 21:42:37,758 - lava_callback - ERROR - Error processing callback for node 69af3ebdce46d8ec186ad46a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43902 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:43:57,765 - lava_callback - INFO - Received callback for node 69af3f0cce46d8ec186ad46f INFO: 172.19.0.1:43918 - "POST /node/69af3f0cce46d8ec186ad46f HTTP/1.0" 202 Accepted 2026-03-11 21:43:57,771 - lava_callback - INFO - Starting async job submit for node 69af3f0cce46d8ec186ad46f 2026-03-11 21:43:57,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:43:57,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3f0cce46d8ec186ad46f HTTP/1.1" 200 None 2026-03-11 21:43:57,796 - lava_callback - DEBUG - Processing node 69af3f0cce46d8ec186ad46f: baseline-arm64-baylibre 2026-03-11 21:43:57,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3f0cce46d8ec186ad46f 2026-03-11 21:43:57,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:43:57,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3f0cce46d8ec186ad46f HTTP/1.1" 200 None 2026-03-11 21:43:57,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:43:57,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a744905a0c0e10c4819cd5 HTTP/1.1" 200 None 2026-03-11 21:43:57,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:43:57,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3f0cce46d8ec186ad46f HTTP/1.1" 200 None 2026-03-11 21:43:57,857 - lava_callback - ERROR - Error processing callback for node 69af3f0cce46d8ec186ad46f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50698 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:45:17,784 - lava_callback - INFO - Received callback for node 69af3f58ce46d8ec186ad47a INFO: 172.19.0.1:50710 - "POST /node/69af3f58ce46d8ec186ad47a HTTP/1.0" 202 Accepted 2026-03-11 21:45:17,789 - lava_callback - INFO - Starting async job submit for node 69af3f58ce46d8ec186ad47a 2026-03-11 21:45:17,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:45:17,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3f58ce46d8ec186ad47a HTTP/1.1" 200 None 2026-03-11 21:45:17,808 - lava_callback - DEBUG - Processing node 69af3f58ce46d8ec186ad47a: baseline-arm64-baylibre 2026-03-11 21:45:17,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3f58ce46d8ec186ad47a 2026-03-11 21:45:17,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:45:17,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3f58ce46d8ec186ad47a HTTP/1.1" 200 None 2026-03-11 21:45:17,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:45:17,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 21:45:17,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:45:17,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3f58ce46d8ec186ad47a HTTP/1.1" 200 None 2026-03-11 21:45:17,897 - lava_callback - ERROR - Error processing callback for node 69af3f58ce46d8ec186ad47a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39082 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:47:37,888 - lava_callback - INFO - Received callback for node 69af3ff6ce46d8ec186ad48b INFO: 172.19.0.1:39092 - "POST /node/69af3ff6ce46d8ec186ad48b HTTP/1.0" 202 Accepted 2026-03-11 21:47:37,893 - lava_callback - INFO - Starting async job submit for node 69af3ff6ce46d8ec186ad48b 2026-03-11 21:47:37,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:47:37,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3ff6ce46d8ec186ad48b HTTP/1.1" 200 None 2026-03-11 21:47:37,910 - lava_callback - DEBUG - Processing node 69af3ff6ce46d8ec186ad48b: baseline-arm64-baylibre 2026-03-11 21:47:37,910 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af3ff6ce46d8ec186ad48b 2026-03-11 21:47:37,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:47:37,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af3ff6ce46d8ec186ad48b HTTP/1.1" 200 None 2026-03-11 21:47:37,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:47:37,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a744905a0c0e10c4819cd5 HTTP/1.1" 200 None 2026-03-11 21:47:37,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:47:37,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af3ff6ce46d8ec186ad48b HTTP/1.1" 200 None 2026-03-11 21:47:37,972 - lava_callback - ERROR - Error processing callback for node 69af3ff6ce46d8ec186ad48b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32810 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:50:18,063 - lava_callback - INFO - Received callback for node 69af4094ce46d8ec186ad4a1 INFO: 172.19.0.1:32822 - "POST /node/69af4094ce46d8ec186ad4a1 HTTP/1.0" 202 Accepted 2026-03-11 21:50:18,069 - lava_callback - INFO - Starting async job submit for node 69af4094ce46d8ec186ad4a1 2026-03-11 21:50:18,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:50:18,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4094ce46d8ec186ad4a1 HTTP/1.1" 200 None 2026-03-11 21:50:18,110 - lava_callback - DEBUG - Processing node 69af4094ce46d8ec186ad4a1: baseline-arm64-baylibre 2026-03-11 21:50:18,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4094ce46d8ec186ad4a1 2026-03-11 21:50:18,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:50:18,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4094ce46d8ec186ad4a1 HTTP/1.1" 200 None 2026-03-11 21:50:18,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:50:18,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a744905a0c0e10c4819cd5 HTTP/1.1" 200 None 2026-03-11 21:50:18,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:50:18,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4094ce46d8ec186ad4a1 HTTP/1.1" 200 None 2026-03-11 21:50:18,194 - lava_callback - ERROR - Error processing callback for node 69af4094ce46d8ec186ad4a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37086 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:51:38,140 - lava_callback - INFO - Received callback for node 69af40e0ce46d8ec186ad4b1 INFO: 172.19.0.1:37096 - "POST /node/69af40e0ce46d8ec186ad4b1 HTTP/1.0" 202 Accepted 2026-03-11 21:51:38,146 - lava_callback - INFO - Starting async job submit for node 69af40e0ce46d8ec186ad4b1 2026-03-11 21:51:38,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:51:38,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af40e0ce46d8ec186ad4b1 HTTP/1.1" 200 None 2026-03-11 21:51:38,172 - lava_callback - DEBUG - Processing node 69af40e0ce46d8ec186ad4b1: baseline-arm64-baylibre 2026-03-11 21:51:38,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af40e0ce46d8ec186ad4b1 2026-03-11 21:51:38,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:51:38,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af40e0ce46d8ec186ad4b1 HTTP/1.1" 200 None 2026-03-11 21:51:38,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:51:38,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 21:51:38,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:51:38,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af40e0ce46d8ec186ad4b1 HTTP/1.1" 200 None 2026-03-11 21:51:38,229 - lava_callback - ERROR - Error processing callback for node 69af40e0ce46d8ec186ad4b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38338 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:52:54,977 - lava_callback - INFO - Received callback for node 69af4133ce46d8ec186ad4bb INFO: 172.19.0.1:33178 - "POST /node/69af4133ce46d8ec186ad4bb HTTP/1.0" 202 Accepted 2026-03-11 21:52:54,982 - lava_callback - INFO - Starting async job submit for node 69af4133ce46d8ec186ad4bb 2026-03-11 21:52:54,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:52:54,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4133ce46d8ec186ad4bb HTTP/1.1" 200 None 2026-03-11 21:52:54,998 - lava_callback - DEBUG - Processing node 69af4133ce46d8ec186ad4bb: baseline-arm64-clabbe 2026-03-11 21:52:54,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4133ce46d8ec186ad4bb 2026-03-11 21:52:54,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:52:55,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4133ce46d8ec186ad4bb HTTP/1.1" 200 None 2026-03-11 21:52:55,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:52:55,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 21:52:55,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:52:55,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4133ce46d8ec186ad4bb HTTP/1.1" 200 None 2026-03-11 21:52:55,054 - lava_callback - ERROR - Error processing callback for node 69af4133ce46d8ec186ad4bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47462 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:54:15,056 - lava_callback - INFO - Received callback for node 69af4181ce46d8ec186ad4c4 INFO: 172.19.0.1:32860 - "POST /node/69af4181ce46d8ec186ad4c4 HTTP/1.0" 202 Accepted 2026-03-11 21:54:15,061 - lava_callback - INFO - Starting async job submit for node 69af4181ce46d8ec186ad4c4 2026-03-11 21:54:15,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:54:15,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4181ce46d8ec186ad4c4 HTTP/1.1" 200 None 2026-03-11 21:54:15,091 - lava_callback - DEBUG - Processing node 69af4181ce46d8ec186ad4c4: baseline-arm64-clabbe 2026-03-11 21:54:15,091 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4181ce46d8ec186ad4c4 2026-03-11 21:54:15,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:54:15,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4181ce46d8ec186ad4c4 HTTP/1.1" 200 None 2026-03-11 21:54:15,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:54:15,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 21:54:15,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:54:15,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4181ce46d8ec186ad4c4 HTTP/1.1" 200 None 2026-03-11 21:54:15,153 - lava_callback - ERROR - Error processing callback for node 69af4181ce46d8ec186ad4c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:32866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56282 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:55:18,359 - lava_callback - INFO - Received callback for node 69af41bcce46d8ec186ad4d3 INFO: 172.19.0.1:56286 - "POST /node/69af41bcce46d8ec186ad4d3 HTTP/1.0" 202 Accepted 2026-03-11 21:55:18,365 - lava_callback - INFO - Starting async job submit for node 69af41bcce46d8ec186ad4d3 2026-03-11 21:55:18,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:55:18,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af41bcce46d8ec186ad4d3 HTTP/1.1" 200 None 2026-03-11 21:55:18,382 - lava_callback - DEBUG - Processing node 69af41bcce46d8ec186ad4d3: baseline-arm-baylibre 2026-03-11 21:55:18,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af41bcce46d8ec186ad4d3 2026-03-11 21:55:18,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:55:18,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af41bcce46d8ec186ad4d3 HTTP/1.1" 200 None 2026-03-11 21:55:18,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:55:18,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a7447b5a0c0e10c4819cc3 HTTP/1.1" 200 None 2026-03-11 21:55:18,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:55:18,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af41bcce46d8ec186ad4d3 HTTP/1.1" 200 None 2026-03-11 21:55:18,525 - lava_callback - ERROR - Error processing callback for node 69af41bcce46d8ec186ad4d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47766 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:55:58,653 - lava_callback - INFO - Received callback for node 69af41dfce46d8ec186ad4df INFO: 172.19.0.1:47778 - "POST /node/69af41dfce46d8ec186ad4df HTTP/1.0" 202 Accepted 2026-03-11 21:55:58,659 - lava_callback - INFO - Starting async job submit for node 69af41dfce46d8ec186ad4df 2026-03-11 21:55:58,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:55:58,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af41dfce46d8ec186ad4df HTTP/1.1" 200 None 2026-03-11 21:55:58,713 - lava_callback - DEBUG - Processing node 69af41dfce46d8ec186ad4df: baseline-arm-baylibre 2026-03-11 21:55:58,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af41dfce46d8ec186ad4df 2026-03-11 21:55:58,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:55:58,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af41dfce46d8ec186ad4df HTTP/1.1" 200 None 2026-03-11 21:55:58,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:55:58,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a7447b5a0c0e10c4819cc3 HTTP/1.1" 200 None 2026-03-11 21:55:58,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:55:58,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af41dfce46d8ec186ad4df HTTP/1.1" 200 None 2026-03-11 21:55:58,777 - lava_callback - ERROR - Error processing callback for node 69af41dfce46d8ec186ad4df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50916 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:56:38,486 - lava_callback - INFO - Received callback for node 69af4205ce46d8ec186ad4e7 INFO: 172.19.0.1:50930 - "POST /node/69af4205ce46d8ec186ad4e7 HTTP/1.0" 202 Accepted 2026-03-11 21:56:38,496 - lava_callback - INFO - Starting async job submit for node 69af4205ce46d8ec186ad4e7 2026-03-11 21:56:38,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:56:38,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4205ce46d8ec186ad4e7 HTTP/1.1" 200 None 2026-03-11 21:56:38,521 - lava_callback - DEBUG - Processing node 69af4205ce46d8ec186ad4e7: baseline-arm-baylibre 2026-03-11 21:56:38,521 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4205ce46d8ec186ad4e7 2026-03-11 21:56:38,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:56:38,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4205ce46d8ec186ad4e7 HTTP/1.1" 200 None 2026-03-11 21:56:38,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:56:38,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a7447b5a0c0e10c4819cc3 HTTP/1.1" 200 None 2026-03-11 21:56:38,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:56:38,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4205ce46d8ec186ad4e7 HTTP/1.1" 200 None 2026-03-11 21:56:38,649 - lava_callback - ERROR - Error processing callback for node 69af4205ce46d8ec186ad4e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42352 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:57:18,372 - lava_callback - INFO - Received callback for node 69af422bce46d8ec186ad4f0 INFO: 172.19.0.1:42366 - "POST /node/69af422bce46d8ec186ad4f0 HTTP/1.0" 202 Accepted 2026-03-11 21:57:18,379 - lava_callback - INFO - Starting async job submit for node 69af422bce46d8ec186ad4f0 2026-03-11 21:57:18,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:57:18,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af422bce46d8ec186ad4f0 HTTP/1.1" 200 None 2026-03-11 21:57:18,399 - lava_callback - DEBUG - Processing node 69af422bce46d8ec186ad4f0: baseline-arm-baylibre 2026-03-11 21:57:18,399 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af422bce46d8ec186ad4f0 2026-03-11 21:57:18,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:57:18,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af422bce46d8ec186ad4f0 HTTP/1.1" 200 None 2026-03-11 21:57:18,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:57:18,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a7447b5a0c0e10c4819cc3 HTTP/1.1" 200 None 2026-03-11 21:57:18,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:57:18,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af422bce46d8ec186ad4f0 HTTP/1.1" 200 None 2026-03-11 21:57:18,463 - lava_callback - ERROR - Error processing callback for node 69af422bce46d8ec186ad4f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51650 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:57:58,739 - lava_callback - INFO - Received callback for node 69af4251ce46d8ec186ad4fa INFO: 172.19.0.1:51664 - "POST /node/69af4251ce46d8ec186ad4fa HTTP/1.0" 202 Accepted 2026-03-11 21:57:58,745 - lava_callback - INFO - Starting async job submit for node 69af4251ce46d8ec186ad4fa 2026-03-11 21:57:58,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:57:58,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4251ce46d8ec186ad4fa HTTP/1.1" 200 None 2026-03-11 21:57:58,761 - lava_callback - DEBUG - Processing node 69af4251ce46d8ec186ad4fa: baseline-arm-baylibre 2026-03-11 21:57:58,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4251ce46d8ec186ad4fa 2026-03-11 21:57:58,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:57:58,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4251ce46d8ec186ad4fa HTTP/1.1" 200 None 2026-03-11 21:57:58,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:57:58,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a7447b5a0c0e10c4819cc3 HTTP/1.1" 200 None 2026-03-11 21:57:58,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:57:58,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4251ce46d8ec186ad4fa HTTP/1.1" 200 None 2026-03-11 21:57:58,818 - lava_callback - ERROR - Error processing callback for node 69af4251ce46d8ec186ad4fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33258 - "GET / HTTP/1.0" 200 OK 2026-03-11 21:58:18,438 - lava_callback - INFO - Received callback for node 69af4276ce46d8ec186ad505 INFO: 172.19.0.1:33264 - "POST /node/69af4276ce46d8ec186ad505 HTTP/1.0" 202 Accepted 2026-03-11 21:58:18,443 - lava_callback - INFO - Starting async job submit for node 69af4276ce46d8ec186ad505 2026-03-11 21:58:18,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:58:18,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4276ce46d8ec186ad505 HTTP/1.1" 200 None 2026-03-11 21:58:18,461 - lava_callback - DEBUG - Processing node 69af4276ce46d8ec186ad505: baseline-arm-baylibre 2026-03-11 21:58:18,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4276ce46d8ec186ad505 2026-03-11 21:58:18,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:58:18,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4276ce46d8ec186ad505 HTTP/1.1" 200 None 2026-03-11 21:58:18,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:58:18,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a7447b5a0c0e10c4819cc3 HTTP/1.1" 200 None 2026-03-11 21:58:18,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 21:58:18,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4276ce46d8ec186ad505 HTTP/1.1" 200 None 2026-03-11 21:58:18,546 - lava_callback - ERROR - Error processing callback for node 69af4276ce46d8ec186ad505: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38080 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:06:18,907 - lava_callback - INFO - Received callback for node 69af444dce46d8ec186ad521 INFO: 172.19.0.1:38094 - "POST /node/69af444dce46d8ec186ad521 HTTP/1.0" 202 Accepted 2026-03-11 22:06:18,912 - lava_callback - INFO - Starting async job submit for node 69af444dce46d8ec186ad521 2026-03-11 22:06:18,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:06:18,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af444dce46d8ec186ad521 HTTP/1.1" 200 None 2026-03-11 22:06:18,928 - lava_callback - DEBUG - Processing node 69af444dce46d8ec186ad521: baseline-arm-baylibre 2026-03-11 22:06:18,928 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af444dce46d8ec186ad521 2026-03-11 22:06:18,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:06:18,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af444dce46d8ec186ad521 HTTP/1.1" 200 None 2026-03-11 22:06:18,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:06:18,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750a55a0c0e10c481a794 HTTP/1.1" 200 None 2026-03-11 22:06:18,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:06:18,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af444dce46d8ec186ad521 HTTP/1.1" 200 None 2026-03-11 22:06:18,980 - lava_callback - ERROR - Error processing callback for node 69af444dce46d8ec186ad521: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57416 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:06:58,885 - lava_callback - INFO - Received callback for node 69af4475ce46d8ec186ad52e INFO: 172.19.0.1:57432 - "POST /node/69af4475ce46d8ec186ad52e HTTP/1.0" 202 Accepted 2026-03-11 22:06:58,891 - lava_callback - INFO - Starting async job submit for node 69af4475ce46d8ec186ad52e 2026-03-11 22:06:58,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:06:58,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4475ce46d8ec186ad52e HTTP/1.1" 200 None 2026-03-11 22:06:58,907 - lava_callback - DEBUG - Processing node 69af4475ce46d8ec186ad52e: baseline-arm-baylibre 2026-03-11 22:06:58,907 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4475ce46d8ec186ad52e 2026-03-11 22:06:58,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:06:58,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4475ce46d8ec186ad52e HTTP/1.1" 200 None 2026-03-11 22:06:58,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:06:58,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750a55a0c0e10c481a794 HTTP/1.1" 200 None 2026-03-11 22:06:58,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:06:58,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4475ce46d8ec186ad52e HTTP/1.1" 200 None 2026-03-11 22:06:58,983 - lava_callback - ERROR - Error processing callback for node 69af4475ce46d8ec186ad52e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44742 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:07:39,204 - lava_callback - INFO - Received callback for node 69af449dce46d8ec186ad537 INFO: 172.19.0.1:44748 - "POST /node/69af449dce46d8ec186ad537 HTTP/1.0" 202 Accepted 2026-03-11 22:07:39,209 - lava_callback - INFO - Starting async job submit for node 69af449dce46d8ec186ad537 2026-03-11 22:07:39,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:07:39,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af449dce46d8ec186ad537 HTTP/1.1" 200 None 2026-03-11 22:07:39,225 - lava_callback - DEBUG - Processing node 69af449dce46d8ec186ad537: baseline-arm-baylibre 2026-03-11 22:07:39,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af449dce46d8ec186ad537 2026-03-11 22:07:39,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:07:39,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af449dce46d8ec186ad537 HTTP/1.1" 200 None 2026-03-11 22:07:39,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:07:39,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750a55a0c0e10c481a794 HTTP/1.1" 200 None 2026-03-11 22:07:39,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:07:39,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af449dce46d8ec186ad537 HTTP/1.1" 200 None 2026-03-11 22:07:39,283 - lava_callback - ERROR - Error processing callback for node 69af449dce46d8ec186ad537: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44734 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:09:19,084 - lava_callback - INFO - Received callback for node 69af4501ce46d8ec186ad550 INFO: 172.19.0.1:44740 - "POST /node/69af4501ce46d8ec186ad550 HTTP/1.0" 202 Accepted 2026-03-11 22:09:19,089 - lava_callback - INFO - Starting async job submit for node 69af4501ce46d8ec186ad550 2026-03-11 22:09:19,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:09:19,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4501ce46d8ec186ad550 HTTP/1.1" 200 None 2026-03-11 22:09:19,105 - lava_callback - DEBUG - Processing node 69af4501ce46d8ec186ad550: baseline-arm-baylibre 2026-03-11 22:09:19,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4501ce46d8ec186ad550 2026-03-11 22:09:19,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:09:19,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4501ce46d8ec186ad550 HTTP/1.1" 200 None 2026-03-11 22:09:19,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:09:19,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750a55a0c0e10c481a794 HTTP/1.1" 200 None 2026-03-11 22:09:19,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:09:19,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4501ce46d8ec186ad550 HTTP/1.1" 200 None 2026-03-11 22:09:19,161 - lava_callback - ERROR - Error processing callback for node 69af4501ce46d8ec186ad550: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46052 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:09:59,074 - lava_callback - INFO - Received callback for node 69af4527ce46d8ec186ad55c INFO: 172.19.0.1:46056 - "POST /node/69af4527ce46d8ec186ad55c HTTP/1.0" 202 Accepted 2026-03-11 22:09:59,079 - lava_callback - INFO - Starting async job submit for node 69af4527ce46d8ec186ad55c 2026-03-11 22:09:59,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:09:59,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4527ce46d8ec186ad55c HTTP/1.1" 200 None 2026-03-11 22:09:59,096 - lava_callback - DEBUG - Processing node 69af4527ce46d8ec186ad55c: baseline-arm-baylibre 2026-03-11 22:09:59,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4527ce46d8ec186ad55c 2026-03-11 22:09:59,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:09:59,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4527ce46d8ec186ad55c HTTP/1.1" 200 None 2026-03-11 22:09:59,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:09:59,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750a55a0c0e10c481a794 HTTP/1.1" 200 None 2026-03-11 22:09:59,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:09:59,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4527ce46d8ec186ad55c HTTP/1.1" 200 None 2026-03-11 22:09:59,167 - lava_callback - ERROR - Error processing callback for node 69af4527ce46d8ec186ad55c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49194 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:11:39,235 - lava_callback - INFO - Received callback for node 69af4599ce46d8ec186ad56d INFO: 172.19.0.1:49204 - "POST /node/69af4599ce46d8ec186ad56d HTTP/1.0" 202 Accepted 2026-03-11 22:11:39,241 - lava_callback - INFO - Starting async job submit for node 69af4599ce46d8ec186ad56d 2026-03-11 22:11:39,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:11:39,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4599ce46d8ec186ad56d HTTP/1.1" 200 None 2026-03-11 22:11:39,258 - lava_callback - DEBUG - Processing node 69af4599ce46d8ec186ad56d: baseline-arm-baylibre 2026-03-11 22:11:39,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4599ce46d8ec186ad56d 2026-03-11 22:11:39,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:11:39,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4599ce46d8ec186ad56d HTTP/1.1" 200 None 2026-03-11 22:11:39,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:11:39,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750a55a0c0e10c481a794 HTTP/1.1" 200 None 2026-03-11 22:11:39,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:11:39,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4599ce46d8ec186ad56d HTTP/1.1" 200 None 2026-03-11 22:11:39,327 - lava_callback - ERROR - Error processing callback for node 69af4599ce46d8ec186ad56d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49878 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:38:40,671 - lava_callback - INFO - Received callback for node 69af4bedce46d8ec186ad587 INFO: 172.19.0.1:35372 - "POST /node/69af4bedce46d8ec186ad587 HTTP/1.0" 202 Accepted 2026-03-11 22:38:40,676 - lava_callback - INFO - Starting async job submit for node 69af4bedce46d8ec186ad587 2026-03-11 22:38:40,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:38:40,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4bedce46d8ec186ad587 HTTP/1.1" 200 None 2026-03-11 22:38:40,703 - lava_callback - DEBUG - Processing node 69af4bedce46d8ec186ad587: baseline-arm64-baylibre 2026-03-11 22:38:40,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4bedce46d8ec186ad587 2026-03-11 22:38:40,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:38:40,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4bedce46d8ec186ad587 HTTP/1.1" 200 None 2026-03-11 22:38:40,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:38:40,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750ca5a0c0e10c481a7c4 HTTP/1.1" 200 None 2026-03-11 22:38:40,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:38:40,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4bedce46d8ec186ad587 HTTP/1.1" 200 None 2026-03-11 22:38:40,768 - lava_callback - ERROR - Error processing callback for node 69af4bedce46d8ec186ad587: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39866 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:40:00,631 - lava_callback - INFO - Received callback for node 69af4c3ece46d8ec186ad592 INFO: 172.19.0.1:42804 - "POST /node/69af4c3ece46d8ec186ad592 HTTP/1.0" 202 Accepted 2026-03-11 22:40:00,636 - lava_callback - INFO - Starting async job submit for node 69af4c3ece46d8ec186ad592 2026-03-11 22:40:00,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:40:00,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4c3ece46d8ec186ad592 HTTP/1.1" 200 None 2026-03-11 22:40:00,652 - lava_callback - DEBUG - Processing node 69af4c3ece46d8ec186ad592: baseline-arm64-baylibre 2026-03-11 22:40:00,652 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4c3ece46d8ec186ad592 2026-03-11 22:40:00,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:40:00,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4c3ece46d8ec186ad592 HTTP/1.1" 200 None 2026-03-11 22:40:00,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:40:00,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750ca5a0c0e10c481a7c4 HTTP/1.1" 200 None 2026-03-11 22:40:00,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:40:00,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4c3ece46d8ec186ad592 HTTP/1.1" 200 None 2026-03-11 22:40:00,726 - lava_callback - ERROR - Error processing callback for node 69af4c3ece46d8ec186ad592: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40636 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:42:20,692 - lava_callback - INFO - Received callback for node 69af4cbace46d8ec186ad5a0 INFO: 172.19.0.1:41940 - "POST /node/69af4cbace46d8ec186ad5a0 HTTP/1.0" 202 Accepted 2026-03-11 22:42:20,697 - lava_callback - INFO - Starting async job submit for node 69af4cbace46d8ec186ad5a0 2026-03-11 22:42:20,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:42:20,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4cbace46d8ec186ad5a0 HTTP/1.1" 200 None 2026-03-11 22:42:20,713 - lava_callback - DEBUG - Processing node 69af4cbace46d8ec186ad5a0: baseline-arm-baylibre 2026-03-11 22:42:20,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4cbace46d8ec186ad5a0 2026-03-11 22:42:20,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:42:20,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4cbace46d8ec186ad5a0 HTTP/1.1" 200 None 2026-03-11 22:42:20,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:42:20,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 22:42:20,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:42:20,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4cbace46d8ec186ad5a0 HTTP/1.1" 200 None 2026-03-11 22:42:20,778 - lava_callback - ERROR - Error processing callback for node 69af4cbace46d8ec186ad5a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37750 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:43:00,726 - lava_callback - INFO - Received callback for node 69af4cebce46d8ec186ad5af INFO: 172.19.0.1:35046 - "POST /node/69af4cebce46d8ec186ad5af HTTP/1.0" 202 Accepted 2026-03-11 22:43:00,732 - lava_callback - INFO - Starting async job submit for node 69af4cebce46d8ec186ad5af 2026-03-11 22:43:00,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:43:00,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4cebce46d8ec186ad5af HTTP/1.1" 200 None 2026-03-11 22:43:00,748 - lava_callback - DEBUG - Processing node 69af4cebce46d8ec186ad5af: baseline-arm64-baylibre 2026-03-11 22:43:00,749 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4cebce46d8ec186ad5af 2026-03-11 22:43:00,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:43:00,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4cebce46d8ec186ad5af HTTP/1.1" 200 None 2026-03-11 22:43:00,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:43:00,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750ca5a0c0e10c481a7c4 HTTP/1.1" 200 None 2026-03-11 22:43:00,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:43:00,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4cebce46d8ec186ad5af HTTP/1.1" 200 None 2026-03-11 22:43:00,804 - lava_callback - ERROR - Error processing callback for node 69af4cebce46d8ec186ad5af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37896 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:44:20,985 - lava_callback - INFO - Received callback for node 69af4d2fce46d8ec186ad5bb INFO: 172.19.0.1:54474 - "POST /node/69af4d2fce46d8ec186ad5bb HTTP/1.0" 202 Accepted 2026-03-11 22:44:20,990 - lava_callback - INFO - Starting async job submit for node 69af4d2fce46d8ec186ad5bb 2026-03-11 22:44:20,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:44:21,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4d2fce46d8ec186ad5bb HTTP/1.1" 200 None 2026-03-11 22:44:21,006 - lava_callback - DEBUG - Processing node 69af4d2fce46d8ec186ad5bb: baseline-arm-baylibre 2026-03-11 22:44:21,006 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4d2fce46d8ec186ad5bb 2026-03-11 22:44:21,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:44:21,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4d2fce46d8ec186ad5bb HTTP/1.1" 200 None 2026-03-11 22:44:21,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:44:21,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 22:44:21,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:44:21,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4d2fce46d8ec186ad5bb HTTP/1.1" 200 None 2026-03-11 22:44:21,077 - lava_callback - ERROR - Error processing callback for node 69af4d2fce46d8ec186ad5bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35674 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:44:40,846 - lava_callback - INFO - Received callback for node 69af4d57ce46d8ec186ad5c7 INFO: 172.19.0.1:53212 - "POST /node/69af4d57ce46d8ec186ad5c7 HTTP/1.0" 202 Accepted 2026-03-11 22:44:40,852 - lava_callback - INFO - Starting async job submit for node 69af4d57ce46d8ec186ad5c7 2026-03-11 22:44:40,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:44:40,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4d57ce46d8ec186ad5c7 HTTP/1.1" 200 None 2026-03-11 22:44:40,869 - lava_callback - DEBUG - Processing node 69af4d57ce46d8ec186ad5c7: baseline-arm-baylibre 2026-03-11 22:44:40,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4d57ce46d8ec186ad5c7 2026-03-11 22:44:40,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:44:40,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4d57ce46d8ec186ad5c7 HTTP/1.1" 200 None 2026-03-11 22:44:40,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:44:40,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 22:44:40,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:44:40,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4d57ce46d8ec186ad5c7 HTTP/1.1" 200 None 2026-03-11 22:44:40,925 - lava_callback - ERROR - Error processing callback for node 69af4d57ce46d8ec186ad5c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44068 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:45:20,858 - lava_callback - INFO - Received callback for node 69af4d7dce46d8ec186ad5d6 INFO: 172.19.0.1:50772 - "POST /node/69af4d7dce46d8ec186ad5d6 HTTP/1.0" 202 Accepted 2026-03-11 22:45:20,863 - lava_callback - INFO - Starting async job submit for node 69af4d7dce46d8ec186ad5d6 2026-03-11 22:45:20,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:45:20,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4d7dce46d8ec186ad5d6 HTTP/1.1" 200 None 2026-03-11 22:45:20,880 - lava_callback - DEBUG - Processing node 69af4d7dce46d8ec186ad5d6: baseline-arm-baylibre 2026-03-11 22:45:20,881 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4d7dce46d8ec186ad5d6 2026-03-11 22:45:20,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:45:20,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4d7dce46d8ec186ad5d6 HTTP/1.1" 200 None 2026-03-11 22:45:20,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:45:20,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 22:45:20,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:45:20,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4d7dce46d8ec186ad5d6 HTTP/1.1" 200 None 2026-03-11 22:45:20,933 - lava_callback - ERROR - Error processing callback for node 69af4d7dce46d8ec186ad5d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34370 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:46:01,021 - lava_callback - INFO - Received callback for node 69af4da6ce46d8ec186ad5de INFO: 172.19.0.1:42188 - "POST /node/69af4da6ce46d8ec186ad5de HTTP/1.0" 202 Accepted 2026-03-11 22:46:01,027 - lava_callback - INFO - Starting async job submit for node 69af4da6ce46d8ec186ad5de 2026-03-11 22:46:01,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:46:01,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4da6ce46d8ec186ad5de HTTP/1.1" 200 None 2026-03-11 22:46:01,047 - lava_callback - DEBUG - Processing node 69af4da6ce46d8ec186ad5de: baseline-arm-baylibre 2026-03-11 22:46:01,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4da6ce46d8ec186ad5de 2026-03-11 22:46:01,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:46:01,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4da6ce46d8ec186ad5de HTTP/1.1" 200 None 2026-03-11 22:46:01,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:46:01,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 22:46:01,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:46:01,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4da6ce46d8ec186ad5de HTTP/1.1" 200 None 2026-03-11 22:46:01,109 - lava_callback - ERROR - Error processing callback for node 69af4da6ce46d8ec186ad5de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55630 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:47:00,897 - lava_callback - INFO - Received callback for node 69af4dd7ce46d8ec186ad5f0 INFO: 172.19.0.1:38892 - "POST /node/69af4dd7ce46d8ec186ad5f0 HTTP/1.0" 202 Accepted 2026-03-11 22:47:00,902 - lava_callback - INFO - Starting async job submit for node 69af4dd7ce46d8ec186ad5f0 2026-03-11 22:47:00,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:47:00,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4dd7ce46d8ec186ad5f0 HTTP/1.1" 200 None 2026-03-11 22:47:00,918 - lava_callback - DEBUG - Processing node 69af4dd7ce46d8ec186ad5f0: baseline-arm64-baylibre 2026-03-11 22:47:00,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4dd7ce46d8ec186ad5f0 2026-03-11 22:47:00,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:47:00,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4dd7ce46d8ec186ad5f0 HTTP/1.1" 200 None 2026-03-11 22:47:00,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:47:00,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750ca5a0c0e10c481a7c4 HTTP/1.1" 200 None 2026-03-11 22:47:00,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:47:00,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4dd7ce46d8ec186ad5f0 HTTP/1.1" 200 None 2026-03-11 22:47:00,978 - lava_callback - ERROR - Error processing callback for node 69af4dd7ce46d8ec186ad5f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43590 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:48:00,980 - lava_callback - INFO - Received callback for node 69af4e19ce46d8ec186ad5f8 INFO: 172.19.0.1:45610 - "POST /node/69af4e19ce46d8ec186ad5f8 HTTP/1.0" 202 Accepted 2026-03-11 22:48:00,986 - lava_callback - INFO - Starting async job submit for node 69af4e19ce46d8ec186ad5f8 2026-03-11 22:48:00,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:48:01,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4e19ce46d8ec186ad5f8 HTTP/1.1" 200 None 2026-03-11 22:48:01,010 - lava_callback - DEBUG - Processing node 69af4e19ce46d8ec186ad5f8: baseline-arm-baylibre 2026-03-11 22:48:01,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4e19ce46d8ec186ad5f8 2026-03-11 22:48:01,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:48:01,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4e19ce46d8ec186ad5f8 HTTP/1.1" 200 None 2026-03-11 22:48:01,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:48:01,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 22:48:01,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:48:01,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4e19ce46d8ec186ad5f8 HTTP/1.1" 200 None 2026-03-11 22:48:01,063 - lava_callback - ERROR - Error processing callback for node 69af4e19ce46d8ec186ad5f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50390 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:48:41,027 - lava_callback - INFO - Received callback for node 69af4e40ce46d8ec186ad607 INFO: 172.19.0.1:37834 - "POST /node/69af4e40ce46d8ec186ad607 HTTP/1.0" 202 Accepted 2026-03-11 22:48:41,032 - lava_callback - INFO - Starting async job submit for node 69af4e40ce46d8ec186ad607 2026-03-11 22:48:41,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:48:41,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4e40ce46d8ec186ad607 HTTP/1.1" 200 None 2026-03-11 22:48:41,048 - lava_callback - DEBUG - Processing node 69af4e40ce46d8ec186ad607: baseline-arm-baylibre 2026-03-11 22:48:41,048 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4e40ce46d8ec186ad607 2026-03-11 22:48:41,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:48:41,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4e40ce46d8ec186ad607 HTTP/1.1" 200 None 2026-03-11 22:48:41,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:48:41,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 22:48:41,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:48:41,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4e40ce46d8ec186ad607 HTTP/1.1" 200 None 2026-03-11 22:48:41,099 - lava_callback - ERROR - Error processing callback for node 69af4e40ce46d8ec186ad607: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54726 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:49:21,100 - lava_callback - INFO - Received callback for node 69af4e68ce46d8ec186ad616 INFO: 172.19.0.1:54372 - "POST /node/69af4e68ce46d8ec186ad616 HTTP/1.0" 202 Accepted 2026-03-11 22:49:21,106 - lava_callback - INFO - Starting async job submit for node 69af4e68ce46d8ec186ad616 2026-03-11 22:49:21,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:49:21,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4e68ce46d8ec186ad616 HTTP/1.1" 200 None 2026-03-11 22:49:21,122 - lava_callback - DEBUG - Processing node 69af4e68ce46d8ec186ad616: baseline-arm-baylibre 2026-03-11 22:49:21,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4e68ce46d8ec186ad616 2026-03-11 22:49:21,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:49:21,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4e68ce46d8ec186ad616 HTTP/1.1" 200 None 2026-03-11 22:49:21,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:49:21,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 22:49:21,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:49:21,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4e68ce46d8ec186ad616 HTTP/1.1" 200 None 2026-03-11 22:49:21,201 - lava_callback - ERROR - Error processing callback for node 69af4e68ce46d8ec186ad616: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43870 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:50:01,162 - lava_callback - INFO - Received callback for node 69af4e92ce46d8ec186ad61f INFO: 172.19.0.1:35244 - "POST /node/69af4e92ce46d8ec186ad61f HTTP/1.0" 202 Accepted 2026-03-11 22:50:01,167 - lava_callback - INFO - Starting async job submit for node 69af4e92ce46d8ec186ad61f 2026-03-11 22:50:01,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:50:01,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4e92ce46d8ec186ad61f HTTP/1.1" 200 None 2026-03-11 22:50:01,184 - lava_callback - DEBUG - Processing node 69af4e92ce46d8ec186ad61f: baseline-arm-baylibre 2026-03-11 22:50:01,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4e92ce46d8ec186ad61f 2026-03-11 22:50:01,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:50:01,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4e92ce46d8ec186ad61f HTTP/1.1" 200 None 2026-03-11 22:50:01,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:50:01,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 22:50:01,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:50:01,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4e92ce46d8ec186ad61f HTTP/1.1" 200 None 2026-03-11 22:50:01,248 - lava_callback - ERROR - Error processing callback for node 69af4e92ce46d8ec186ad61f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43648 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:50:57,517 - lava_callback - INFO - Received callback for node 69af4ebcce46d8ec186ad658 INFO: 172.19.0.1:43658 - "POST /node/69af4ebcce46d8ec186ad658 HTTP/1.0" 202 Accepted 2026-03-11 22:50:57,522 - lava_callback - INFO - Starting async job submit for node 69af4ebcce46d8ec186ad658 2026-03-11 22:50:57,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:50:57,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4ebcce46d8ec186ad658 HTTP/1.1" 200 None 2026-03-11 22:50:57,538 - lava_callback - DEBUG - Processing node 69af4ebcce46d8ec186ad658: baseline-arm-clabbe 2026-03-11 22:50:57,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4ebcce46d8ec186ad658 2026-03-11 22:50:57,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:50:57,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4ebcce46d8ec186ad658 HTTP/1.1" 200 None 2026-03-11 22:50:57,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:50:57,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 22:50:57,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:50:57,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4ebcce46d8ec186ad658 HTTP/1.1" 200 None 2026-03-11 22:50:57,608 - lava_callback - ERROR - Error processing callback for node 69af4ebcce46d8ec186ad658: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39322 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:51:37,474 - lava_callback - INFO - Received callback for node 69af4ee4ce46d8ec186ad666 INFO: 172.19.0.1:39324 - "POST /node/69af4ee4ce46d8ec186ad666 HTTP/1.0" 202 Accepted 2026-03-11 22:51:37,479 - lava_callback - INFO - Starting async job submit for node 69af4ee4ce46d8ec186ad666 2026-03-11 22:51:37,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:51:37,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4ee4ce46d8ec186ad666 HTTP/1.1" 200 None 2026-03-11 22:51:37,510 - lava_callback - DEBUG - Processing node 69af4ee4ce46d8ec186ad666: baseline-arm-clabbe 2026-03-11 22:51:37,511 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4ee4ce46d8ec186ad666 2026-03-11 22:51:37,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:51:37,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4ee4ce46d8ec186ad666 HTTP/1.1" 200 None 2026-03-11 22:51:37,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:51:37,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 22:51:37,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:51:37,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4ee4ce46d8ec186ad666 HTTP/1.1" 200 None 2026-03-11 22:51:37,573 - lava_callback - ERROR - Error processing callback for node 69af4ee4ce46d8ec186ad666: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49948 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:53:21,598 - lava_callback - INFO - Received callback for node 69af4f51ce46d8ec186ad687 INFO: 172.19.0.1:57754 - "POST /node/69af4f51ce46d8ec186ad687 HTTP/1.0" 202 Accepted 2026-03-11 22:53:21,603 - lava_callback - INFO - Starting async job submit for node 69af4f51ce46d8ec186ad687 2026-03-11 22:53:21,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:53:21,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4f51ce46d8ec186ad687 HTTP/1.1" 200 None 2026-03-11 22:53:21,619 - lava_callback - DEBUG - Processing node 69af4f51ce46d8ec186ad687: baseline-arm-baylibre 2026-03-11 22:53:21,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4f51ce46d8ec186ad687 2026-03-11 22:53:21,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:53:21,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4f51ce46d8ec186ad687 HTTP/1.1" 200 None 2026-03-11 22:53:21,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:53:21,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 22:53:21,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:53:21,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4f51ce46d8ec186ad687 HTTP/1.1" 200 None 2026-03-11 22:53:21,714 - lava_callback - ERROR - Error processing callback for node 69af4f51ce46d8ec186ad687: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43584 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:54:01,246 - lava_callback - INFO - Received callback for node 69af4f78ce46d8ec186ad694 INFO: 172.19.0.1:50314 - "POST /node/69af4f78ce46d8ec186ad694 HTTP/1.0" 202 Accepted 2026-03-11 22:54:01,251 - lava_callback - INFO - Starting async job submit for node 69af4f78ce46d8ec186ad694 2026-03-11 22:54:01,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:54:01,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4f78ce46d8ec186ad694 HTTP/1.1" 200 None 2026-03-11 22:54:01,267 - lava_callback - DEBUG - Processing node 69af4f78ce46d8ec186ad694: baseline-arm-baylibre 2026-03-11 22:54:01,267 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4f78ce46d8ec186ad694 2026-03-11 22:54:01,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:54:01,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4f78ce46d8ec186ad694 HTTP/1.1" 200 None 2026-03-11 22:54:01,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:54:01,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 22:54:01,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:54:01,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4f78ce46d8ec186ad694 HTTP/1.1" 200 None 2026-03-11 22:54:01,319 - lava_callback - ERROR - Error processing callback for node 69af4f78ce46d8ec186ad694: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44942 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:54:41,354 - lava_callback - INFO - Received callback for node 69af4f9fce46d8ec186ad69b INFO: 172.19.0.1:34732 - "POST /node/69af4f9fce46d8ec186ad69b HTTP/1.0" 202 Accepted 2026-03-11 22:54:41,359 - lava_callback - INFO - Starting async job submit for node 69af4f9fce46d8ec186ad69b 2026-03-11 22:54:41,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:54:41,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4f9fce46d8ec186ad69b HTTP/1.1" 200 None 2026-03-11 22:54:41,375 - lava_callback - DEBUG - Processing node 69af4f9fce46d8ec186ad69b: baseline-arm-baylibre 2026-03-11 22:54:41,375 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4f9fce46d8ec186ad69b 2026-03-11 22:54:41,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:54:41,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4f9fce46d8ec186ad69b HTTP/1.1" 200 None 2026-03-11 22:54:41,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:54:41,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 22:54:41,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:54:41,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4f9fce46d8ec186ad69b HTTP/1.1" 200 None 2026-03-11 22:54:41,438 - lava_callback - ERROR - Error processing callback for node 69af4f9fce46d8ec186ad69b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43268 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:55:21,529 - lava_callback - INFO - Received callback for node 69af4fc6ce46d8ec186ad6a6 INFO: 172.19.0.1:45440 - "POST /node/69af4fc6ce46d8ec186ad6a6 HTTP/1.0" 202 Accepted 2026-03-11 22:55:21,535 - lava_callback - INFO - Starting async job submit for node 69af4fc6ce46d8ec186ad6a6 2026-03-11 22:55:21,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:55:21,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4fc6ce46d8ec186ad6a6 HTTP/1.1" 200 None 2026-03-11 22:55:21,550 - lava_callback - DEBUG - Processing node 69af4fc6ce46d8ec186ad6a6: baseline-arm-baylibre 2026-03-11 22:55:21,550 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4fc6ce46d8ec186ad6a6 2026-03-11 22:55:21,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:55:21,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4fc6ce46d8ec186ad6a6 HTTP/1.1" 200 None 2026-03-11 22:55:21,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:55:21,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 22:55:21,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:55:21,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4fc6ce46d8ec186ad6a6 HTTP/1.1" 200 None 2026-03-11 22:55:21,609 - lava_callback - ERROR - Error processing callback for node 69af4fc6ce46d8ec186ad6a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44846 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:56:01,355 - lava_callback - INFO - Received callback for node 69af4feece46d8ec186ad6b1 INFO: 172.19.0.1:57672 - "POST /node/69af4feece46d8ec186ad6b1 HTTP/1.0" 202 Accepted 2026-03-11 22:56:01,361 - lava_callback - INFO - Starting async job submit for node 69af4feece46d8ec186ad6b1 2026-03-11 22:56:01,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:56:01,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4feece46d8ec186ad6b1 HTTP/1.1" 200 None 2026-03-11 22:56:01,384 - lava_callback - DEBUG - Processing node 69af4feece46d8ec186ad6b1: baseline-arm-baylibre 2026-03-11 22:56:01,384 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af4feece46d8ec186ad6b1 2026-03-11 22:56:01,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:56:01,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af4feece46d8ec186ad6b1 HTTP/1.1" 200 None 2026-03-11 22:56:01,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:56:01,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 22:56:01,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:56:01,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af4feece46d8ec186ad6b1 HTTP/1.1" 200 None 2026-03-11 22:56:01,437 - lava_callback - ERROR - Error processing callback for node 69af4feece46d8ec186ad6b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35094 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:56:41,367 - lava_callback - INFO - Received callback for node 69af5014ce46d8ec186ad6ba INFO: 172.19.0.1:48936 - "POST /node/69af5014ce46d8ec186ad6ba HTTP/1.0" 202 Accepted 2026-03-11 22:56:41,373 - lava_callback - INFO - Starting async job submit for node 69af5014ce46d8ec186ad6ba 2026-03-11 22:56:41,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:56:41,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5014ce46d8ec186ad6ba HTTP/1.1" 200 None 2026-03-11 22:56:41,388 - lava_callback - DEBUG - Processing node 69af5014ce46d8ec186ad6ba: baseline-arm-baylibre 2026-03-11 22:56:41,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5014ce46d8ec186ad6ba 2026-03-11 22:56:41,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:56:41,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5014ce46d8ec186ad6ba HTTP/1.1" 200 None 2026-03-11 22:56:41,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:56:41,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 22:56:41,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:56:41,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5014ce46d8ec186ad6ba HTTP/1.1" 200 None 2026-03-11 22:56:41,470 - lava_callback - ERROR - Error processing callback for node 69af5014ce46d8ec186ad6ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39710 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:57:17,747 - lava_callback - INFO - Received callback for node 69af503dce46d8ec186ad6c5 INFO: 172.19.0.1:39720 - "POST /node/69af503dce46d8ec186ad6c5 HTTP/1.0" 202 Accepted 2026-03-11 22:57:17,752 - lava_callback - INFO - Starting async job submit for node 69af503dce46d8ec186ad6c5 2026-03-11 22:57:17,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:57:17,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af503dce46d8ec186ad6c5 HTTP/1.1" 200 None 2026-03-11 22:57:17,774 - lava_callback - DEBUG - Processing node 69af503dce46d8ec186ad6c5: baseline-arm-clabbe 2026-03-11 22:57:17,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af503dce46d8ec186ad6c5 2026-03-11 22:57:17,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:57:17,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af503dce46d8ec186ad6c5 HTTP/1.1" 200 None 2026-03-11 22:57:17,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:57:17,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 22:57:17,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:57:17,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af503dce46d8ec186ad6c5 HTTP/1.1" 200 None 2026-03-11 22:57:17,833 - lava_callback - ERROR - Error processing callback for node 69af503dce46d8ec186ad6c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41656 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:59:17,836 - lava_callback - INFO - Received callback for node 69af50b1ce46d8ec186ad6e4 INFO: 172.19.0.1:41670 - "POST /node/69af50b1ce46d8ec186ad6e4 HTTP/1.0" 202 Accepted 2026-03-11 22:59:17,841 - lava_callback - INFO - Starting async job submit for node 69af50b1ce46d8ec186ad6e4 2026-03-11 22:59:17,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:59:17,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af50b1ce46d8ec186ad6e4 HTTP/1.1" 200 None 2026-03-11 22:59:17,857 - lava_callback - DEBUG - Processing node 69af50b1ce46d8ec186ad6e4: baseline-arm-clabbe 2026-03-11 22:59:17,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af50b1ce46d8ec186ad6e4 2026-03-11 22:59:17,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:59:17,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af50b1ce46d8ec186ad6e4 HTTP/1.1" 200 None 2026-03-11 22:59:17,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:59:17,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 22:59:17,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:59:17,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af50b1ce46d8ec186ad6e4 HTTP/1.1" 200 None 2026-03-11 22:59:17,928 - lava_callback - ERROR - Error processing callback for node 69af50b1ce46d8ec186ad6e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32806 - "GET / HTTP/1.0" 200 OK 2026-03-11 22:59:57,842 - lava_callback - INFO - Received callback for node 69af50d8ce46d8ec186ad6ef INFO: 172.19.0.1:32810 - "POST /node/69af50d8ce46d8ec186ad6ef HTTP/1.0" 202 Accepted 2026-03-11 22:59:57,852 - lava_callback - INFO - Starting async job submit for node 69af50d8ce46d8ec186ad6ef 2026-03-11 22:59:57,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:59:57,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af50d8ce46d8ec186ad6ef HTTP/1.1" 200 None 2026-03-11 22:59:57,872 - lava_callback - DEBUG - Processing node 69af50d8ce46d8ec186ad6ef: baseline-arm-clabbe 2026-03-11 22:59:57,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af50d8ce46d8ec186ad6ef 2026-03-11 22:59:57,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:59:57,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af50d8ce46d8ec186ad6ef HTTP/1.1" 200 None 2026-03-11 22:59:57,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:59:57,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 22:59:57,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 22:59:57,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af50d8ce46d8ec186ad6ef HTTP/1.1" 200 None 2026-03-11 22:59:57,938 - lava_callback - ERROR - Error processing callback for node 69af50d8ce46d8ec186ad6ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35860 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:00:38,117 - lava_callback - INFO - Received callback for node 69af5101ce46d8ec186ad6fc INFO: 172.19.0.1:35866 - "POST /node/69af5101ce46d8ec186ad6fc HTTP/1.0" 202 Accepted 2026-03-11 23:00:38,122 - lava_callback - INFO - Starting async job submit for node 69af5101ce46d8ec186ad6fc 2026-03-11 23:00:38,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:00:38,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5101ce46d8ec186ad6fc HTTP/1.1" 200 None 2026-03-11 23:00:38,142 - lava_callback - DEBUG - Processing node 69af5101ce46d8ec186ad6fc: baseline-arm-clabbe 2026-03-11 23:00:38,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5101ce46d8ec186ad6fc 2026-03-11 23:00:38,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:00:38,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5101ce46d8ec186ad6fc HTTP/1.1" 200 None 2026-03-11 23:00:38,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:00:38,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 23:00:38,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:00:38,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5101ce46d8ec186ad6fc HTTP/1.1" 200 None 2026-03-11 23:00:38,196 - lava_callback - ERROR - Error processing callback for node 69af5101ce46d8ec186ad6fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59208 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:01:17,876 - lava_callback - INFO - Received callback for node 69af5129ce46d8ec186ad703 INFO: 172.19.0.1:59212 - "POST /node/69af5129ce46d8ec186ad703 HTTP/1.0" 202 Accepted 2026-03-11 23:01:17,881 - lava_callback - INFO - Starting async job submit for node 69af5129ce46d8ec186ad703 2026-03-11 23:01:17,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:01:17,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5129ce46d8ec186ad703 HTTP/1.1" 200 None 2026-03-11 23:01:17,908 - lava_callback - DEBUG - Processing node 69af5129ce46d8ec186ad703: baseline-arm-clabbe 2026-03-11 23:01:17,908 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5129ce46d8ec186ad703 2026-03-11 23:01:17,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:01:17,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5129ce46d8ec186ad703 HTTP/1.1" 200 None 2026-03-11 23:01:17,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:01:17,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 23:01:17,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:01:17,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5129ce46d8ec186ad703 HTTP/1.1" 200 None 2026-03-11 23:01:17,970 - lava_callback - ERROR - Error processing callback for node 69af5129ce46d8ec186ad703: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42600 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:01:57,908 - lava_callback - INFO - Received callback for node 69af5153ce46d8ec186ad70c INFO: 172.19.0.1:42608 - "POST /node/69af5153ce46d8ec186ad70c HTTP/1.0" 202 Accepted 2026-03-11 23:01:57,913 - lava_callback - INFO - Starting async job submit for node 69af5153ce46d8ec186ad70c 2026-03-11 23:01:57,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:01:57,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5153ce46d8ec186ad70c HTTP/1.1" 200 None 2026-03-11 23:01:57,930 - lava_callback - DEBUG - Processing node 69af5153ce46d8ec186ad70c: baseline-arm-clabbe 2026-03-11 23:01:57,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5153ce46d8ec186ad70c 2026-03-11 23:01:57,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:01:57,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5153ce46d8ec186ad70c HTTP/1.1" 200 None 2026-03-11 23:01:57,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:01:57,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef424ce46d8ec186ab80e HTTP/1.1" 200 None 2026-03-11 23:01:57,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:01:57,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5153ce46d8ec186ad70c HTTP/1.1" 200 None 2026-03-11 23:01:57,999 - lava_callback - ERROR - Error processing callback for node 69af5153ce46d8ec186ad70c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33622 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:02:21,757 - lava_callback - INFO - Received callback for node 69af5178ce46d8ec186ad717 INFO: 172.19.0.1:54354 - "POST /node/69af5178ce46d8ec186ad717 HTTP/1.0" 202 Accepted 2026-03-11 23:02:21,763 - lava_callback - INFO - Starting async job submit for node 69af5178ce46d8ec186ad717 2026-03-11 23:02:21,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:02:21,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5178ce46d8ec186ad717 HTTP/1.1" 200 None 2026-03-11 23:02:21,797 - lava_callback - DEBUG - Processing node 69af5178ce46d8ec186ad717: baseline-arm-baylibre 2026-03-11 23:02:21,797 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5178ce46d8ec186ad717 2026-03-11 23:02:21,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:02:21,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5178ce46d8ec186ad717 HTTP/1.1" 200 None 2026-03-11 23:02:21,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:02:21,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 23:02:21,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:02:21,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5178ce46d8ec186ad717 HTTP/1.1" 200 None 2026-03-11 23:02:21,857 - lava_callback - ERROR - Error processing callback for node 69af5178ce46d8ec186ad717: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59168 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:03:17,998 - lava_callback - INFO - Received callback for node 69af51a3ce46d8ec186ad71e INFO: 172.19.0.1:59180 - "POST /node/69af51a3ce46d8ec186ad71e HTTP/1.0" 202 Accepted 2026-03-11 23:03:18,003 - lava_callback - INFO - Starting async job submit for node 69af51a3ce46d8ec186ad71e 2026-03-11 23:03:18,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:03:18,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af51a3ce46d8ec186ad71e HTTP/1.1" 200 None 2026-03-11 23:03:18,043 - lava_callback - DEBUG - Processing node 69af51a3ce46d8ec186ad71e: baseline-arm-clabbe 2026-03-11 23:03:18,043 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af51a3ce46d8ec186ad71e 2026-03-11 23:03:18,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:03:18,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af51a3ce46d8ec186ad71e HTTP/1.1" 200 None 2026-03-11 23:03:18,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:03:18,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 23:03:18,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:03:18,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af51a3ce46d8ec186ad71e HTTP/1.1" 200 None 2026-03-11 23:03:18,111 - lava_callback - ERROR - Error processing callback for node 69af51a3ce46d8ec186ad71e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33018 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:03:58,041 - lava_callback - INFO - Received callback for node 69af51cbce46d8ec186ad728 INFO: 172.19.0.1:33024 - "POST /node/69af51cbce46d8ec186ad728 HTTP/1.0" 202 Accepted 2026-03-11 23:03:58,046 - lava_callback - INFO - Starting async job submit for node 69af51cbce46d8ec186ad728 2026-03-11 23:03:58,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:03:58,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af51cbce46d8ec186ad728 HTTP/1.1" 200 None 2026-03-11 23:03:58,065 - lava_callback - DEBUG - Processing node 69af51cbce46d8ec186ad728: baseline-arm-clabbe 2026-03-11 23:03:58,065 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af51cbce46d8ec186ad728 2026-03-11 23:03:58,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:03:58,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af51cbce46d8ec186ad728 HTTP/1.1" 200 None 2026-03-11 23:03:58,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:03:58,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 23:03:58,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:03:58,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af51cbce46d8ec186ad728 HTTP/1.1" 200 None 2026-03-11 23:03:58,122 - lava_callback - ERROR - Error processing callback for node 69af51cbce46d8ec186ad728: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47934 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:04:39,407 - lava_callback - INFO - Received callback for node 69af51f5ce46d8ec186ad736 INFO: 172.19.0.1:47938 - "POST /node/69af51f5ce46d8ec186ad736 HTTP/1.0" 202 Accepted 2026-03-11 23:04:39,413 - lava_callback - INFO - Starting async job submit for node 69af51f5ce46d8ec186ad736 2026-03-11 23:04:39,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:04:39,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af51f5ce46d8ec186ad736 HTTP/1.1" 200 None 2026-03-11 23:04:39,429 - lava_callback - DEBUG - Processing node 69af51f5ce46d8ec186ad736: baseline-arm-clabbe 2026-03-11 23:04:39,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af51f5ce46d8ec186ad736 2026-03-11 23:04:39,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:04:39,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af51f5ce46d8ec186ad736 HTTP/1.1" 200 None 2026-03-11 23:04:39,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:04:39,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 23:04:39,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:04:39,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af51f5ce46d8ec186ad736 HTTP/1.1" 200 None 2026-03-11 23:04:39,486 - lava_callback - ERROR - Error processing callback for node 69af51f5ce46d8ec186ad736: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50918 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:05:18,052 - lava_callback - INFO - Received callback for node 69af521dce46d8ec186ad73d INFO: 172.19.0.1:50926 - "POST /node/69af521dce46d8ec186ad73d HTTP/1.0" 202 Accepted 2026-03-11 23:05:18,058 - lava_callback - INFO - Starting async job submit for node 69af521dce46d8ec186ad73d 2026-03-11 23:05:18,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:05:18,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af521dce46d8ec186ad73d HTTP/1.1" 200 None 2026-03-11 23:05:18,074 - lava_callback - DEBUG - Processing node 69af521dce46d8ec186ad73d: baseline-arm-clabbe 2026-03-11 23:05:18,074 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af521dce46d8ec186ad73d 2026-03-11 23:05:18,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:05:18,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af521dce46d8ec186ad73d HTTP/1.1" 200 None 2026-03-11 23:05:18,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:05:18,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 23:05:18,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:05:18,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af521dce46d8ec186ad73d HTTP/1.1" 200 None 2026-03-11 23:05:18,136 - lava_callback - ERROR - Error processing callback for node 69af521dce46d8ec186ad73d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48460 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:05:59,750 - lava_callback - INFO - Received callback for node 69af5245ce46d8ec186ad746 INFO: 172.19.0.1:45846 - "POST /node/69af5245ce46d8ec186ad746 HTTP/1.0" 202 Accepted 2026-03-11 23:05:59,755 - lava_callback - INFO - Starting async job submit for node 69af5245ce46d8ec186ad746 2026-03-11 23:05:59,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:05:59,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5245ce46d8ec186ad746 HTTP/1.1" 200 None 2026-03-11 23:05:59,782 - lava_callback - DEBUG - Processing node 69af5245ce46d8ec186ad746: baseline-arm-clabbe 2026-03-11 23:05:59,782 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5245ce46d8ec186ad746 2026-03-11 23:05:59,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:05:59,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5245ce46d8ec186ad746 HTTP/1.1" 200 None 2026-03-11 23:05:59,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:05:59,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 23:05:59,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:05:59,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5245ce46d8ec186ad746 HTTP/1.1" 200 None 2026-03-11 23:05:59,838 - lava_callback - ERROR - Error processing callback for node 69af5245ce46d8ec186ad746: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52662 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:06:38,098 - lava_callback - INFO - Received callback for node 69af526ece46d8ec186ad753 INFO: 172.19.0.1:52672 - "POST /node/69af526ece46d8ec186ad753 HTTP/1.0" 202 Accepted 2026-03-11 23:06:38,104 - lava_callback - INFO - Starting async job submit for node 69af526ece46d8ec186ad753 2026-03-11 23:06:38,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:06:38,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af526ece46d8ec186ad753 HTTP/1.1" 200 None 2026-03-11 23:06:38,120 - lava_callback - DEBUG - Processing node 69af526ece46d8ec186ad753: baseline-arm-clabbe 2026-03-11 23:06:38,120 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af526ece46d8ec186ad753 2026-03-11 23:06:38,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:06:38,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af526ece46d8ec186ad753 HTTP/1.1" 200 None 2026-03-11 23:06:38,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:06:40,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f6846f7ae8ff3364c2c HTTP/1.1" 200 None 2026-03-11 23:06:40,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:06:40,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af526ece46d8ec186ad753 HTTP/1.1" 200 None 2026-03-11 23:06:40,770 - lava_callback - ERROR - Error processing callback for node 69af526ece46d8ec186ad753: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42350 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:07:21,968 - lava_callback - INFO - Received callback for node 69af529dce46d8ec186ad760 INFO: 172.19.0.1:53304 - "POST /node/69af529dce46d8ec186ad760 HTTP/1.0" 202 Accepted 2026-03-11 23:07:21,974 - lava_callback - INFO - Starting async job submit for node 69af529dce46d8ec186ad760 2026-03-11 23:07:21,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:07:21,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af529dce46d8ec186ad760 HTTP/1.1" 200 None 2026-03-11 23:07:21,991 - lava_callback - DEBUG - Processing node 69af529dce46d8ec186ad760: baseline-arm64-baylibre 2026-03-11 23:07:21,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af529dce46d8ec186ad760 2026-03-11 23:07:21,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:07:22,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af529dce46d8ec186ad760 HTTP/1.1" 200 None 2026-03-11 23:07:22,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:07:22,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750ca5a0c0e10c481a7c4 HTTP/1.1" 200 None 2026-03-11 23:07:22,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:07:22,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af529dce46d8ec186ad760 HTTP/1.1" 200 None 2026-03-11 23:07:22,047 - lava_callback - ERROR - Error processing callback for node 69af529dce46d8ec186ad760: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42142 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:08:38,182 - lava_callback - INFO - Received callback for node 69af52e4ce46d8ec186ad76d INFO: 172.19.0.1:42158 - "POST /node/69af52e4ce46d8ec186ad76d HTTP/1.0" 202 Accepted 2026-03-11 23:08:38,188 - lava_callback - INFO - Starting async job submit for node 69af52e4ce46d8ec186ad76d 2026-03-11 23:08:38,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:08:38,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af52e4ce46d8ec186ad76d HTTP/1.1" 200 None 2026-03-11 23:08:38,242 - lava_callback - DEBUG - Processing node 69af52e4ce46d8ec186ad76d: baseline-arm-clabbe 2026-03-11 23:08:38,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af52e4ce46d8ec186ad76d 2026-03-11 23:08:38,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:08:38,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af52e4ce46d8ec186ad76d HTTP/1.1" 200 None 2026-03-11 23:08:38,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:08:38,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 23:08:38,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:08:38,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af52e4ce46d8ec186ad76d HTTP/1.1" 200 None 2026-03-11 23:08:38,320 - lava_callback - ERROR - Error processing callback for node 69af52e4ce46d8ec186ad76d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39776 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:09:22,120 - lava_callback - INFO - Received callback for node 69af5318ce46d8ec186ad774 INFO: 172.19.0.1:49162 - "POST /node/69af5318ce46d8ec186ad774 HTTP/1.0" 202 Accepted 2026-03-11 23:09:22,125 - lava_callback - INFO - Starting async job submit for node 69af5318ce46d8ec186ad774 2026-03-11 23:09:22,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:09:22,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5318ce46d8ec186ad774 HTTP/1.1" 200 None 2026-03-11 23:09:22,149 - lava_callback - DEBUG - Processing node 69af5318ce46d8ec186ad774: baseline-arm64-baylibre 2026-03-11 23:09:22,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5318ce46d8ec186ad774 2026-03-11 23:09:22,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:09:22,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5318ce46d8ec186ad774 HTTP/1.1" 200 None 2026-03-11 23:09:22,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:09:22,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a750ca5a0c0e10c481a7c4 HTTP/1.1" 200 None 2026-03-11 23:09:22,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:09:22,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5318ce46d8ec186ad774 HTTP/1.1" 200 None 2026-03-11 23:09:22,208 - lava_callback - ERROR - Error processing callback for node 69af5318ce46d8ec186ad774: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39990 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:10:38,237 - lava_callback - INFO - Received callback for node 69af5360ce46d8ec186ad781 INFO: 172.19.0.1:40002 - "POST /node/69af5360ce46d8ec186ad781 HTTP/1.0" 202 Accepted 2026-03-11 23:10:38,242 - lava_callback - INFO - Starting async job submit for node 69af5360ce46d8ec186ad781 2026-03-11 23:10:38,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:10:38,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5360ce46d8ec186ad781 HTTP/1.1" 200 None 2026-03-11 23:10:38,257 - lava_callback - DEBUG - Processing node 69af5360ce46d8ec186ad781: baseline-arm-clabbe 2026-03-11 23:10:38,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5360ce46d8ec186ad781 2026-03-11 23:10:38,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:10:38,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5360ce46d8ec186ad781 HTTP/1.1" 200 None 2026-03-11 23:10:38,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:10:38,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 23:10:38,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:10:38,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5360ce46d8ec186ad781 HTTP/1.1" 200 None 2026-03-11 23:10:38,317 - lava_callback - ERROR - Error processing callback for node 69af5360ce46d8ec186ad781: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53696 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:11:18,235 - lava_callback - INFO - Received callback for node 69af538dce46d8ec186ad78a INFO: 172.19.0.1:53698 - "POST /node/69af538dce46d8ec186ad78a HTTP/1.0" 202 Accepted 2026-03-11 23:11:18,241 - lava_callback - INFO - Starting async job submit for node 69af538dce46d8ec186ad78a 2026-03-11 23:11:18,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:11:18,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af538dce46d8ec186ad78a HTTP/1.1" 200 None 2026-03-11 23:11:18,256 - lava_callback - DEBUG - Processing node 69af538dce46d8ec186ad78a: baseline-arm-clabbe 2026-03-11 23:11:18,257 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af538dce46d8ec186ad78a 2026-03-11 23:11:18,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:11:18,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af538dce46d8ec186ad78a HTTP/1.1" 200 None 2026-03-11 23:11:18,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:11:18,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 23:11:18,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:11:18,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af538dce46d8ec186ad78a HTTP/1.1" 200 None 2026-03-11 23:11:18,312 - lava_callback - ERROR - Error processing callback for node 69af538dce46d8ec186ad78a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33932 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:12:02,300 - lava_callback - INFO - Received callback for node 69af53b9ce46d8ec186ad795 INFO: 172.19.0.1:51682 - "POST /node/69af53b9ce46d8ec186ad795 HTTP/1.0" 202 Accepted 2026-03-11 23:12:02,305 - lava_callback - INFO - Starting async job submit for node 69af53b9ce46d8ec186ad795 2026-03-11 23:12:02,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:12:02,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af53b9ce46d8ec186ad795 HTTP/1.1" 200 None 2026-03-11 23:12:02,322 - lava_callback - DEBUG - Processing node 69af53b9ce46d8ec186ad795: baseline-arm64-baylibre 2026-03-11 23:12:02,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af53b9ce46d8ec186ad795 2026-03-11 23:12:02,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:12:02,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af53b9ce46d8ec186ad795 HTTP/1.1" 200 None 2026-03-11 23:12:02,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:12:02,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 23:12:02,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:12:02,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af53b9ce46d8ec186ad795 HTTP/1.1" 200 None 2026-03-11 23:12:02,388 - lava_callback - ERROR - Error processing callback for node 69af53b9ce46d8ec186ad795: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49860 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:13:42,373 - lava_callback - INFO - Received callback for node 69af5411ce46d8ec186ad7a2 INFO: 172.19.0.1:41970 - "POST /node/69af5411ce46d8ec186ad7a2 HTTP/1.0" 202 Accepted 2026-03-11 23:13:42,379 - lava_callback - INFO - Starting async job submit for node 69af5411ce46d8ec186ad7a2 2026-03-11 23:13:42,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:13:42,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5411ce46d8ec186ad7a2 HTTP/1.1" 200 None 2026-03-11 23:13:42,394 - lava_callback - DEBUG - Processing node 69af5411ce46d8ec186ad7a2: baseline-arm64-baylibre 2026-03-11 23:13:42,394 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5411ce46d8ec186ad7a2 2026-03-11 23:13:42,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:13:42,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5411ce46d8ec186ad7a2 HTTP/1.1" 200 None 2026-03-11 23:13:42,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:13:42,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 23:13:42,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:13:42,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5411ce46d8ec186ad7a2 HTTP/1.1" 200 None 2026-03-11 23:13:42,466 - lava_callback - ERROR - Error processing callback for node 69af5411ce46d8ec186ad7a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49342 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:14:38,403 - lava_callback - INFO - Received callback for node 69af545cce46d8ec186ad7ae INFO: 172.19.0.1:49344 - "POST /node/69af545cce46d8ec186ad7ae HTTP/1.0" 202 Accepted 2026-03-11 23:14:38,409 - lava_callback - INFO - Starting async job submit for node 69af545cce46d8ec186ad7ae 2026-03-11 23:14:38,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:14:38,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af545cce46d8ec186ad7ae HTTP/1.1" 200 None 2026-03-11 23:14:38,425 - lava_callback - DEBUG - Processing node 69af545cce46d8ec186ad7ae: baseline-arm-clabbe 2026-03-11 23:14:38,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af545cce46d8ec186ad7ae 2026-03-11 23:14:38,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:14:38,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af545cce46d8ec186ad7ae HTTP/1.1" 200 None 2026-03-11 23:14:38,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:14:38,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 23:14:38,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:14:38,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af545cce46d8ec186ad7ae HTTP/1.1" 200 None 2026-03-11 23:14:38,488 - lava_callback - ERROR - Error processing callback for node 69af545cce46d8ec186ad7ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42802 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:15:42,444 - lava_callback - INFO - Received callback for node 69af5489ce46d8ec186ad7ba INFO: 172.19.0.1:57742 - "POST /node/69af5489ce46d8ec186ad7ba HTTP/1.0" 202 Accepted 2026-03-11 23:15:42,450 - lava_callback - INFO - Starting async job submit for node 69af5489ce46d8ec186ad7ba 2026-03-11 23:15:42,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:15:42,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5489ce46d8ec186ad7ba HTTP/1.1" 200 None 2026-03-11 23:15:42,467 - lava_callback - DEBUG - Processing node 69af5489ce46d8ec186ad7ba: baseline-arm64-baylibre 2026-03-11 23:15:42,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5489ce46d8ec186ad7ba 2026-03-11 23:15:42,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:15:42,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5489ce46d8ec186ad7ba HTTP/1.1" 200 None 2026-03-11 23:15:42,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:15:42,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 23:15:42,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:15:42,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5489ce46d8ec186ad7ba HTTP/1.1" 200 None 2026-03-11 23:15:42,530 - lava_callback - ERROR - Error processing callback for node 69af5489ce46d8ec186ad7ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53884 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:16:42,449 - lava_callback - INFO - Received callback for node 69af54d8ce46d8ec186ad7c1 INFO: 172.19.0.1:47480 - "POST /node/69af54d8ce46d8ec186ad7c1 HTTP/1.0" 202 Accepted 2026-03-11 23:16:42,454 - lava_callback - INFO - Starting async job submit for node 69af54d8ce46d8ec186ad7c1 2026-03-11 23:16:42,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:16:42,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af54d8ce46d8ec186ad7c1 HTTP/1.1" 200 None 2026-03-11 23:16:42,470 - lava_callback - DEBUG - Processing node 69af54d8ce46d8ec186ad7c1: baseline-arm64-baylibre 2026-03-11 23:16:42,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af54d8ce46d8ec186ad7c1 2026-03-11 23:16:42,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:16:42,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af54d8ce46d8ec186ad7c1 HTTP/1.1" 200 None 2026-03-11 23:16:42,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:16:42,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 23:16:42,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:16:42,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af54d8ce46d8ec186ad7c1 HTTP/1.1" 200 None 2026-03-11 23:16:42,527 - lava_callback - ERROR - Error processing callback for node 69af54d8ce46d8ec186ad7c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37266 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:18:02,577 - lava_callback - INFO - Received callback for node 69af5528ce46d8ec186ad7ce INFO: 172.19.0.1:35728 - "POST /node/69af5528ce46d8ec186ad7ce HTTP/1.0" 202 Accepted 2026-03-11 23:18:02,582 - lava_callback - INFO - Starting async job submit for node 69af5528ce46d8ec186ad7ce 2026-03-11 23:18:02,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:18:02,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5528ce46d8ec186ad7ce HTTP/1.1" 200 None 2026-03-11 23:18:02,599 - lava_callback - DEBUG - Processing node 69af5528ce46d8ec186ad7ce: baseline-arm64-baylibre 2026-03-11 23:18:02,599 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5528ce46d8ec186ad7ce 2026-03-11 23:18:02,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:18:02,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5528ce46d8ec186ad7ce HTTP/1.1" 200 None 2026-03-11 23:18:02,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:18:02,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 23:18:02,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:18:02,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5528ce46d8ec186ad7ce HTTP/1.1" 200 None 2026-03-11 23:18:02,664 - lava_callback - ERROR - Error processing callback for node 69af5528ce46d8ec186ad7ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53540 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:19:22,613 - lava_callback - INFO - Received callback for node 69af5579ce46d8ec186ad7db INFO: 172.19.0.1:50544 - "POST /node/69af5579ce46d8ec186ad7db HTTP/1.0" 202 Accepted 2026-03-11 23:19:22,618 - lava_callback - INFO - Starting async job submit for node 69af5579ce46d8ec186ad7db 2026-03-11 23:19:22,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:19:22,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5579ce46d8ec186ad7db HTTP/1.1" 200 None 2026-03-11 23:19:22,633 - lava_callback - DEBUG - Processing node 69af5579ce46d8ec186ad7db: baseline-arm64-baylibre 2026-03-11 23:19:22,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5579ce46d8ec186ad7db 2026-03-11 23:19:22,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:19:22,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5579ce46d8ec186ad7db HTTP/1.1" 200 None 2026-03-11 23:19:22,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:19:22,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 23:19:22,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:19:22,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5579ce46d8ec186ad7db HTTP/1.1" 200 None 2026-03-11 23:19:22,687 - lava_callback - ERROR - Error processing callback for node 69af5579ce46d8ec186ad7db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51006 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:20:58,753 - lava_callback - INFO - Received callback for node 69af55d1ce46d8ec186ad7e5 INFO: 172.19.0.1:51010 - "POST /node/69af55d1ce46d8ec186ad7e5 HTTP/1.0" 202 Accepted 2026-03-11 23:20:58,759 - lava_callback - INFO - Starting async job submit for node 69af55d1ce46d8ec186ad7e5 2026-03-11 23:20:58,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:20:58,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af55d1ce46d8ec186ad7e5 HTTP/1.1" 200 None 2026-03-11 23:20:58,775 - lava_callback - DEBUG - Processing node 69af55d1ce46d8ec186ad7e5: baseline-arm64-clabbe 2026-03-11 23:20:58,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af55d1ce46d8ec186ad7e5 2026-03-11 23:20:58,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:20:58,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af55d1ce46d8ec186ad7e5 HTTP/1.1" 200 None 2026-03-11 23:20:58,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:20:58,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 23:20:58,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:20:58,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af55d1ce46d8ec186ad7e5 HTTP/1.1" 200 None 2026-03-11 23:20:58,836 - lava_callback - ERROR - Error processing callback for node 69af55d1ce46d8ec186ad7e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33836 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:23:18,768 - lava_callback - INFO - Received callback for node 69af5660ce46d8ec186ad819 INFO: 172.19.0.1:33846 - "POST /node/69af5660ce46d8ec186ad819 HTTP/1.0" 202 Accepted 2026-03-11 23:23:18,773 - lava_callback - INFO - Starting async job submit for node 69af5660ce46d8ec186ad819 2026-03-11 23:23:18,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:23:18,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5660ce46d8ec186ad819 HTTP/1.1" 200 None 2026-03-11 23:23:18,803 - lava_callback - DEBUG - Processing node 69af5660ce46d8ec186ad819: baseline-arm64-clabbe 2026-03-11 23:23:18,803 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5660ce46d8ec186ad819 2026-03-11 23:23:18,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:23:18,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5660ce46d8ec186ad819 HTTP/1.1" 200 None 2026-03-11 23:23:18,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:23:18,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 23:23:18,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:23:18,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5660ce46d8ec186ad819 HTTP/1.1" 200 None 2026-03-11 23:23:18,854 - lava_callback - ERROR - Error processing callback for node 69af5660ce46d8ec186ad819: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44612 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:24:43,217 - lava_callback - INFO - Received callback for node 69af56abce46d8ec186ad831 INFO: 172.19.0.1:35704 - "POST /node/69af56abce46d8ec186ad831 HTTP/1.0" 202 Accepted 2026-03-11 23:24:43,223 - lava_callback - INFO - Starting async job submit for node 69af56abce46d8ec186ad831 2026-03-11 23:24:43,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:24:43,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af56abce46d8ec186ad831 HTTP/1.1" 200 None 2026-03-11 23:24:43,239 - lava_callback - DEBUG - Processing node 69af56abce46d8ec186ad831: baseline-arm64-baylibre 2026-03-11 23:24:43,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af56abce46d8ec186ad831 2026-03-11 23:24:43,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:24:43,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af56abce46d8ec186ad831 HTTP/1.1" 200 None 2026-03-11 23:24:43,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:24:43,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 23:24:43,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:24:43,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af56abce46d8ec186ad831 HTTP/1.1" 200 None 2026-03-11 23:24:43,294 - lava_callback - ERROR - Error processing callback for node 69af56abce46d8ec186ad831: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50266 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:25:58,895 - lava_callback - INFO - Received callback for node 69af5703ce46d8ec186ad83c INFO: 172.19.0.1:50268 - "POST /node/69af5703ce46d8ec186ad83c HTTP/1.0" 202 Accepted 2026-03-11 23:25:58,900 - lava_callback - INFO - Starting async job submit for node 69af5703ce46d8ec186ad83c 2026-03-11 23:25:58,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:25:58,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5703ce46d8ec186ad83c HTTP/1.1" 200 None 2026-03-11 23:25:58,918 - lava_callback - DEBUG - Processing node 69af5703ce46d8ec186ad83c: baseline-arm64-clabbe 2026-03-11 23:25:58,919 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5703ce46d8ec186ad83c 2026-03-11 23:25:58,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:25:58,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5703ce46d8ec186ad83c HTTP/1.1" 200 None 2026-03-11 23:25:58,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:25:58,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 23:25:58,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:25:59,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5703ce46d8ec186ad83c HTTP/1.1" 200 None 2026-03-11 23:25:59,025 - lava_callback - ERROR - Error processing callback for node 69af5703ce46d8ec186ad83c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59164 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:27:38,958 - lava_callback - INFO - Received callback for node 69af5756ce46d8ec186ad846 INFO: 172.19.0.1:59178 - "POST /node/69af5756ce46d8ec186ad846 HTTP/1.0" 202 Accepted 2026-03-11 23:27:38,964 - lava_callback - INFO - Starting async job submit for node 69af5756ce46d8ec186ad846 2026-03-11 23:27:38,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:27:38,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5756ce46d8ec186ad846 HTTP/1.1" 200 None 2026-03-11 23:27:38,989 - lava_callback - DEBUG - Processing node 69af5756ce46d8ec186ad846: baseline-arm64-clabbe 2026-03-11 23:27:38,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5756ce46d8ec186ad846 2026-03-11 23:27:38,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:27:39,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5756ce46d8ec186ad846 HTTP/1.1" 200 None 2026-03-11 23:27:39,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:27:39,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4f7446f7ae8ff3364c45 HTTP/1.1" 200 None 2026-03-11 23:27:39,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:27:39,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5756ce46d8ec186ad846 HTTP/1.1" 200 None 2026-03-11 23:27:39,051 - lava_callback - ERROR - Error processing callback for node 69af5756ce46d8ec186ad846: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51510 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:28:39,012 - lava_callback - INFO - Received callback for node 69af579ace46d8ec186ad84c INFO: 172.19.0.1:51512 - "POST /node/69af579ace46d8ec186ad84c HTTP/1.0" 202 Accepted 2026-03-11 23:28:39,018 - lava_callback - INFO - Starting async job submit for node 69af579ace46d8ec186ad84c 2026-03-11 23:28:39,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:28:39,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af579ace46d8ec186ad84c HTTP/1.1" 200 None 2026-03-11 23:28:39,036 - lava_callback - DEBUG - Processing node 69af579ace46d8ec186ad84c: baseline-arm-clabbe 2026-03-11 23:28:39,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af579ace46d8ec186ad84c 2026-03-11 23:28:39,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:28:39,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af579ace46d8ec186ad84c HTTP/1.1" 200 None 2026-03-11 23:28:39,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:28:39,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 23:28:39,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:28:39,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af579ace46d8ec186ad84c HTTP/1.1" 200 None 2026-03-11 23:28:39,097 - lava_callback - ERROR - Error processing callback for node 69af579ace46d8ec186ad84c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54886 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:29:18,975 - lava_callback - INFO - Received callback for node 69af57c3ce46d8ec186ad859 INFO: 172.19.0.1:54898 - "POST /node/69af57c3ce46d8ec186ad859 HTTP/1.0" 202 Accepted 2026-03-11 23:29:18,980 - lava_callback - INFO - Starting async job submit for node 69af57c3ce46d8ec186ad859 2026-03-11 23:29:18,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:29:19,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af57c3ce46d8ec186ad859 HTTP/1.1" 200 None 2026-03-11 23:29:19,007 - lava_callback - DEBUG - Processing node 69af57c3ce46d8ec186ad859: baseline-arm-clabbe 2026-03-11 23:29:19,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af57c3ce46d8ec186ad859 2026-03-11 23:29:19,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:29:19,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af57c3ce46d8ec186ad859 HTTP/1.1" 200 None 2026-03-11 23:29:19,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:29:19,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acd99c5f93e4f05eb2ac HTTP/1.1" 200 None 2026-03-11 23:29:19,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:29:19,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af57c3ce46d8ec186ad859 HTTP/1.1" 200 None 2026-03-11 23:29:19,075 - lava_callback - ERROR - Error processing callback for node 69af57c3ce46d8ec186ad859: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50890 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:32:43,618 - lava_callback - INFO - Received callback for node 69af588bce46d8ec186ad879 INFO: 172.19.0.1:57868 - "POST /node/69af588bce46d8ec186ad879 HTTP/1.0" 202 Accepted 2026-03-11 23:32:43,624 - lava_callback - INFO - Starting async job submit for node 69af588bce46d8ec186ad879 2026-03-11 23:32:43,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:32:43,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af588bce46d8ec186ad879 HTTP/1.1" 200 None 2026-03-11 23:32:43,640 - lava_callback - DEBUG - Processing node 69af588bce46d8ec186ad879: baseline-arm64-baylibre 2026-03-11 23:32:43,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af588bce46d8ec186ad879 2026-03-11 23:32:43,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:32:43,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af588bce46d8ec186ad879 HTTP/1.1" 200 None 2026-03-11 23:32:43,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:32:43,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 23:32:43,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:32:43,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af588bce46d8ec186ad879 HTTP/1.1" 200 None 2026-03-11 23:32:43,699 - lava_callback - ERROR - Error processing callback for node 69af588bce46d8ec186ad879: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46416 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:34:03,364 - lava_callback - INFO - Received callback for node 69af58dbce46d8ec186ad883 INFO: 172.19.0.1:50114 - "POST /node/69af58dbce46d8ec186ad883 HTTP/1.0" 202 Accepted 2026-03-11 23:34:03,370 - lava_callback - INFO - Starting async job submit for node 69af58dbce46d8ec186ad883 2026-03-11 23:34:03,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:34:03,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af58dbce46d8ec186ad883 HTTP/1.1" 200 None 2026-03-11 23:34:03,393 - lava_callback - DEBUG - Processing node 69af58dbce46d8ec186ad883: baseline-arm64-baylibre 2026-03-11 23:34:03,394 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af58dbce46d8ec186ad883 2026-03-11 23:34:03,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:34:03,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af58dbce46d8ec186ad883 HTTP/1.1" 200 None 2026-03-11 23:34:03,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:34:03,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 23:34:03,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:34:03,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af58dbce46d8ec186ad883 HTTP/1.1" 200 None 2026-03-11 23:34:03,448 - lava_callback - ERROR - Error processing callback for node 69af58dbce46d8ec186ad883: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45252 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:35:23,447 - lava_callback - INFO - Received callback for node 69af592bce46d8ec186ad888 INFO: 172.19.0.1:33462 - "POST /node/69af592bce46d8ec186ad888 HTTP/1.0" 202 Accepted 2026-03-11 23:35:23,453 - lava_callback - INFO - Starting async job submit for node 69af592bce46d8ec186ad888 2026-03-11 23:35:23,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:35:23,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af592bce46d8ec186ad888 HTTP/1.1" 200 None 2026-03-11 23:35:23,474 - lava_callback - DEBUG - Processing node 69af592bce46d8ec186ad888: baseline-arm64-baylibre 2026-03-11 23:35:23,475 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af592bce46d8ec186ad888 2026-03-11 23:35:23,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:35:23,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af592bce46d8ec186ad888 HTTP/1.1" 200 None 2026-03-11 23:35:23,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:35:23,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 23:35:23,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:35:23,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af592bce46d8ec186ad888 HTTP/1.1" 200 None 2026-03-11 23:35:23,545 - lava_callback - ERROR - Error processing callback for node 69af592bce46d8ec186ad888: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44172 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:36:43,529 - lava_callback - INFO - Received callback for node 69af597cce46d8ec186ad891 INFO: 172.19.0.1:45518 - "POST /node/69af597cce46d8ec186ad891 HTTP/1.0" 202 Accepted 2026-03-11 23:36:43,534 - lava_callback - INFO - Starting async job submit for node 69af597cce46d8ec186ad891 2026-03-11 23:36:43,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:36:43,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af597cce46d8ec186ad891 HTTP/1.1" 200 None 2026-03-11 23:36:43,551 - lava_callback - DEBUG - Processing node 69af597cce46d8ec186ad891: baseline-arm64-baylibre 2026-03-11 23:36:43,551 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af597cce46d8ec186ad891 2026-03-11 23:36:43,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:36:43,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af597cce46d8ec186ad891 HTTP/1.1" 200 None 2026-03-11 23:36:43,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:36:43,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 23:36:43,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:36:43,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af597cce46d8ec186ad891 HTTP/1.1" 200 None 2026-03-11 23:36:43,615 - lava_callback - ERROR - Error processing callback for node 69af597cce46d8ec186ad891: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36224 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:38:03,684 - lava_callback - INFO - Received callback for node 69af59cdce46d8ec186ad89b INFO: 172.19.0.1:34148 - "POST /node/69af59cdce46d8ec186ad89b HTTP/1.0" 202 Accepted 2026-03-11 23:38:03,690 - lava_callback - INFO - Starting async job submit for node 69af59cdce46d8ec186ad89b 2026-03-11 23:38:03,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:38:03,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af59cdce46d8ec186ad89b HTTP/1.1" 200 None 2026-03-11 23:38:03,726 - lava_callback - DEBUG - Processing node 69af59cdce46d8ec186ad89b: baseline-arm64-baylibre 2026-03-11 23:38:03,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af59cdce46d8ec186ad89b 2026-03-11 23:38:03,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:38:03,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af59cdce46d8ec186ad89b HTTP/1.1" 200 None 2026-03-11 23:38:03,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:38:03,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 23:38:03,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:38:03,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af59cdce46d8ec186ad89b HTTP/1.1" 200 None 2026-03-11 23:38:03,778 - lava_callback - ERROR - Error processing callback for node 69af59cdce46d8ec186ad89b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38930 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:39:23,764 - lava_callback - INFO - Received callback for node 69af5a1ece46d8ec186ad8a0 INFO: 172.19.0.1:39764 - "POST /node/69af5a1ece46d8ec186ad8a0 HTTP/1.0" 202 Accepted 2026-03-11 23:39:23,770 - lava_callback - INFO - Starting async job submit for node 69af5a1ece46d8ec186ad8a0 2026-03-11 23:39:23,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:39:23,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5a1ece46d8ec186ad8a0 HTTP/1.1" 200 None 2026-03-11 23:39:23,786 - lava_callback - DEBUG - Processing node 69af5a1ece46d8ec186ad8a0: baseline-arm64-baylibre 2026-03-11 23:39:23,787 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5a1ece46d8ec186ad8a0 2026-03-11 23:39:23,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:39:23,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5a1ece46d8ec186ad8a0 HTTP/1.1" 200 None 2026-03-11 23:39:23,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:39:23,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 23:39:23,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:39:23,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5a1ece46d8ec186ad8a0 HTTP/1.1" 200 None 2026-03-11 23:39:23,857 - lava_callback - ERROR - Error processing callback for node 69af5a1ece46d8ec186ad8a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44972 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:41:59,532 - lava_callback - INFO - Received callback for node 69af5ac5ce46d8ec186ad8b3 INFO: 172.19.0.1:44984 - "POST /node/69af5ac5ce46d8ec186ad8b3 HTTP/1.0" 202 Accepted 2026-03-11 23:41:59,538 - lava_callback - INFO - Starting async job submit for node 69af5ac5ce46d8ec186ad8b3 2026-03-11 23:41:59,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:41:59,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5ac5ce46d8ec186ad8b3 HTTP/1.1" 200 None 2026-03-11 23:41:59,556 - lava_callback - DEBUG - Processing node 69af5ac5ce46d8ec186ad8b3: baseline-arm64-clabbe 2026-03-11 23:41:59,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5ac5ce46d8ec186ad8b3 2026-03-11 23:41:59,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:41:59,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5ac5ce46d8ec186ad8b3 HTTP/1.1" 200 None 2026-03-11 23:41:59,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:41:59,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 23:41:59,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:41:59,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5ac5ce46d8ec186ad8b3 HTTP/1.1" 200 None 2026-03-11 23:41:59,618 - lava_callback - ERROR - Error processing callback for node 69af5ac5ce46d8ec186ad8b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45464 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:43:39,699 - lava_callback - INFO - Received callback for node 69af5b16ce46d8ec186ad8bb INFO: 172.19.0.1:43090 - "POST /node/69af5b16ce46d8ec186ad8bb HTTP/1.0" 202 Accepted 2026-03-11 23:43:39,705 - lava_callback - INFO - Starting async job submit for node 69af5b16ce46d8ec186ad8bb 2026-03-11 23:43:39,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:43:39,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5b16ce46d8ec186ad8bb HTTP/1.1" 200 None 2026-03-11 23:43:39,721 - lava_callback - DEBUG - Processing node 69af5b16ce46d8ec186ad8bb: baseline-arm64-clabbe 2026-03-11 23:43:39,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5b16ce46d8ec186ad8bb 2026-03-11 23:43:39,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:43:39,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5b16ce46d8ec186ad8bb HTTP/1.1" 200 None 2026-03-11 23:43:39,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:43:39,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 23:43:39,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:43:39,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5b16ce46d8ec186ad8bb HTTP/1.1" 200 None 2026-03-11 23:43:39,785 - lava_callback - ERROR - Error processing callback for node 69af5b16ce46d8ec186ad8bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42958 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:44:59,641 - lava_callback - INFO - Received callback for node 69af5b66ce46d8ec186ad8c0 INFO: 172.19.0.1:42962 - "POST /node/69af5b66ce46d8ec186ad8c0 HTTP/1.0" 202 Accepted 2026-03-11 23:44:59,647 - lava_callback - INFO - Starting async job submit for node 69af5b66ce46d8ec186ad8c0 2026-03-11 23:44:59,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:44:59,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5b66ce46d8ec186ad8c0 HTTP/1.1" 200 None 2026-03-11 23:44:59,665 - lava_callback - DEBUG - Processing node 69af5b66ce46d8ec186ad8c0: baseline-arm64-clabbe 2026-03-11 23:44:59,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5b66ce46d8ec186ad8c0 2026-03-11 23:44:59,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:44:59,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5b66ce46d8ec186ad8c0 HTTP/1.1" 200 None 2026-03-11 23:44:59,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:44:59,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 23:44:59,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:44:59,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5b66ce46d8ec186ad8c0 HTTP/1.1" 200 None 2026-03-11 23:44:59,748 - lava_callback - ERROR - Error processing callback for node 69af5b66ce46d8ec186ad8c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55354 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:46:19,726 - lava_callback - INFO - Received callback for node 69af5bb6ce46d8ec186ad8cb INFO: 172.19.0.1:47224 - "POST /node/69af5bb6ce46d8ec186ad8cb HTTP/1.0" 202 Accepted 2026-03-11 23:46:19,732 - lava_callback - INFO - Starting async job submit for node 69af5bb6ce46d8ec186ad8cb 2026-03-11 23:46:19,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:46:19,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5bb6ce46d8ec186ad8cb HTTP/1.1" 200 None 2026-03-11 23:46:19,748 - lava_callback - DEBUG - Processing node 69af5bb6ce46d8ec186ad8cb: baseline-arm64-clabbe 2026-03-11 23:46:19,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5bb6ce46d8ec186ad8cb 2026-03-11 23:46:19,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:46:19,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5bb6ce46d8ec186ad8cb HTTP/1.1" 200 None 2026-03-11 23:46:19,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:46:19,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 23:46:19,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:46:19,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5bb6ce46d8ec186ad8cb HTTP/1.1" 200 None 2026-03-11 23:46:19,804 - lava_callback - ERROR - Error processing callback for node 69af5bb6ce46d8ec186ad8cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47232 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:46:32,402 - lava_callback - INFO - Received callback for node 69b1c022a26b422765ba3fb6 INFO: 172.19.0.1:34012 - "POST /node/69b1c022a26b422765ba3fb6 HTTP/1.0" 202 Accepted 2026-03-11 23:46:32,408 - lava_callback - INFO - Starting async job submit for node 69b1c022a26b422765ba3fb6 2026-03-11 23:46:32,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:46:32,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c022a26b422765ba3fb6 HTTP/1.1" 200 None 2026-03-11 23:46:32,453 - lava_callback - DEBUG - Processing node 69b1c022a26b422765ba3fb6: baseline-arm64-broonie 2026-03-11 23:46:32,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 23:46:32,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 23:46:32,926 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c022a26b422765ba3fb6/log.txt.gz 2026-03-11 23:46:33,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 23:46:33,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 23:46:33,347 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c022a26b422765ba3fb6/lava-logs.yaml 2026-03-11 23:46:33,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 23:46:33,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 23:46:33,566 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b1c022a26b422765ba3fb6/lava_callback.json.gz 2026-03-11 23:46:33,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:46:33,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1c022a26b422765ba3fb6 HTTP/1.1" 200 None 2026-03-11 23:46:33,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:46:33,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1960ba26b422765ba3717 HTTP/1.1" 200 None 2026-03-11 23:46:33,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:46:33,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1c022a26b422765ba3fb6 HTTP/1.1" 200 None 2026-03-11 23:46:33,653 - lava_callback - INFO - Completed processing callback for node 69b1c022a26b422765ba3fb6 INFO: 172.19.0.1:34026 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:46:38,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:46:38,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39192 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:47:39,777 - lava_callback - INFO - Received callback for node 69af5c07ce46d8ec186ad8d3 INFO: 172.19.0.1:40428 - "POST /node/69af5c07ce46d8ec186ad8d3 HTTP/1.0" 202 Accepted 2026-03-11 23:47:39,782 - lava_callback - INFO - Starting async job submit for node 69af5c07ce46d8ec186ad8d3 2026-03-11 23:47:39,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:47:39,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5c07ce46d8ec186ad8d3 HTTP/1.1" 200 None 2026-03-11 23:47:39,798 - lava_callback - DEBUG - Processing node 69af5c07ce46d8ec186ad8d3: baseline-arm64-clabbe 2026-03-11 23:47:39,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5c07ce46d8ec186ad8d3 2026-03-11 23:47:39,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:47:39,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5c07ce46d8ec186ad8d3 HTTP/1.1" 200 None 2026-03-11 23:47:39,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:47:39,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 23:47:39,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:47:39,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5c07ce46d8ec186ad8d3 HTTP/1.1" 200 None 2026-03-11 23:47:39,852 - lava_callback - ERROR - Error processing callback for node 69af5c07ce46d8ec186ad8d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36262 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:48:59,806 - lava_callback - INFO - Received callback for node 69af5c58ce46d8ec186ad8d8 INFO: 172.19.0.1:34678 - "POST /node/69af5c58ce46d8ec186ad8d8 HTTP/1.0" 202 Accepted 2026-03-11 23:48:59,811 - lava_callback - INFO - Starting async job submit for node 69af5c58ce46d8ec186ad8d8 2026-03-11 23:48:59,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:48:59,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5c58ce46d8ec186ad8d8 HTTP/1.1" 200 None 2026-03-11 23:48:59,827 - lava_callback - DEBUG - Processing node 69af5c58ce46d8ec186ad8d8: baseline-arm64-clabbe 2026-03-11 23:48:59,828 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5c58ce46d8ec186ad8d8 2026-03-11 23:48:59,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:48:59,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5c58ce46d8ec186ad8d8 HTTP/1.1" 200 None 2026-03-11 23:48:59,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:48:59,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef431ce46d8ec186ab81d HTTP/1.1" 200 None 2026-03-11 23:48:59,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:48:59,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5c58ce46d8ec186ad8d8 HTTP/1.1" 200 None 2026-03-11 23:48:59,885 - lava_callback - ERROR - Error processing callback for node 69af5c58ce46d8ec186ad8d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59932 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:50:04,284 - lava_callback - INFO - Received callback for node 69af5ca0ce46d8ec186ad8e2 INFO: 172.19.0.1:33594 - "POST /node/69af5ca0ce46d8ec186ad8e2 HTTP/1.0" 202 Accepted 2026-03-11 23:50:04,290 - lava_callback - INFO - Starting async job submit for node 69af5ca0ce46d8ec186ad8e2 2026-03-11 23:50:04,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:50:04,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5ca0ce46d8ec186ad8e2 HTTP/1.1" 200 None 2026-03-11 23:50:04,309 - lava_callback - DEBUG - Processing node 69af5ca0ce46d8ec186ad8e2: baseline-arm64-baylibre 2026-03-11 23:50:04,309 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5ca0ce46d8ec186ad8e2 2026-03-11 23:50:04,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:50:04,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5ca0ce46d8ec186ad8e2 HTTP/1.1" 200 None 2026-03-11 23:50:04,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:50:04,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-11 23:50:04,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:50:04,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5ca0ce46d8ec186ad8e2 HTTP/1.1" 200 None 2026-03-11 23:50:04,360 - lava_callback - ERROR - Error processing callback for node 69af5ca0ce46d8ec186ad8e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35798 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:51:24,551 - lava_callback - INFO - Received callback for node 69af5cf1ce46d8ec186ad8e7 INFO: 172.19.0.1:39314 - "POST /node/69af5cf1ce46d8ec186ad8e7 HTTP/1.0" 202 Accepted 2026-03-11 23:51:24,561 - lava_callback - INFO - Starting async job submit for node 69af5cf1ce46d8ec186ad8e7 2026-03-11 23:51:24,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:51:24,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5cf1ce46d8ec186ad8e7 HTTP/1.1" 200 None 2026-03-11 23:51:24,586 - lava_callback - DEBUG - Processing node 69af5cf1ce46d8ec186ad8e7: baseline-arm64-baylibre 2026-03-11 23:51:24,586 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5cf1ce46d8ec186ad8e7 2026-03-11 23:51:24,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:51:24,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5cf1ce46d8ec186ad8e7 HTTP/1.1" 200 None 2026-03-11 23:51:24,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:51:24,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-11 23:51:24,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:51:24,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5cf1ce46d8ec186ad8e7 HTTP/1.1" 200 None 2026-03-11 23:51:24,665 - lava_callback - ERROR - Error processing callback for node 69af5cf1ce46d8ec186ad8e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37902 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:52:44,443 - lava_callback - INFO - Received callback for node 69af5d40ce46d8ec186ad8f0 INFO: 172.19.0.1:35914 - "POST /node/69af5d40ce46d8ec186ad8f0 HTTP/1.0" 202 Accepted 2026-03-11 23:52:44,449 - lava_callback - INFO - Starting async job submit for node 69af5d40ce46d8ec186ad8f0 2026-03-11 23:52:44,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:52:44,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5d40ce46d8ec186ad8f0 HTTP/1.1" 200 None 2026-03-11 23:52:44,465 - lava_callback - DEBUG - Processing node 69af5d40ce46d8ec186ad8f0: baseline-arm64-baylibre 2026-03-11 23:52:44,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5d40ce46d8ec186ad8f0 2026-03-11 23:52:44,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:52:44,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5d40ce46d8ec186ad8f0 HTTP/1.1" 200 None 2026-03-11 23:52:44,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:52:44,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-11 23:52:44,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:52:44,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5d40ce46d8ec186ad8f0 HTTP/1.1" 200 None 2026-03-11 23:52:44,542 - lava_callback - ERROR - Error processing callback for node 69af5d40ce46d8ec186ad8f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47286 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:54:04,538 - lava_callback - INFO - Received callback for node 69af5d90ce46d8ec186ad8fa INFO: 172.19.0.1:34970 - "POST /node/69af5d90ce46d8ec186ad8fa HTTP/1.0" 202 Accepted 2026-03-11 23:54:04,543 - lava_callback - INFO - Starting async job submit for node 69af5d90ce46d8ec186ad8fa 2026-03-11 23:54:04,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:54:04,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5d90ce46d8ec186ad8fa HTTP/1.1" 200 None 2026-03-11 23:54:04,561 - lava_callback - DEBUG - Processing node 69af5d90ce46d8ec186ad8fa: baseline-arm64-baylibre 2026-03-11 23:54:04,561 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5d90ce46d8ec186ad8fa 2026-03-11 23:54:04,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:54:04,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5d90ce46d8ec186ad8fa HTTP/1.1" 200 None 2026-03-11 23:54:04,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:54:04,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-11 23:54:04,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:54:04,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5d90ce46d8ec186ad8fa HTTP/1.1" 200 None 2026-03-11 23:54:04,619 - lava_callback - ERROR - Error processing callback for node 69af5d90ce46d8ec186ad8fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42780 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:55:40,144 - lava_callback - INFO - Received callback for node 69af5de6ce46d8ec186ad904 INFO: 172.19.0.1:60162 - "POST /node/69af5de6ce46d8ec186ad904 HTTP/1.0" 202 Accepted 2026-03-11 23:55:40,149 - lava_callback - INFO - Starting async job submit for node 69af5de6ce46d8ec186ad904 2026-03-11 23:55:40,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:55:40,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5de6ce46d8ec186ad904 HTTP/1.1" 200 None 2026-03-11 23:55:40,169 - lava_callback - DEBUG - Processing node 69af5de6ce46d8ec186ad904: baseline-arm64-clabbe 2026-03-11 23:55:40,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5de6ce46d8ec186ad904 2026-03-11 23:55:40,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:55:40,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5de6ce46d8ec186ad904 HTTP/1.1" 200 None 2026-03-11 23:55:40,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:55:40,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-11 23:55:40,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:55:40,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5de6ce46d8ec186ad904 HTTP/1.1" 200 None 2026-03-11 23:55:40,226 - lava_callback - ERROR - Error processing callback for node 69af5de6ce46d8ec186ad904: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32900 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:56:44,912 - lava_callback - INFO - Received callback for node 69af5e33ce46d8ec186ad909 INFO: 172.19.0.1:46294 - "POST /node/69af5e33ce46d8ec186ad909 HTTP/1.0" 202 Accepted 2026-03-11 23:56:44,917 - lava_callback - INFO - Starting async job submit for node 69af5e33ce46d8ec186ad909 2026-03-11 23:56:44,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:56:44,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5e33ce46d8ec186ad909 HTTP/1.1" 200 None 2026-03-11 23:56:44,933 - lava_callback - DEBUG - Processing node 69af5e33ce46d8ec186ad909: baseline-arm64-baylibre 2026-03-11 23:56:44,933 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5e33ce46d8ec186ad909 2026-03-11 23:56:44,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:56:44,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5e33ce46d8ec186ad909 HTTP/1.1" 200 None 2026-03-11 23:56:44,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:56:44,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-11 23:56:44,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:56:45,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5e33ce46d8ec186ad909 HTTP/1.1" 200 None 2026-03-11 23:56:45,006 - lava_callback - ERROR - Error processing callback for node 69af5e33ce46d8ec186ad909: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54336 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:58:20,289 - lava_callback - INFO - Received callback for node 69af5e8dce46d8ec186ad913 INFO: 172.19.0.1:56716 - "POST /node/69af5e8dce46d8ec186ad913 HTTP/1.0" 202 Accepted 2026-03-11 23:58:20,294 - lava_callback - INFO - Starting async job submit for node 69af5e8dce46d8ec186ad913 2026-03-11 23:58:20,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:58:20,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5e8dce46d8ec186ad913 HTTP/1.1" 200 None 2026-03-11 23:58:20,310 - lava_callback - DEBUG - Processing node 69af5e8dce46d8ec186ad913: baseline-arm64-clabbe 2026-03-11 23:58:20,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5e8dce46d8ec186ad913 2026-03-11 23:58:20,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:58:20,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5e8dce46d8ec186ad913 HTTP/1.1" 200 None 2026-03-11 23:58:20,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:58:20,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-11 23:58:20,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:58:20,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5e8dce46d8ec186ad913 HTTP/1.1" 200 None 2026-03-11 23:58:20,368 - lava_callback - ERROR - Error processing callback for node 69af5e8dce46d8ec186ad913: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52474 - "GET / HTTP/1.0" 200 OK 2026-03-11 23:59:40,173 - lava_callback - INFO - Received callback for node 69af5edcce46d8ec186ad91e INFO: 172.19.0.1:43142 - "POST /node/69af5edcce46d8ec186ad91e HTTP/1.0" 202 Accepted 2026-03-11 23:59:40,179 - lava_callback - INFO - Starting async job submit for node 69af5edcce46d8ec186ad91e 2026-03-11 23:59:40,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:59:40,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5edcce46d8ec186ad91e HTTP/1.1" 200 None 2026-03-11 23:59:40,195 - lava_callback - DEBUG - Processing node 69af5edcce46d8ec186ad91e: baseline-arm64-clabbe 2026-03-11 23:59:40,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69af5edcce46d8ec186ad91e 2026-03-11 23:59:40,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:59:40,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69af5edcce46d8ec186ad91e HTTP/1.1" 200 None 2026-03-11 23:59:40,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:59:40,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9acf29c5f93e4f05eb2cc HTTP/1.1" 200 None 2026-03-11 23:59:40,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 23:59:40,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69af5edcce46d8ec186ad91e HTTP/1.1" 200 None 2026-03-11 23:59:40,246 - lava_callback - ERROR - Error processing callback for node 69af5edcce46d8ec186ad91e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]