INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:55370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:40:45,139 - lava_callback - INFO - Received callback for node 69de6e00f6535ffd5b3ed901 2026-04-16 16:40:45,146 - lava_callback - INFO - Starting async job submit for node 69de6e00f6535ffd5b3ed901 INFO: 172.21.0.1:52794 - "POST /node/69de6e00f6535ffd5b3ed901 HTTP/1.0" 202 Accepted 2026-04-16 16:40:45,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:40:45,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6e00f6535ffd5b3ed901 HTTP/1.1" 200 None 2026-04-16 16:40:45,169 - lava_callback - DEBUG - Processing node 69de6e00f6535ffd5b3ed901: baseline-arm-baylibre 2026-04-16 16:40:45,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de6e00f6535ffd5b3ed901 2026-04-16 16:40:45,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:40:45,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6e00f6535ffd5b3ed901 HTTP/1.1" 200 None 2026-04-16 16:40:45,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:40:45,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-16 16:40:45,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:40:45,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de6e00f6535ffd5b3ed901 HTTP/1.1" 200 None 2026-04-16 16:40:45,226 - lava_callback - ERROR - Error processing callback for node 69de6e00f6535ffd5b3ed901: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54026 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:41:25,041 - lava_callback - INFO - Received callback for node 69de6e26f6535ffd5b3ed926 INFO: 172.21.0.1:50196 - "POST /node/69de6e26f6535ffd5b3ed926 HTTP/1.0" 202 Accepted 2026-04-16 16:41:25,047 - lava_callback - INFO - Starting async job submit for node 69de6e26f6535ffd5b3ed926 2026-04-16 16:41:25,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:41:25,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6e26f6535ffd5b3ed926 HTTP/1.1" 200 None 2026-04-16 16:41:25,063 - lava_callback - DEBUG - Processing node 69de6e26f6535ffd5b3ed926: baseline-arm-baylibre 2026-04-16 16:41:25,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de6e26f6535ffd5b3ed926 2026-04-16 16:41:25,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:41:25,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6e26f6535ffd5b3ed926 HTTP/1.1" 200 None 2026-04-16 16:41:25,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:41:25,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-16 16:41:25,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:41:25,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de6e26f6535ffd5b3ed926 HTTP/1.1" 200 None 2026-04-16 16:41:25,111 - lava_callback - ERROR - Error processing callback for node 69de6e26f6535ffd5b3ed926: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42606 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:42:05,191 - lava_callback - INFO - Received callback for node 69de6e48f6535ffd5b3ed93d INFO: 172.21.0.1:43746 - "POST /node/69de6e48f6535ffd5b3ed93d HTTP/1.0" 202 Accepted 2026-04-16 16:42:05,197 - lava_callback - INFO - Starting async job submit for node 69de6e48f6535ffd5b3ed93d 2026-04-16 16:42:05,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:42:05,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6e48f6535ffd5b3ed93d HTTP/1.1" 200 None 2026-04-16 16:42:05,222 - lava_callback - DEBUG - Processing node 69de6e48f6535ffd5b3ed93d: baseline-arm-baylibre 2026-04-16 16:42:05,222 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de6e48f6535ffd5b3ed93d 2026-04-16 16:42:05,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:42:05,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6e48f6535ffd5b3ed93d HTTP/1.1" 200 None 2026-04-16 16:42:05,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:42:05,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-16 16:42:05,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:42:05,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de6e48f6535ffd5b3ed93d HTTP/1.1" 200 None 2026-04-16 16:42:05,276 - lava_callback - ERROR - Error processing callback for node 69de6e48f6535ffd5b3ed93d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55392 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:42:25,105 - lava_callback - INFO - Received callback for node 69de6e6cf6535ffd5b3ed95a INFO: 172.21.0.1:38844 - "POST /node/69de6e6cf6535ffd5b3ed95a HTTP/1.0" 202 Accepted 2026-04-16 16:42:25,111 - lava_callback - INFO - Starting async job submit for node 69de6e6cf6535ffd5b3ed95a 2026-04-16 16:42:25,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:42:25,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6e6cf6535ffd5b3ed95a HTTP/1.1" 200 None 2026-04-16 16:42:25,135 - lava_callback - DEBUG - Processing node 69de6e6cf6535ffd5b3ed95a: baseline-arm-baylibre 2026-04-16 16:42:25,135 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de6e6cf6535ffd5b3ed95a 2026-04-16 16:42:25,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:42:25,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6e6cf6535ffd5b3ed95a HTTP/1.1" 200 None 2026-04-16 16:42:25,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:42:25,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-16 16:42:25,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:42:25,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de6e6cf6535ffd5b3ed95a HTTP/1.1" 200 None 2026-04-16 16:42:25,208 - lava_callback - ERROR - Error processing callback for node 69de6e6cf6535ffd5b3ed95a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49674 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:43:05,134 - lava_callback - INFO - Received callback for node 69de6e8cf6535ffd5b3ed977 INFO: 172.21.0.1:56866 - "POST /node/69de6e8cf6535ffd5b3ed977 HTTP/1.0" 202 Accepted 2026-04-16 16:43:05,140 - lava_callback - INFO - Starting async job submit for node 69de6e8cf6535ffd5b3ed977 2026-04-16 16:43:05,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:43:05,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6e8cf6535ffd5b3ed977 HTTP/1.1" 200 None 2026-04-16 16:43:05,156 - lava_callback - DEBUG - Processing node 69de6e8cf6535ffd5b3ed977: baseline-arm-baylibre 2026-04-16 16:43:05,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de6e8cf6535ffd5b3ed977 2026-04-16 16:43:05,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:43:05,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6e8cf6535ffd5b3ed977 HTTP/1.1" 200 None 2026-04-16 16:43:05,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:43:05,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-16 16:43:05,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:43:05,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de6e8cf6535ffd5b3ed977 HTTP/1.1" 200 None 2026-04-16 16:43:05,207 - lava_callback - ERROR - Error processing callback for node 69de6e8cf6535ffd5b3ed977: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45696 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:43:45,154 - lava_callback - INFO - Received callback for node 69de6eacf6535ffd5b3ed9b9 INFO: 172.21.0.1:45706 - "POST /node/69de6eacf6535ffd5b3ed9b9 HTTP/1.0" 202 Accepted 2026-04-16 16:43:45,159 - lava_callback - INFO - Starting async job submit for node 69de6eacf6535ffd5b3ed9b9 2026-04-16 16:43:45,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:43:45,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6eacf6535ffd5b3ed9b9 HTTP/1.1" 200 None 2026-04-16 16:43:45,183 - lava_callback - DEBUG - Processing node 69de6eacf6535ffd5b3ed9b9: baseline-arm-baylibre 2026-04-16 16:43:45,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de6eacf6535ffd5b3ed9b9 2026-04-16 16:43:45,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:43:45,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6eacf6535ffd5b3ed9b9 HTTP/1.1" 200 None 2026-04-16 16:43:45,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:43:45,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-16 16:43:45,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:43:45,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de6eacf6535ffd5b3ed9b9 HTTP/1.1" 200 None 2026-04-16 16:43:45,257 - lava_callback - ERROR - Error processing callback for node 69de6eacf6535ffd5b3ed9b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45748 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:44:05,167 - lava_callback - INFO - Received callback for node 69de6ecbf6535ffd5b3ed9ea INFO: 172.21.0.1:55798 - "POST /node/69de6ecbf6535ffd5b3ed9ea HTTP/1.0" 202 Accepted 2026-04-16 16:44:05,173 - lava_callback - INFO - Starting async job submit for node 69de6ecbf6535ffd5b3ed9ea 2026-04-16 16:44:05,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:44:05,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6ecbf6535ffd5b3ed9ea HTTP/1.1" 200 None 2026-04-16 16:44:05,189 - lava_callback - DEBUG - Processing node 69de6ecbf6535ffd5b3ed9ea: baseline-arm-baylibre 2026-04-16 16:44:05,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de6ecbf6535ffd5b3ed9ea 2026-04-16 16:44:05,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:44:05,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6ecbf6535ffd5b3ed9ea HTTP/1.1" 200 None 2026-04-16 16:44:05,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:44:05,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680092cda61b443d5b587 HTTP/1.1" 200 None 2026-04-16 16:44:05,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:44:05,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de6ecbf6535ffd5b3ed9ea HTTP/1.1" 200 None 2026-04-16 16:44:05,246 - lava_callback - ERROR - Error processing callback for node 69de6ecbf6535ffd5b3ed9ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46842 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:44:49,103 - lava_callback - INFO - Received callback for node 69de6ef3f6535ffd5b3eda08 INFO: 172.21.0.1:46856 - "POST /node/69de6ef3f6535ffd5b3eda08 HTTP/1.0" 202 Accepted 2026-04-16 16:44:49,112 - lava_callback - INFO - Starting async job submit for node 69de6ef3f6535ffd5b3eda08 2026-04-16 16:44:49,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:44:49,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6ef3f6535ffd5b3eda08 HTTP/1.1" 200 None 2026-04-16 16:44:49,176 - lava_callback - DEBUG - Processing node 69de6ef3f6535ffd5b3eda08: baseline-arm-clabbe 2026-04-16 16:44:49,176 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de6ef3f6535ffd5b3eda08 2026-04-16 16:44:49,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:44:49,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6ef3f6535ffd5b3eda08 HTTP/1.1" 200 None 2026-04-16 16:44:49,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:44:49,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-16 16:44:49,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:44:49,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de6ef3f6535ffd5b3eda08 HTTP/1.1" 200 None 2026-04-16 16:44:49,260 - lava_callback - ERROR - Error processing callback for node 69de6ef3f6535ffd5b3eda08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:45:22,685 - lava_callback - INFO - Received callback for node 69e111f82eed175ae971a62d INFO: 172.21.0.1:39764 - "POST /node/69e111f82eed175ae971a62d HTTP/1.0" 202 Accepted 2026-04-16 16:45:22,691 - lava_callback - INFO - Starting async job submit for node 69e111f82eed175ae971a62d 2026-04-16 16:45:22,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:22,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111f82eed175ae971a62d HTTP/1.1" 200 None 2026-04-16 16:45:22,725 - lava_callback - DEBUG - Processing node 69e111f82eed175ae971a62d: baseline-arm64 2026-04-16 16:45:22,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:45:23,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:45:23,065 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111f82eed175ae971a62d/log.txt.gz 2026-04-16 16:45:23,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:45:23,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:45:23,317 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111f82eed175ae971a62d/lava-logs.yaml 2026-04-16 16:45:23,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:45:23,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:45:23,420 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111f82eed175ae971a62d/lava_callback.json.gz 2026-04-16 16:45:23,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:23,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111f82eed175ae971a62d HTTP/1.1" 200 None 2026-04-16 16:45:23,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:23,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:45:23,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:23,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e111f82eed175ae971a62d HTTP/1.1" 200 None 2026-04-16 16:45:23,499 - lava_callback - INFO - Completed processing callback for node 69e111f82eed175ae971a62d INFO: 172.21.0.1:39772 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:45:29,095 - lava_callback - INFO - Received callback for node 69de6f17f6535ffd5b3eda19 INFO: 172.21.0.1:39786 - "POST /node/69de6f17f6535ffd5b3eda19 HTTP/1.0" 202 Accepted 2026-04-16 16:45:29,101 - lava_callback - INFO - Starting async job submit for node 69de6f17f6535ffd5b3eda19 2026-04-16 16:45:29,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:29,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6f17f6535ffd5b3eda19 HTTP/1.1" 200 None 2026-04-16 16:45:29,118 - lava_callback - DEBUG - Processing node 69de6f17f6535ffd5b3eda19: baseline-arm-clabbe 2026-04-16 16:45:29,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de6f17f6535ffd5b3eda19 2026-04-16 16:45:29,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:29,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6f17f6535ffd5b3eda19 HTTP/1.1" 200 None 2026-04-16 16:45:29,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:29,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-16 16:45:29,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:29,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de6f17f6535ffd5b3eda19 HTTP/1.1" 200 None 2026-04-16 16:45:29,176 - lava_callback - ERROR - Error processing callback for node 69de6f17f6535ffd5b3eda19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 16:45:32,206 - lava_callback - INFO - Received callback for node 69e112152eed175ae971a687 INFO: 172.21.0.1:38990 - "POST /node/69e112152eed175ae971a687 HTTP/1.0" 202 Accepted 2026-04-16 16:45:32,213 - lava_callback - INFO - Starting async job submit for node 69e112152eed175ae971a687 2026-04-16 16:45:32,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:32,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112152eed175ae971a687 HTTP/1.1" 200 None 2026-04-16 16:45:32,230 - lava_callback - DEBUG - Processing node 69e112152eed175ae971a687: baseline-nfs-arm64 2026-04-16 16:45:32,232 - lava_callback - WARNING - Failed to upload log 2026-04-16 16:45:32,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:45:32,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:45:32,323 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112152eed175ae971a687/lava-logs.yaml 2026-04-16 16:45:32,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:45:32,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:45:32,423 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112152eed175ae971a687/lava_callback.json.gz 2026-04-16 16:45:32,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:32,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112152eed175ae971a687 HTTP/1.1" 200 None 2026-04-16 16:45:32,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:32,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:45:32,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:32,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112152eed175ae971a687 HTTP/1.1" 200 None 2026-04-16 16:45:32,525 - lava_callback - INFO - Completed processing callback for node 69e112152eed175ae971a687 INFO: 172.21.0.1:39002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:45:45,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:45,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53384 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:45:47,895 - lava_callback - INFO - Received callback for node 69e111fd2eed175ae971a646 INFO: 172.21.0.1:53386 - "POST /node/69e111fd2eed175ae971a646 HTTP/1.0" 202 Accepted 2026-04-16 16:45:47,923 - lava_callback - INFO - Starting async job submit for node 69e111fd2eed175ae971a646 2026-04-16 16:45:47,978 - lava_callback - INFO - Received callback for node 69e112052eed175ae971a65a 2026-04-16 16:45:47,993 - lava_callback - INFO - Starting async job submit for node 69e112052eed175ae971a65a INFO: 172.21.0.1:53388 - "POST /node/69e112052eed175ae971a65a HTTP/1.0" 202 Accepted 2026-04-16 16:45:48,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:48,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:48,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112052eed175ae971a65a HTTP/1.1" 200 None 2026-04-16 16:45:48,076 - lava_callback - DEBUG - Processing node 69e112052eed175ae971a65a: baseline-arm64 2026-04-16 16:45:48,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111fd2eed175ae971a646 HTTP/1.1" 200 None 2026-04-16 16:45:48,091 - lava_callback - DEBUG - Processing node 69e111fd2eed175ae971a646: baseline-arm64 2026-04-16 16:45:48,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:45:48,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:45:48,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:45:48,966 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111fd2eed175ae971a646/log.txt.gz 2026-04-16 16:45:49,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:45:49,030 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112052eed175ae971a65a/log.txt.gz 2026-04-16 16:45:49,190 - lava_callback - INFO - Received callback for node 69de6f37f6535ffd5b3eda42 2026-04-16 16:45:49,204 - lava_callback - INFO - Starting async job submit for node 69de6f37f6535ffd5b3eda42 2026-04-16 16:45:49,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:53402 - "POST /node/69de6f37f6535ffd5b3eda42 HTTP/1.0" 202 Accepted 2026-04-16 16:45:49,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:45:49,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6f37f6535ffd5b3eda42 HTTP/1.1" 200 None 2026-04-16 16:45:49,288 - lava_callback - DEBUG - Processing node 69de6f37f6535ffd5b3eda42: baseline-arm-clabbe 2026-04-16 16:45:49,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de6f37f6535ffd5b3eda42 2026-04-16 16:45:49,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:49,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:45:49,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6f37f6535ffd5b3eda42 HTTP/1.1" 200 None 2026-04-16 16:45:49,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:49,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-16 16:45:49,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:49,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de6f37f6535ffd5b3eda42 HTTP/1.1" 200 None 2026-04-16 16:45:49,461 - lava_callback - ERROR - Error processing callback for node 69de6f37f6535ffd5b3eda42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 16:45:49,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:45:49,533 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111fd2eed175ae971a646/lava-logs.yaml 2026-04-16 16:45:49,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:45:49,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:45:49,794 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112052eed175ae971a65a/lava-logs.yaml 2026-04-16 16:45:49,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:45:49,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:45:49,851 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111fd2eed175ae971a646/lava_callback.json.gz 2026-04-16 16:45:49,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:49,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111fd2eed175ae971a646 HTTP/1.1" 200 None 2026-04-16 16:45:49,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:50,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:45:50,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:50,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e111fd2eed175ae971a646 HTTP/1.1" 200 None 2026-04-16 16:45:50,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:45:50,080 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112052eed175ae971a65a/lava_callback.json.gz 2026-04-16 16:45:50,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:50,217 - lava_callback - INFO - Completed processing callback for node 69e111fd2eed175ae971a646 2026-04-16 16:45:50,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112052eed175ae971a65a HTTP/1.1" 200 None 2026-04-16 16:45:50,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:50,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:45:50,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:50,338 - lava_callback - INFO - Received callback for node 69e111fa2eed175ae971a633 INFO: 172.21.0.1:46690 - "POST /node/69e111fa2eed175ae971a633 HTTP/1.0" 202 Accepted 2026-04-16 16:45:50,355 - lava_callback - INFO - Starting async job submit for node 69e111fa2eed175ae971a633 2026-04-16 16:45:50,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112052eed175ae971a65a HTTP/1.1" 200 None 2026-04-16 16:45:50,440 - lava_callback - INFO - Completed processing callback for node 69e112052eed175ae971a65a 2026-04-16 16:45:50,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:50,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111fa2eed175ae971a633 HTTP/1.1" 200 None 2026-04-16 16:45:50,577 - lava_callback - DEBUG - Processing node 69e111fa2eed175ae971a633: baseline-arm64 2026-04-16 16:45:51,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:45:51,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:45:51,300 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111fa2eed175ae971a633/log.txt.gz 2026-04-16 16:45:51,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:45:51,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:45:51,895 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111fa2eed175ae971a633/lava-logs.yaml 2026-04-16 16:45:51,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:45:52,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:45:52,132 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111fa2eed175ae971a633/lava_callback.json.gz 2026-04-16 16:45:52,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:52,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111fa2eed175ae971a633 HTTP/1.1" 200 None 2026-04-16 16:45:52,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:52,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:45:52,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:45:52,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e111fa2eed175ae971a633 HTTP/1.1" 200 None 2026-04-16 16:45:52,338 - lava_callback - INFO - Completed processing callback for node 69e111fa2eed175ae971a633 INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:46:01,729 - lava_callback - INFO - Received callback for node 69e112082eed175ae971a663 INFO: 172.21.0.1:45542 - "POST /node/69e112082eed175ae971a663 HTTP/1.0" 202 Accepted 2026-04-16 16:46:01,741 - lava_callback - INFO - Starting async job submit for node 69e112082eed175ae971a663 2026-04-16 16:46:01,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:01,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112082eed175ae971a663 HTTP/1.1" 200 None 2026-04-16 16:46:01,824 - lava_callback - DEBUG - Processing node 69e112082eed175ae971a663: baseline-arm64 2026-04-16 16:46:02,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:02,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:02,580 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112082eed175ae971a663/log.txt.gz 2026-04-16 16:46:02,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:03,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:03,169 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112082eed175ae971a663/lava-logs.yaml 2026-04-16 16:46:03,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:03,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:03,320 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112082eed175ae971a663/lava_callback.json.gz 2026-04-16 16:46:03,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:03,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112082eed175ae971a663 HTTP/1.1" 200 None 2026-04-16 16:46:03,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:03,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:03,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:03,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112082eed175ae971a663 HTTP/1.1" 200 None 2026-04-16 16:46:03,520 - lava_callback - INFO - Completed processing callback for node 69e112082eed175ae971a663 INFO: 172.21.0.1:45556 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:46:07,941 - lava_callback - INFO - Received callback for node 69e111fc2eed175ae971a643 INFO: 172.21.0.1:45566 - "POST /node/69e111fc2eed175ae971a643 HTTP/1.0" 202 Accepted 2026-04-16 16:46:07,954 - lava_callback - INFO - Starting async job submit for node 69e111fc2eed175ae971a643 2026-04-16 16:46:08,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:08,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111fc2eed175ae971a643 HTTP/1.1" 200 None 2026-04-16 16:46:08,062 - lava_callback - DEBUG - Processing node 69e111fc2eed175ae971a643: baseline-arm64 2026-04-16 16:46:08,358 - lava_callback - WARNING - Failed to upload log 2026-04-16 16:46:08,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:08,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:08,752 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111fc2eed175ae971a643/lava-logs.yaml 2026-04-16 16:46:08,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:08,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:08,939 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111fc2eed175ae971a643/lava_callback.json.gz 2026-04-16 16:46:09,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:09,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111fc2eed175ae971a643 HTTP/1.1" 200 None 2026-04-16 16:46:09,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:09,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:09,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:09,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e111fc2eed175ae971a643 HTTP/1.1" 200 None 2026-04-16 16:46:09,235 - lava_callback - INFO - Completed processing callback for node 69e111fc2eed175ae971a643 2026-04-16 16:46:12,822 - lava_callback - INFO - Received callback for node 69e111fb2eed175ae971a636 INFO: 172.21.0.1:41202 - "POST /node/69e111fb2eed175ae971a636 HTTP/1.0" 202 Accepted 2026-04-16 16:46:12,834 - lava_callback - INFO - Starting async job submit for node 69e111fb2eed175ae971a636 2026-04-16 16:46:12,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:12,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111fb2eed175ae971a636 HTTP/1.1" 200 None 2026-04-16 16:46:12,908 - lava_callback - DEBUG - Processing node 69e111fb2eed175ae971a636: baseline-arm64 2026-04-16 16:46:13,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:13,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:13,576 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111fb2eed175ae971a636/log.txt.gz 2026-04-16 16:46:13,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:14,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:14,092 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111fb2eed175ae971a636/lava-logs.yaml 2026-04-16 16:46:14,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:14,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:14,280 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111fb2eed175ae971a636/lava_callback.json.gz 2026-04-16 16:46:14,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:14,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111fb2eed175ae971a636 HTTP/1.1" 200 None 2026-04-16 16:46:14,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:14,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:14,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:14,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e111fb2eed175ae971a636 HTTP/1.1" 200 None 2026-04-16 16:46:14,432 - lava_callback - INFO - Completed processing callback for node 69e111fb2eed175ae971a636 INFO: 172.21.0.1:41210 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 16:46:15,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:15,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:41216 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:46:17,424 - lava_callback - INFO - Received callback for node 69e112012eed175ae971a651 INFO: 172.21.0.1:41226 - "POST /node/69e112012eed175ae971a651 HTTP/1.0" 202 Accepted 2026-04-16 16:46:17,431 - lava_callback - INFO - Starting async job submit for node 69e112012eed175ae971a651 2026-04-16 16:46:17,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:17,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112012eed175ae971a651 HTTP/1.1" 200 None 2026-04-16 16:46:17,470 - lava_callback - DEBUG - Processing node 69e112012eed175ae971a651: baseline-arm64 2026-04-16 16:46:17,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:17,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:17,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112012eed175ae971a651/log.txt.gz 2026-04-16 16:46:18,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:18,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:18,249 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112012eed175ae971a651/lava-logs.yaml 2026-04-16 16:46:18,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:18,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:18,360 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112012eed175ae971a651/lava_callback.json.gz 2026-04-16 16:46:18,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:18,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112012eed175ae971a651 HTTP/1.1" 200 None 2026-04-16 16:46:18,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:18,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:18,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:18,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112012eed175ae971a651 HTTP/1.1" 200 None 2026-04-16 16:46:18,443 - lava_callback - INFO - Completed processing callback for node 69e112012eed175ae971a651 2026-04-16 16:46:24,771 - lava_callback - INFO - Received callback for node 69e111f92eed175ae971a630 INFO: 172.21.0.1:57882 - "POST /node/69e111f92eed175ae971a630 HTTP/1.0" 202 Accepted 2026-04-16 16:46:24,777 - lava_callback - INFO - Starting async job submit for node 69e111f92eed175ae971a630 2026-04-16 16:46:24,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:24,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111f92eed175ae971a630 HTTP/1.1" 200 None 2026-04-16 16:46:24,820 - lava_callback - DEBUG - Processing node 69e111f92eed175ae971a630: baseline-arm64 2026-04-16 16:46:25,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:25,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:25,179 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111f92eed175ae971a630/log.txt.gz 2026-04-16 16:46:25,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:25,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:25,505 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111f92eed175ae971a630/lava-logs.yaml 2026-04-16 16:46:25,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:25,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:25,634 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111f92eed175ae971a630/lava_callback.json.gz 2026-04-16 16:46:25,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:25,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111f92eed175ae971a630 HTTP/1.1" 200 None 2026-04-16 16:46:25,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:25,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:25,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:25,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e111f92eed175ae971a630 HTTP/1.1" 200 None 2026-04-16 16:46:25,706 - lava_callback - INFO - Completed processing callback for node 69e111f92eed175ae971a630 INFO: 172.21.0.1:57886 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:46:29,097 - lava_callback - INFO - Received callback for node 69de6f57f6535ffd5b3eda63 INFO: 172.21.0.1:57890 - "POST /node/69de6f57f6535ffd5b3eda63 HTTP/1.0" 202 Accepted 2026-04-16 16:46:29,103 - lava_callback - INFO - Starting async job submit for node 69de6f57f6535ffd5b3eda63 2026-04-16 16:46:29,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:29,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6f57f6535ffd5b3eda63 HTTP/1.1" 200 None 2026-04-16 16:46:29,130 - lava_callback - DEBUG - Processing node 69de6f57f6535ffd5b3eda63: baseline-arm-clabbe 2026-04-16 16:46:29,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de6f57f6535ffd5b3eda63 2026-04-16 16:46:29,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:29,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6f57f6535ffd5b3eda63 HTTP/1.1" 200 None 2026-04-16 16:46:29,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:29,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-16 16:46:29,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:29,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de6f57f6535ffd5b3eda63 HTTP/1.1" 200 None 2026-04-16 16:46:29,179 - lava_callback - ERROR - Error processing callback for node 69de6f57f6535ffd5b3eda63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 16:46:29,677 - lava_callback - INFO - Received callback for node 69e1120a2eed175ae971a66c INFO: 172.21.0.1:57896 - "POST /node/69e1120a2eed175ae971a66c HTTP/1.0" 202 Accepted 2026-04-16 16:46:29,683 - lava_callback - INFO - Starting async job submit for node 69e1120a2eed175ae971a66c 2026-04-16 16:46:29,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:29,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1120a2eed175ae971a66c HTTP/1.1" 200 None 2026-04-16 16:46:29,725 - lava_callback - DEBUG - Processing node 69e1120a2eed175ae971a66c: baseline-arm64 2026-04-16 16:46:30,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:30,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:30,117 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e1120a2eed175ae971a66c/log.txt.gz 2026-04-16 16:46:30,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:30,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:30,486 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e1120a2eed175ae971a66c/lava-logs.yaml 2026-04-16 16:46:30,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:30,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:30,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e1120a2eed175ae971a66c/lava_callback.json.gz 2026-04-16 16:46:30,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:34,633 - urllib3.util.retry - DEBUG - Incremented Retry for (url='/latest/node/69e1120a2eed175ae971a66c'): Retry(total=4, connect=None, read=None, redirect=None, status=None) 2026-04-16 16:46:34,633 - urllib3.connectionpool - WARNING - Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NameResolutionError("HTTPSConnection(host='staging.kernelci.org', port=9000): Failed to resolve 'staging.kernelci.org' ([Errno -5] No address associated with hostname)")': /latest/node/69e1120a2eed175ae971a66c 2026-04-16 16:46:34,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (2): staging.kernelci.org:9000 2026-04-16 16:46:34,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1120a2eed175ae971a66c HTTP/1.1" 200 None 2026-04-16 16:46:34,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:34,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:34,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:34,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1120a2eed175ae971a66c HTTP/1.1" 200 None 2026-04-16 16:46:34,687 - lava_callback - INFO - Completed processing callback for node 69e1120a2eed175ae971a66c INFO: 172.21.0.1:38802 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:46:38,508 - lava_callback - INFO - Received callback for node 69e112042eed175ae971a657 INFO: 172.21.0.1:38814 - "POST /node/69e112042eed175ae971a657 HTTP/1.0" 202 Accepted 2026-04-16 16:46:38,516 - lava_callback - INFO - Starting async job submit for node 69e112042eed175ae971a657 2026-04-16 16:46:38,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:38,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112042eed175ae971a657 HTTP/1.1" 200 None 2026-04-16 16:46:38,554 - lava_callback - DEBUG - Processing node 69e112042eed175ae971a657: baseline-arm64 2026-04-16 16:46:38,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:39,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:39,033 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112042eed175ae971a657/log.txt.gz 2026-04-16 16:46:39,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:39,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:39,415 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112042eed175ae971a657/lava-logs.yaml 2026-04-16 16:46:39,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:39,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:39,537 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112042eed175ae971a657/lava_callback.json.gz 2026-04-16 16:46:39,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:39,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112042eed175ae971a657 HTTP/1.1" 200 None 2026-04-16 16:46:39,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:39,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:39,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:39,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112042eed175ae971a657 HTTP/1.1" 200 None 2026-04-16 16:46:39,674 - lava_callback - INFO - Completed processing callback for node 69e112042eed175ae971a657 INFO: 172.21.0.1:33788 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:46:45,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:45,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-16 16:46:45,510 - lava_callback - INFO - Received callback for node 69e112022eed175ae971a654 INFO: 172.21.0.1:33804 - "POST /node/69e112022eed175ae971a654 HTTP/1.0" 202 Accepted 2026-04-16 16:46:45,523 - lava_callback - INFO - Starting async job submit for node 69e112022eed175ae971a654 2026-04-16 16:46:45,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:45,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112022eed175ae971a654 HTTP/1.1" 200 None 2026-04-16 16:46:45,632 - lava_callback - DEBUG - Processing node 69e112022eed175ae971a654: baseline-arm64 2026-04-16 16:46:45,753 - lava_callback - INFO - Received callback for node 69e112182eed175ae971a690 INFO: 172.21.0.1:33820 - "POST /node/69e112182eed175ae971a690 HTTP/1.0" 202 Accepted 2026-04-16 16:46:45,771 - lava_callback - INFO - Starting async job submit for node 69e112182eed175ae971a690 2026-04-16 16:46:45,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:45,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112182eed175ae971a690 HTTP/1.1" 200 None 2026-04-16 16:46:45,979 - lava_callback - DEBUG - Processing node 69e112182eed175ae971a690: baseline-nfs-arm64 INFO: 172.21.0.1:33832 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:46:47,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:47,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:47,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:47,256 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112182eed175ae971a690/log.txt.gz 2026-04-16 16:46:47,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:47,430 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112022eed175ae971a654/log.txt.gz 2026-04-16 16:46:47,566 - lava_callback - INFO - Received callback for node 69e1123f2eed175ae971a742 INFO: 172.21.0.1:33846 - "POST /node/69e1123f2eed175ae971a742 HTTP/1.0" 202 Accepted 2026-04-16 16:46:47,587 - lava_callback - INFO - Starting async job submit for node 69e1123f2eed175ae971a742 2026-04-16 16:46:47,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:47,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1123f2eed175ae971a742 HTTP/1.1" 200 None 2026-04-16 16:46:47,875 - lava_callback - DEBUG - Processing node 69e1123f2eed175ae971a742: baseline-arm64-pengutronix 2026-04-16 16:46:47,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:48,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:48,284 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112182eed175ae971a690/lava-logs.yaml 2026-04-16 16:46:48,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:48,529 - lava_callback - INFO - Received callback for node 69e112062eed175ae971a65d 2026-04-16 16:46:48,546 - lava_callback - INFO - Starting async job submit for node 69e112062eed175ae971a65d INFO: 172.21.0.1:33858 - "POST /node/69e112062eed175ae971a65d HTTP/1.0" 202 Accepted 2026-04-16 16:46:48,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:48,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:48,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:48,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112062eed175ae971a65d HTTP/1.1" 200 None 2026-04-16 16:46:48,645 - lava_callback - DEBUG - Processing node 69e112062eed175ae971a65d: baseline-arm64 2026-04-16 16:46:48,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:48,736 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112182eed175ae971a690/lava_callback.json.gz 2026-04-16 16:46:48,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:48,789 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e1123f2eed175ae971a742/log.txt.gz 2026-04-16 16:46:48,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:48,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:48,877 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112022eed175ae971a654/lava-logs.yaml 2026-04-16 16:46:48,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:49,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112182eed175ae971a690 HTTP/1.1" 200 None 2026-04-16 16:46:49,040 - lava_callback - INFO - Received callback for node 69e112442eed175ae971a74f 2026-04-16 16:46:49,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:49,058 - lava_callback - INFO - Starting async job submit for node 69e112442eed175ae971a74f INFO: 172.21.0.1:33868 - "POST /node/69e112442eed175ae971a74f HTTP/1.0" 202 Accepted 2026-04-16 16:46:49,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:49,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:49,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:49,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:49,260 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112022eed175ae971a654/lava_callback.json.gz 2026-04-16 16:46:49,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112442eed175ae971a74f HTTP/1.1" 200 None 2026-04-16 16:46:49,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112182eed175ae971a690 HTTP/1.1" 200 None 2026-04-16 16:46:49,436 - lava_callback - INFO - Completed processing callback for node 69e112182eed175ae971a690 2026-04-16 16:46:49,450 - lava_callback - DEBUG - Processing node 69e112442eed175ae971a74f: baseline-arm64-foundriesio 2026-04-16 16:46:49,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:49,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:49,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112022eed175ae971a654 HTTP/1.1" 200 None 2026-04-16 16:46:49,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:49,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:49,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:50,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:50,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112022eed175ae971a654 HTTP/1.1" 200 None 2026-04-16 16:46:50,196 - lava_callback - INFO - Completed processing callback for node 69e112022eed175ae971a654 2026-04-16 16:46:50,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:50,276 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e1123f2eed175ae971a742/lava-logs.yaml 2026-04-16 16:46:50,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:50,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:50,430 - lava_callback - INFO - Received callback for node 69e112452eed175ae971a752 INFO: 172.21.0.1:55114 - "POST /node/69e112452eed175ae971a752 HTTP/1.0" 202 Accepted 2026-04-16 16:46:50,445 - lava_callback - INFO - Starting async job submit for node 69e112452eed175ae971a752 2026-04-16 16:46:50,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:50,486 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112062eed175ae971a65d/log.txt.gz 2026-04-16 16:46:50,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:50,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112452eed175ae971a752 HTTP/1.1" 200 None 2026-04-16 16:46:50,629 - lava_callback - DEBUG - Processing node 69e112452eed175ae971a752: baseline-arm64-foundriesio 2026-04-16 16:46:50,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:50,692 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e1123f2eed175ae971a742/lava_callback.json.gz 2026-04-16 16:46:50,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:50,740 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e112442eed175ae971a74f/log.txt.gz 2026-04-16 16:46:50,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:50,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1123f2eed175ae971a742 HTTP/1.1" 200 None 2026-04-16 16:46:51,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:51,130 - lava_callback - INFO - Received callback for node 69e112102eed175ae971a679 INFO: 172.21.0.1:55120 - "POST /node/69e112102eed175ae971a679 HTTP/1.0" 202 Accepted 2026-04-16 16:46:51,178 - lava_callback - INFO - Starting async job submit for node 69e112102eed175ae971a679 2026-04-16 16:46:51,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:51,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:51,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:51,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:51,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1123f2eed175ae971a742 HTTP/1.1" 200 None 2026-04-16 16:46:51,447 - lava_callback - INFO - Completed processing callback for node 69e1123f2eed175ae971a742 2026-04-16 16:46:51,633 - lava_callback - INFO - Received callback for node 69e112122eed175ae971a681 2026-04-16 16:46:51,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112102eed175ae971a679 HTTP/1.1" 200 None 2026-04-16 16:46:51,680 - lava_callback - DEBUG - Processing node 69e112102eed175ae971a679: baseline-nfs-arm64 INFO: 172.21.0.1:55136 - "POST /node/69e112122eed175ae971a681 HTTP/1.0" 202 Accepted 2026-04-16 16:46:51,745 - lava_callback - INFO - Starting async job submit for node 69e112122eed175ae971a681 2026-04-16 16:46:51,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:51,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:51,884 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112062eed175ae971a65d/lava-logs.yaml 2026-04-16 16:46:51,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:52,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:52,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112122eed175ae971a681 HTTP/1.1" 200 None 2026-04-16 16:46:52,192 - lava_callback - DEBUG - Processing node 69e112122eed175ae971a681: baseline-nfs-arm64 2026-04-16 16:46:52,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:52,288 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112062eed175ae971a65d/lava_callback.json.gz 2026-04-16 16:46:52,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:52,354 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e112442eed175ae971a74f/lava-logs.yaml 2026-04-16 16:46:52,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:52,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:52,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112062eed175ae971a65d HTTP/1.1" 200 None 2026-04-16 16:46:52,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:52,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:52,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:52,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e112442eed175ae971a74f/lava_callback.json.gz 2026-04-16 16:46:52,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:52,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112062eed175ae971a65d HTTP/1.1" 200 None 2026-04-16 16:46:52,978 - lava_callback - INFO - Completed processing callback for node 69e112062eed175ae971a65d 2026-04-16 16:46:53,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:53,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112442eed175ae971a74f HTTP/1.1" 200 None 2026-04-16 16:46:53,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:53,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:53,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:53,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:53,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112442eed175ae971a74f HTTP/1.1" 200 None 2026-04-16 16:46:53,629 - lava_callback - INFO - Completed processing callback for node 69e112442eed175ae971a74f 2026-04-16 16:46:53,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:53,926 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e112452eed175ae971a752/log.txt.gz 2026-04-16 16:46:54,081 - lava_callback - INFO - Received callback for node 69e112412eed175ae971a749 INFO: 172.21.0.1:55138 - "POST /node/69e112412eed175ae971a749 HTTP/1.0" 202 Accepted 2026-04-16 16:46:54,149 - lava_callback - INFO - Starting async job submit for node 69e112412eed175ae971a749 2026-04-16 16:46:54,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:54,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:54,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112412eed175ae971a749 HTTP/1.1" 200 None 2026-04-16 16:46:54,457 - lava_callback - DEBUG - Processing node 69e112412eed175ae971a749: baseline-arm64-pengutronix 2026-04-16 16:46:54,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:54,719 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112102eed175ae971a679/log.txt.gz 2026-04-16 16:46:54,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:55,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:55,330 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112122eed175ae971a681/log.txt.gz 2026-04-16 16:46:55,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:55,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:55,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:56,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:56,027 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e112452eed175ae971a752/lava-logs.yaml 2026-04-16 16:46:56,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:56,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:56,096 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e112412eed175ae971a749/log.txt.gz 2026-04-16 16:46:56,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:56,248 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112102eed175ae971a679/lava-logs.yaml 2026-04-16 16:46:56,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:56,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:56,326 - lava_callback - INFO - Received callback for node 69e112002eed175ae971a64c INFO: 172.21.0.1:55148 - "POST /node/69e112002eed175ae971a64c HTTP/1.0" 202 Accepted 2026-04-16 16:46:56,358 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e112452eed175ae971a752/lava_callback.json.gz 2026-04-16 16:46:56,366 - lava_callback - INFO - Starting async job submit for node 69e112002eed175ae971a64c 2026-04-16 16:46:56,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55162 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:46:56,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:56,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:56,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112452eed175ae971a752 HTTP/1.1" 200 None 2026-04-16 16:46:56,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112002eed175ae971a64c HTTP/1.1" 200 None 2026-04-16 16:46:56,616 - lava_callback - DEBUG - Processing node 69e112002eed175ae971a64c: baseline-arm64 2026-04-16 16:46:56,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:56,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:56,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:56,662 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112102eed175ae971a679/lava_callback.json.gz 2026-04-16 16:46:56,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:56,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:56,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:56,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:56,815 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112122eed175ae971a681/lava-logs.yaml 2026-04-16 16:46:56,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112102eed175ae971a679 HTTP/1.1" 200 None 2026-04-16 16:46:56,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:56,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:56,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:56,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112452eed175ae971a752 HTTP/1.1" 200 None 2026-04-16 16:46:56,950 - lava_callback - INFO - Completed processing callback for node 69e112452eed175ae971a752 2026-04-16 16:46:56,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:57,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112102eed175ae971a679 HTTP/1.1" 200 None 2026-04-16 16:46:57,075 - lava_callback - INFO - Completed processing callback for node 69e112102eed175ae971a679 2026-04-16 16:46:57,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:57,171 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e112412eed175ae971a749/lava-logs.yaml 2026-04-16 16:46:57,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:57,335 - lava_callback - INFO - Received callback for node 69e1121a2eed175ae971a6ba INFO: 172.21.0.1:55166 - "POST /node/69e1121a2eed175ae971a6ba HTTP/1.0" 202 Accepted 2026-04-16 16:46:57,377 - lava_callback - INFO - Starting async job submit for node 69e1121a2eed175ae971a6ba 2026-04-16 16:46:57,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:57,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:57,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1121a2eed175ae971a6ba HTTP/1.1" 200 None 2026-04-16 16:46:57,543 - lava_callback - DEBUG - Processing node 69e1121a2eed175ae971a6ba: baseline-nfs-arm64 2026-04-16 16:46:57,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:57,554 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e112412eed175ae971a749/lava_callback.json.gz 2026-04-16 16:46:57,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:57,584 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112122eed175ae971a681/lava_callback.json.gz 2026-04-16 16:46:57,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:57,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:57,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112412eed175ae971a749 HTTP/1.1" 200 None 2026-04-16 16:46:57,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:57,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:57,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112122eed175ae971a681 HTTP/1.1" 200 None 2026-04-16 16:46:57,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:57,866 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112002eed175ae971a64c/log.txt.gz 2026-04-16 16:46:57,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:57,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:58,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:58,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:58,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112412eed175ae971a749 HTTP/1.1" 200 None 2026-04-16 16:46:58,129 - lava_callback - INFO - Completed processing callback for node 69e112412eed175ae971a749 2026-04-16 16:46:58,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112122eed175ae971a681 HTTP/1.1" 200 None 2026-04-16 16:46:58,238 - lava_callback - INFO - Completed processing callback for node 69e112122eed175ae971a681 2026-04-16 16:46:58,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:58,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:58,943 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112002eed175ae971a64c/lava-logs.yaml 2026-04-16 16:46:58,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:59,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:46:59,144 - lava_callback - INFO - Received callback for node 69e1120d2eed175ae971a673 INFO: 172.21.0.1:55178 - "POST /node/69e1120d2eed175ae971a673 HTTP/1.0" 202 Accepted 2026-04-16 16:46:59,158 - lava_callback - INFO - Starting async job submit for node 69e1120d2eed175ae971a673 2026-04-16 16:46:59,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:59,208 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112002eed175ae971a64c/lava_callback.json.gz 2026-04-16 16:46:59,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:59,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:46:59,265 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e1121a2eed175ae971a6ba/log.txt.gz 2026-04-16 16:46:59,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:59,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1120d2eed175ae971a673 HTTP/1.1" 200 None 2026-04-16 16:46:59,293 - lava_callback - DEBUG - Processing node 69e1120d2eed175ae971a673: baseline-nfs-arm64 2026-04-16 16:46:59,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112002eed175ae971a64c HTTP/1.1" 200 None 2026-04-16 16:46:59,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:59,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:46:59,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:46:59,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112002eed175ae971a64c HTTP/1.1" 200 None 2026-04-16 16:46:59,803 - lava_callback - INFO - Completed processing callback for node 69e112002eed175ae971a64c 2026-04-16 16:47:00,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:00,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:00,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:00,632 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e1120d2eed175ae971a673/log.txt.gz 2026-04-16 16:47:00,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:00,650 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e1121a2eed175ae971a6ba/lava-logs.yaml 2026-04-16 16:47:00,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:00,930 - lava_callback - INFO - Received callback for node 69e112422eed175ae971a74c INFO: 172.21.0.1:60118 - "POST /node/69e112422eed175ae971a74c HTTP/1.0" 202 Accepted 2026-04-16 16:47:00,947 - lava_callback - INFO - Starting async job submit for node 69e112422eed175ae971a74c 2026-04-16 16:47:00,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:00,975 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e1121a2eed175ae971a6ba/lava_callback.json.gz 2026-04-16 16:47:01,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:01,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:01,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:01,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112422eed175ae971a74c HTTP/1.1" 200 None 2026-04-16 16:47:01,164 - lava_callback - DEBUG - Processing node 69e112422eed175ae971a74c: baseline-arm64-pengutronix 2026-04-16 16:47:01,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1121a2eed175ae971a6ba HTTP/1.1" 200 None 2026-04-16 16:47:01,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:01,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:47:01,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:01,334 - lava_callback - INFO - Received callback for node 69e1123c2eed175ae971a734 INFO: 172.21.0.1:60120 - "POST /node/69e1123c2eed175ae971a734 HTTP/1.0" 202 Accepted 2026-04-16 16:47:01,365 - lava_callback - INFO - Starting async job submit for node 69e1123c2eed175ae971a734 2026-04-16 16:47:01,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1121a2eed175ae971a6ba HTTP/1.1" 200 None 2026-04-16 16:47:01,451 - lava_callback - INFO - Completed processing callback for node 69e1121a2eed175ae971a6ba 2026-04-16 16:47:01,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:01,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1123c2eed175ae971a734 HTTP/1.1" 200 None 2026-04-16 16:47:01,545 - lava_callback - DEBUG - Processing node 69e1123c2eed175ae971a734: baseline-arm64-kontron 2026-04-16 16:47:01,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:01,588 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e1120d2eed175ae971a673/lava-logs.yaml 2026-04-16 16:47:01,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:01,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:01,948 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e1120d2eed175ae971a673/lava_callback.json.gz 2026-04-16 16:47:02,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:02,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:02,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1120d2eed175ae971a673 HTTP/1.1" 200 None 2026-04-16 16:47:02,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:02,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:47:02,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:02,429 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:02,434 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e112422eed175ae971a74c/log.txt.gz 2026-04-16 16:47:02,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1120d2eed175ae971a673 HTTP/1.1" 200 None 2026-04-16 16:47:02,449 - lava_callback - INFO - Completed processing callback for node 69e1120d2eed175ae971a673 2026-04-16 16:47:02,639 - lava_callback - INFO - Received callback for node 69e1123e2eed175ae971a73f INFO: 172.21.0.1:60136 - "POST /node/69e1123e2eed175ae971a73f HTTP/1.0" 202 Accepted 2026-04-16 16:47:02,703 - lava_callback - INFO - Starting async job submit for node 69e1123e2eed175ae971a73f 2026-04-16 16:47:02,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:02,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:02,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1123e2eed175ae971a73f HTTP/1.1" 200 None 2026-04-16 16:47:02,914 - lava_callback - DEBUG - Processing node 69e1123e2eed175ae971a73f: baseline-arm64-kontron 2026-04-16 16:47:02,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:03,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:03,007 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e1123c2eed175ae971a734/log.txt.gz 2026-04-16 16:47:03,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:03,480 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e112422eed175ae971a74c/lava-logs.yaml 2026-04-16 16:47:03,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:03,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:03,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:03,838 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e112422eed175ae971a74c/lava_callback.json.gz 2026-04-16 16:47:03,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:03,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:03,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:03,917 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e1123c2eed175ae971a734/lava-logs.yaml 2026-04-16 16:47:03,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112422eed175ae971a74c HTTP/1.1" 200 None 2026-04-16 16:47:03,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:03,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:03,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:47:03,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:04,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112422eed175ae971a74c HTTP/1.1" 200 None 2026-04-16 16:47:04,004 - lava_callback - INFO - Completed processing callback for node 69e112422eed175ae971a74c 2026-04-16 16:47:04,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:04,144 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e1123e2eed175ae971a73f/log.txt.gz 2026-04-16 16:47:04,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:04,193 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e1123c2eed175ae971a734/lava_callback.json.gz 2026-04-16 16:47:04,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:04,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1123c2eed175ae971a734 HTTP/1.1" 200 None 2026-04-16 16:47:04,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:04,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:47:04,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:04,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1123c2eed175ae971a734 HTTP/1.1" 200 None 2026-04-16 16:47:04,590 - lava_callback - INFO - Completed processing callback for node 69e1123c2eed175ae971a734 2026-04-16 16:47:04,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:05,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:05,012 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e1123e2eed175ae971a73f/lava-logs.yaml 2026-04-16 16:47:05,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:05,026 - lava_callback - INFO - Received callback for node 69e112142eed175ae971a684 INFO: 172.21.0.1:60148 - "POST /node/69e112142eed175ae971a684 HTTP/1.0" 202 Accepted 2026-04-16 16:47:05,039 - lava_callback - INFO - Starting async job submit for node 69e112142eed175ae971a684 2026-04-16 16:47:05,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:05,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112142eed175ae971a684 HTTP/1.1" 200 None 2026-04-16 16:47:05,130 - lava_callback - DEBUG - Processing node 69e112142eed175ae971a684: baseline-nfs-arm64 2026-04-16 16:47:05,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:05,229 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e1123e2eed175ae971a73f/lava_callback.json.gz 2026-04-16 16:47:05,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:05,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1123e2eed175ae971a73f HTTP/1.1" 200 None 2026-04-16 16:47:05,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:05,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:47:05,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:05,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1123e2eed175ae971a73f HTTP/1.1" 200 None 2026-04-16 16:47:05,621 - lava_callback - INFO - Completed processing callback for node 69e1123e2eed175ae971a73f 2026-04-16 16:47:06,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:06,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:06,431 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112142eed175ae971a684/log.txt.gz INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:47:06,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:07,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:07,165 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112142eed175ae971a684/lava-logs.yaml 2026-04-16 16:47:07,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:07,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:07,341 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112142eed175ae971a684/lava_callback.json.gz 2026-04-16 16:47:07,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:07,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112142eed175ae971a684 HTTP/1.1" 200 None 2026-04-16 16:47:07,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:07,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:47:07,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:07,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112142eed175ae971a684 HTTP/1.1" 200 None 2026-04-16 16:47:07,482 - lava_callback - INFO - Completed processing callback for node 69e112142eed175ae971a684 2026-04-16 16:47:09,204 - lava_callback - INFO - Received callback for node 69de6f7bf6535ffd5b3eda8e INFO: 172.21.0.1:60166 - "POST /node/69de6f7bf6535ffd5b3eda8e HTTP/1.0" 202 Accepted 2026-04-16 16:47:09,217 - lava_callback - INFO - Starting async job submit for node 69de6f7bf6535ffd5b3eda8e 2026-04-16 16:47:09,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:09,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6f7bf6535ffd5b3eda8e HTTP/1.1" 200 None 2026-04-16 16:47:09,261 - lava_callback - DEBUG - Processing node 69de6f7bf6535ffd5b3eda8e: baseline-arm-clabbe 2026-04-16 16:47:09,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de6f7bf6535ffd5b3eda8e 2026-04-16 16:47:09,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:09,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6f7bf6535ffd5b3eda8e HTTP/1.1" 200 None 2026-04-16 16:47:09,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:09,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-16 16:47:09,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:09,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de6f7bf6535ffd5b3eda8e HTTP/1.1" 200 None 2026-04-16 16:47:09,381 - lava_callback - ERROR - Error processing callback for node 69de6f7bf6535ffd5b3eda8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54976 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 16:47:15,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:15,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:54980 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:47:25,842 - lava_callback - INFO - Received callback for node 69e112162eed175ae971a68a INFO: 172.21.0.1:37886 - "POST /node/69e112162eed175ae971a68a HTTP/1.0" 202 Accepted 2026-04-16 16:47:25,849 - lava_callback - INFO - Starting async job submit for node 69e112162eed175ae971a68a 2026-04-16 16:47:25,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:25,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112162eed175ae971a68a HTTP/1.1" 200 None 2026-04-16 16:47:25,888 - lava_callback - DEBUG - Processing node 69e112162eed175ae971a68a: baseline-nfs-arm64 2026-04-16 16:47:26,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:26,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:26,317 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112162eed175ae971a68a/log.txt.gz 2026-04-16 16:47:26,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:37896 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:47:26,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:26,648 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112162eed175ae971a68a/lava-logs.yaml 2026-04-16 16:47:26,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:47:26,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:47:26,777 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112162eed175ae971a68a/lava_callback.json.gz 2026-04-16 16:47:26,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:26,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112162eed175ae971a68a HTTP/1.1" 200 None 2026-04-16 16:47:26,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:26,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:47:26,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:26,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112162eed175ae971a68a HTTP/1.1" 200 None 2026-04-16 16:47:26,856 - lava_callback - INFO - Completed processing callback for node 69e112162eed175ae971a68a INFO: 172.21.0.1:53280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49722 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:47:45,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:45,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49728 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:47:49,174 - lava_callback - INFO - Received callback for node 69de6f9ff6535ffd5b3edaba INFO: 172.21.0.1:49730 - "POST /node/69de6f9ff6535ffd5b3edaba HTTP/1.0" 202 Accepted 2026-04-16 16:47:49,180 - lava_callback - INFO - Starting async job submit for node 69de6f9ff6535ffd5b3edaba 2026-04-16 16:47:49,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:49,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6f9ff6535ffd5b3edaba HTTP/1.1" 200 None 2026-04-16 16:47:49,196 - lava_callback - DEBUG - Processing node 69de6f9ff6535ffd5b3edaba: baseline-arm-clabbe 2026-04-16 16:47:49,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de6f9ff6535ffd5b3edaba 2026-04-16 16:47:49,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:49,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6f9ff6535ffd5b3edaba HTTP/1.1" 200 None 2026-04-16 16:47:49,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:49,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-16 16:47:49,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:47:49,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de6f9ff6535ffd5b3edaba HTTP/1.1" 200 None 2026-04-16 16:47:49,250 - lava_callback - ERROR - Error processing callback for node 69de6f9ff6535ffd5b3edaba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53812 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:48:09,246 - lava_callback - INFO - Received callback for node 69de6fc2f6535ffd5b3edad0 INFO: 172.21.0.1:53822 - "POST /node/69de6fc2f6535ffd5b3edad0 HTTP/1.0" 202 Accepted 2026-04-16 16:48:09,252 - lava_callback - INFO - Starting async job submit for node 69de6fc2f6535ffd5b3edad0 2026-04-16 16:48:09,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:48:09,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6fc2f6535ffd5b3edad0 HTTP/1.1" 200 None 2026-04-16 16:48:09,267 - lava_callback - DEBUG - Processing node 69de6fc2f6535ffd5b3edad0: baseline-arm-clabbe 2026-04-16 16:48:09,267 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de6fc2f6535ffd5b3edad0 2026-04-16 16:48:09,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:48:09,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6fc2f6535ffd5b3edad0 HTTP/1.1" 200 None 2026-04-16 16:48:09,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:48:09,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-16 16:48:09,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:48:09,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de6fc2f6535ffd5b3edad0 HTTP/1.1" 200 None 2026-04-16 16:48:09,326 - lava_callback - ERROR - Error processing callback for node 69de6fc2f6535ffd5b3edad0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53190 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:48:49,251 - lava_callback - INFO - Received callback for node 69de6fe0f6535ffd5b3edb05 INFO: 172.21.0.1:53204 - "POST /node/69de6fe0f6535ffd5b3edb05 HTTP/1.0" 202 Accepted 2026-04-16 16:48:49,257 - lava_callback - INFO - Starting async job submit for node 69de6fe0f6535ffd5b3edb05 2026-04-16 16:48:49,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:48:49,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6fe0f6535ffd5b3edb05 HTTP/1.1" 200 None 2026-04-16 16:48:49,272 - lava_callback - DEBUG - Processing node 69de6fe0f6535ffd5b3edb05: baseline-arm-clabbe 2026-04-16 16:48:49,272 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de6fe0f6535ffd5b3edb05 2026-04-16 16:48:49,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:48:49,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de6fe0f6535ffd5b3edb05 HTTP/1.1" 200 None 2026-04-16 16:48:49,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:48:49,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-16 16:48:49,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:48:49,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de6fe0f6535ffd5b3edb05 HTTP/1.1" 200 None 2026-04-16 16:48:49,320 - lava_callback - ERROR - Error processing callback for node 69de6fe0f6535ffd5b3edb05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35132 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:48:56,951 - lava_callback - INFO - Received callback for node 69e111ff2eed175ae971a649 INFO: 172.21.0.1:35146 - "POST /node/69e111ff2eed175ae971a649 HTTP/1.0" 202 Accepted 2026-04-16 16:48:56,957 - lava_callback - INFO - Starting async job submit for node 69e111ff2eed175ae971a649 2026-04-16 16:48:56,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:48:56,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111ff2eed175ae971a649 HTTP/1.1" 200 None 2026-04-16 16:48:56,989 - lava_callback - DEBUG - Processing node 69e111ff2eed175ae971a649: baseline-arm64 2026-04-16 16:48:57,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:48:57,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:48:57,625 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111ff2eed175ae971a649/log.txt.gz 2026-04-16 16:48:57,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:48:58,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:48:58,141 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111ff2eed175ae971a649/lava-logs.yaml 2026-04-16 16:48:58,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:48:58,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:48:58,421 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e111ff2eed175ae971a649/lava_callback.json.gz 2026-04-16 16:48:58,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:48:58,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e111ff2eed175ae971a649 HTTP/1.1" 200 None 2026-04-16 16:48:58,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:48:58,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:48:58,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:48:58,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e111ff2eed175ae971a649 HTTP/1.1" 200 None 2026-04-16 16:48:58,502 - lava_callback - INFO - Completed processing callback for node 69e111ff2eed175ae971a649 INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36702 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 16:49:15,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:49:15,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:49:29,282 - lava_callback - INFO - Received callback for node 69de7006f6535ffd5b3edb18 INFO: 172.21.0.1:56548 - "POST /node/69de7006f6535ffd5b3edb18 HTTP/1.0" 202 Accepted 2026-04-16 16:49:29,287 - lava_callback - INFO - Starting async job submit for node 69de7006f6535ffd5b3edb18 2026-04-16 16:49:29,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:49:29,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7006f6535ffd5b3edb18 HTTP/1.1" 200 None 2026-04-16 16:49:29,304 - lava_callback - DEBUG - Processing node 69de7006f6535ffd5b3edb18: baseline-arm-clabbe 2026-04-16 16:49:29,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7006f6535ffd5b3edb18 2026-04-16 16:49:29,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:49:29,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7006f6535ffd5b3edb18 HTTP/1.1" 200 None 2026-04-16 16:49:29,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:49:29,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-16 16:49:29,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:49:29,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7006f6535ffd5b3edb18 HTTP/1.1" 200 None 2026-04-16 16:49:29,383 - lava_callback - ERROR - Error processing callback for node 69de7006f6535ffd5b3edb18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44320 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:50:05,538 - lava_callback - INFO - Received callback for node 69de7029f6535ffd5b3edb2a INFO: 172.21.0.1:39062 - "POST /node/69de7029f6535ffd5b3edb2a HTTP/1.0" 202 Accepted 2026-04-16 16:50:05,543 - lava_callback - INFO - Starting async job submit for node 69de7029f6535ffd5b3edb2a 2026-04-16 16:50:05,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:05,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7029f6535ffd5b3edb2a HTTP/1.1" 200 None 2026-04-16 16:50:05,559 - lava_callback - DEBUG - Processing node 69de7029f6535ffd5b3edb2a: baseline-arm-baylibre 2026-04-16 16:50:05,560 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7029f6535ffd5b3edb2a 2026-04-16 16:50:05,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:05,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7029f6535ffd5b3edb2a HTTP/1.1" 200 None 2026-04-16 16:50:05,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:05,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680092cda61b443d5b587 HTTP/1.1" 200 None 2026-04-16 16:50:05,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:05,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7029f6535ffd5b3edb2a HTTP/1.1" 200 None 2026-04-16 16:50:05,610 - lava_callback - ERROR - Error processing callback for node 69de7029f6535ffd5b3edb2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33744 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:50:25,515 - lava_callback - INFO - Received callback for node 69de704bf6535ffd5b3edb40 INFO: 172.21.0.1:59022 - "POST /node/69de704bf6535ffd5b3edb40 HTTP/1.0" 202 Accepted 2026-04-16 16:50:25,521 - lava_callback - INFO - Starting async job submit for node 69de704bf6535ffd5b3edb40 2026-04-16 16:50:25,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:25,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de704bf6535ffd5b3edb40 HTTP/1.1" 200 None 2026-04-16 16:50:25,537 - lava_callback - DEBUG - Processing node 69de704bf6535ffd5b3edb40: baseline-arm-baylibre 2026-04-16 16:50:25,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de704bf6535ffd5b3edb40 2026-04-16 16:50:25,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:25,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de704bf6535ffd5b3edb40 HTTP/1.1" 200 None 2026-04-16 16:50:25,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:25,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680092cda61b443d5b587 HTTP/1.1" 200 None 2026-04-16 16:50:25,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:25,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de704bf6535ffd5b3edb40 HTTP/1.1" 200 None 2026-04-16 16:50:25,648 - lava_callback - ERROR - Error processing callback for node 69de704bf6535ffd5b3edb40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59024 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:50:27,152 - lava_callback - INFO - Received callback for node 69e113492eed175ae971a8b3 INFO: 172.21.0.1:59036 - "POST /node/69e113492eed175ae971a8b3 HTTP/1.0" 202 Accepted 2026-04-16 16:50:27,158 - lava_callback - INFO - Starting async job submit for node 69e113492eed175ae971a8b3 2026-04-16 16:50:27,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:27,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e113492eed175ae971a8b3 HTTP/1.1" 200 None 2026-04-16 16:50:27,175 - lava_callback - DEBUG - Processing node 69e113492eed175ae971a8b3: baseline-nfs-arm64 2026-04-16 16:50:27,177 - lava_callback - WARNING - Failed to upload log 2026-04-16 16:50:27,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:50:27,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:50:27,432 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e113492eed175ae971a8b3/lava-logs.yaml 2026-04-16 16:50:27,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:50:27,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:50:27,535 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e113492eed175ae971a8b3/lava_callback.json.gz 2026-04-16 16:50:27,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:27,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e113492eed175ae971a8b3 HTTP/1.1" 200 None 2026-04-16 16:50:27,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:27,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:50:27,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:27,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e113492eed175ae971a8b3 HTTP/1.1" 200 None 2026-04-16 16:50:27,595 - lava_callback - INFO - Completed processing callback for node 69e113492eed175ae971a8b3 2026-04-16 16:50:35,357 - lava_callback - INFO - Received callback for node 69e112282eed175ae971a6da INFO: 172.21.0.1:43414 - "POST /node/69e112282eed175ae971a6da HTTP/1.0" 202 Accepted 2026-04-16 16:50:35,363 - lava_callback - INFO - Starting async job submit for node 69e112282eed175ae971a6da 2026-04-16 16:50:35,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:35,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112282eed175ae971a6da HTTP/1.1" 200 None 2026-04-16 16:50:35,418 - lava_callback - DEBUG - Processing node 69e112282eed175ae971a6da: baseline-arm64-broonie 2026-04-16 16:50:35,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:50:35,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:50:35,956 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e112282eed175ae971a6da/log.txt.gz 2026-04-16 16:50:36,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:50:36,218 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:50:36,220 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e112282eed175ae971a6da/lava-logs.yaml 2026-04-16 16:50:36,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:50:36,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:50:36,349 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e112282eed175ae971a6da/lava_callback.json.gz 2026-04-16 16:50:36,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:36,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112282eed175ae971a6da HTTP/1.1" 200 None 2026-04-16 16:50:36,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:36,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:50:36,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:36,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112282eed175ae971a6da HTTP/1.1" 200 None 2026-04-16 16:50:36,430 - lava_callback - INFO - Completed processing callback for node 69e112282eed175ae971a6da INFO: 172.21.0.1:43426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58286 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:50:45,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:50:45,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47454 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:51:05,579 - lava_callback - INFO - Received callback for node 69de706cf6535ffd5b3edb54 INFO: 172.21.0.1:57264 - "POST /node/69de706cf6535ffd5b3edb54 HTTP/1.0" 202 Accepted 2026-04-16 16:51:05,584 - lava_callback - INFO - Starting async job submit for node 69de706cf6535ffd5b3edb54 2026-04-16 16:51:05,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:51:05,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de706cf6535ffd5b3edb54 HTTP/1.1" 200 None 2026-04-16 16:51:05,601 - lava_callback - DEBUG - Processing node 69de706cf6535ffd5b3edb54: baseline-arm-baylibre 2026-04-16 16:51:05,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de706cf6535ffd5b3edb54 2026-04-16 16:51:05,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:51:05,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de706cf6535ffd5b3edb54 HTTP/1.1" 200 None 2026-04-16 16:51:05,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:51:05,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680092cda61b443d5b587 HTTP/1.1" 200 None 2026-04-16 16:51:05,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:51:05,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de706cf6535ffd5b3edb54 HTTP/1.1" 200 None 2026-04-16 16:51:05,652 - lava_callback - ERROR - Error processing callback for node 69de706cf6535ffd5b3edb54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47472 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:52:05,604 - lava_callback - INFO - Received callback for node 69de70abf6535ffd5b3edb91 INFO: 172.21.0.1:60448 - "POST /node/69de70abf6535ffd5b3edb91 HTTP/1.0" 202 Accepted 2026-04-16 16:52:05,613 - lava_callback - INFO - Starting async job submit for node 69de70abf6535ffd5b3edb91 2026-04-16 16:52:05,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:52:05,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de70abf6535ffd5b3edb91 HTTP/1.1" 200 None 2026-04-16 16:52:05,634 - lava_callback - DEBUG - Processing node 69de70abf6535ffd5b3edb91: baseline-arm-baylibre 2026-04-16 16:52:05,634 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de70abf6535ffd5b3edb91 2026-04-16 16:52:05,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:52:05,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de70abf6535ffd5b3edb91 HTTP/1.1" 200 None 2026-04-16 16:52:05,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:52:05,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680092cda61b443d5b587 HTTP/1.1" 200 None 2026-04-16 16:52:05,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:52:05,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de70abf6535ffd5b3edb91 HTTP/1.1" 200 None 2026-04-16 16:52:05,685 - lava_callback - ERROR - Error processing callback for node 69de70abf6535ffd5b3edb91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41256 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:52:18,251 - lava_callback - INFO - Received callback for node 69e1120e2eed175ae971a676 INFO: 172.21.0.1:41266 - "POST /node/69e1120e2eed175ae971a676 HTTP/1.0" 202 Accepted 2026-04-16 16:52:18,258 - lava_callback - INFO - Starting async job submit for node 69e1120e2eed175ae971a676 2026-04-16 16:52:18,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:52:18,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1120e2eed175ae971a676 HTTP/1.1" 200 None 2026-04-16 16:52:18,292 - lava_callback - DEBUG - Processing node 69e1120e2eed175ae971a676: baseline-nfs-arm64 2026-04-16 16:52:18,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:52:18,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:52:18,988 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e1120e2eed175ae971a676/log.txt.gz 2026-04-16 16:52:19,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:52:19,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:52:19,531 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e1120e2eed175ae971a676/lava-logs.yaml 2026-04-16 16:52:19,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:52:19,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:52:19,694 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e1120e2eed175ae971a676/lava_callback.json.gz 2026-04-16 16:52:19,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:52:19,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1120e2eed175ae971a676 HTTP/1.1" 200 None 2026-04-16 16:52:19,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:52:19,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:52:19,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:52:19,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1120e2eed175ae971a676 HTTP/1.1" 200 None 2026-04-16 16:52:19,772 - lava_callback - INFO - Completed processing callback for node 69e1120e2eed175ae971a676 INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50154 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:52:45,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:52:45,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:52:52,718 - lava_callback - INFO - Received callback for node 69e1120b2eed175ae971a66f INFO: 172.21.0.1:46854 - "POST /node/69e1120b2eed175ae971a66f HTTP/1.0" 202 Accepted 2026-04-16 16:52:52,726 - lava_callback - INFO - Starting async job submit for node 69e1120b2eed175ae971a66f 2026-04-16 16:52:52,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:52:52,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1120b2eed175ae971a66f HTTP/1.1" 200 None 2026-04-16 16:52:52,784 - lava_callback - DEBUG - Processing node 69e1120b2eed175ae971a66f: baseline-arm64 2026-04-16 16:52:53,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:52:53,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:52:53,253 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e1120b2eed175ae971a66f/log.txt.gz 2026-04-16 16:52:53,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:52:53,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:52:53,616 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e1120b2eed175ae971a66f/lava-logs.yaml 2026-04-16 16:52:53,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:52:53,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:52:53,745 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e1120b2eed175ae971a66f/lava_callback.json.gz DEBUG: Setup failed for 69e1120b2eed175ae971a66f. Transitting job node result: incomplete -> fail 2026-04-16 16:52:53,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:52:53,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1120b2eed175ae971a66f HTTP/1.1" 200 None 2026-04-16 16:52:53,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:52:53,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:52:53,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:52:53,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1120b2eed175ae971a66f HTTP/1.1" 200 None 2026-04-16 16:52:53,968 - lava_callback - INFO - Completed processing callback for node 69e1120b2eed175ae971a66f INFO: 172.21.0.1:46868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51588 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:53:09,436 - lava_callback - INFO - Received callback for node 69de70e7f6535ffd5b3edbab INFO: 172.21.0.1:51590 - "POST /node/69de70e7f6535ffd5b3edbab HTTP/1.0" 202 Accepted 2026-04-16 16:53:09,442 - lava_callback - INFO - Starting async job submit for node 69de70e7f6535ffd5b3edbab 2026-04-16 16:53:09,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:53:09,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de70e7f6535ffd5b3edbab HTTP/1.1" 200 None 2026-04-16 16:53:09,458 - lava_callback - DEBUG - Processing node 69de70e7f6535ffd5b3edbab: baseline-arm-clabbe 2026-04-16 16:53:09,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de70e7f6535ffd5b3edbab 2026-04-16 16:53:09,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:53:09,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de70e7f6535ffd5b3edbab HTTP/1.1" 200 None 2026-04-16 16:53:09,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:53:09,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680092cda61b443d5b587 HTTP/1.1" 200 None 2026-04-16 16:53:09,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:53:09,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de70e7f6535ffd5b3edbab HTTP/1.1" 200 None 2026-04-16 16:53:09,508 - lava_callback - ERROR - Error processing callback for node 69de70e7f6535ffd5b3edbab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 16:53:13,539 - lava_callback - INFO - Received callback for node 69e112332eed175ae971a6f7 INFO: 172.21.0.1:35688 - "POST /node/69e112332eed175ae971a6f7 HTTP/1.0" 202 Accepted 2026-04-16 16:53:13,545 - lava_callback - INFO - Starting async job submit for node 69e112332eed175ae971a6f7 2026-04-16 16:53:13,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:53:13,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112332eed175ae971a6f7 HTTP/1.1" 200 None 2026-04-16 16:53:13,582 - lava_callback - DEBUG - Processing node 69e112332eed175ae971a6f7: baseline-arm64-broonie 2026-04-16 16:53:13,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:53:13,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:53:13,922 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e112332eed175ae971a6f7/log.txt.gz 2026-04-16 16:53:14,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:53:14,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:53:14,207 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e112332eed175ae971a6f7/lava-logs.yaml 2026-04-16 16:53:14,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:53:14,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:53:14,311 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e112332eed175ae971a6f7/lava_callback.json.gz 2026-04-16 16:53:14,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:53:14,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112332eed175ae971a6f7 HTTP/1.1" 200 None 2026-04-16 16:53:14,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:53:14,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:53:14,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:53:14,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112332eed175ae971a6f7 HTTP/1.1" 200 None 2026-04-16 16:53:14,391 - lava_callback - INFO - Completed processing callback for node 69e112332eed175ae971a6f7 INFO: 172.21.0.1:35692 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 16:53:15,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:53:15,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37264 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:53:53,510 - lava_callback - INFO - Received callback for node 69e112302eed175ae971a6f1 INFO: 172.21.0.1:41136 - "POST /node/69e112302eed175ae971a6f1 HTTP/1.0" 202 Accepted 2026-04-16 16:53:53,516 - lava_callback - INFO - Starting async job submit for node 69e112302eed175ae971a6f1 2026-04-16 16:53:53,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:53:53,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112302eed175ae971a6f1 HTTP/1.1" 200 None 2026-04-16 16:53:53,557 - lava_callback - DEBUG - Processing node 69e112302eed175ae971a6f1: baseline-arm64-broonie 2026-04-16 16:53:53,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:53:53,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:53:53,943 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e112302eed175ae971a6f1/log.txt.gz 2026-04-16 16:53:54,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:53:54,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:53:54,297 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e112302eed175ae971a6f1/lava-logs.yaml 2026-04-16 16:53:54,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:53:54,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:53:54,420 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e112302eed175ae971a6f1/lava_callback.json.gz 2026-04-16 16:53:54,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:53:54,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112302eed175ae971a6f1 HTTP/1.1" 200 None 2026-04-16 16:53:54,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:53:54,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:53:54,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:53:54,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112302eed175ae971a6f1 HTTP/1.1" 200 None 2026-04-16 16:53:54,499 - lava_callback - INFO - Completed processing callback for node 69e112302eed175ae971a6f1 INFO: 172.21.0.1:41148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55016 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:54:09,490 - lava_callback - INFO - Received callback for node 69de7123f6535ffd5b3edbe5 INFO: 172.21.0.1:55022 - "POST /node/69de7123f6535ffd5b3edbe5 HTTP/1.0" 202 Accepted 2026-04-16 16:54:09,496 - lava_callback - INFO - Starting async job submit for node 69de7123f6535ffd5b3edbe5 2026-04-16 16:54:09,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:54:09,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7123f6535ffd5b3edbe5 HTTP/1.1" 200 None 2026-04-16 16:54:09,513 - lava_callback - DEBUG - Processing node 69de7123f6535ffd5b3edbe5: baseline-arm-clabbe 2026-04-16 16:54:09,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7123f6535ffd5b3edbe5 2026-04-16 16:54:09,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:54:09,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7123f6535ffd5b3edbe5 HTTP/1.1" 200 None 2026-04-16 16:54:09,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:54:09,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680092cda61b443d5b587 HTTP/1.1" 200 None 2026-04-16 16:54:09,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:54:09,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7123f6535ffd5b3edbe5 HTTP/1.1" 200 None 2026-04-16 16:54:09,562 - lava_callback - ERROR - Error processing callback for node 69de7123f6535ffd5b3edbe5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36874 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 16:54:15,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:54:15,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36880 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:54:23,288 - lava_callback - INFO - Received callback for node 69e114082eed175ae971a91d INFO: 172.21.0.1:51824 - "POST /node/69e114082eed175ae971a91d HTTP/1.0" 202 Accepted 2026-04-16 16:54:23,295 - lava_callback - INFO - Starting async job submit for node 69e114082eed175ae971a91d 2026-04-16 16:54:23,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:54:23,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e114082eed175ae971a91d HTTP/1.1" 200 None 2026-04-16 16:54:23,353 - lava_callback - DEBUG - Processing node 69e114082eed175ae971a91d: baseline-arm64 2026-04-16 16:54:23,488 - lava_callback - WARNING - Failed to upload log 2026-04-16 16:54:23,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:54:23,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:54:23,719 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e114082eed175ae971a91d/lava-logs.yaml 2026-04-16 16:54:23,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:54:23,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:54:23,826 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e114082eed175ae971a91d/lava_callback.json.gz 2026-04-16 16:54:23,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:54:23,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e114082eed175ae971a91d HTTP/1.1" 200 None 2026-04-16 16:54:23,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:54:23,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:54:23,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:54:23,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e114082eed175ae971a91d HTTP/1.1" 200 None 2026-04-16 16:54:24,038 - lava_callback - INFO - Completed processing callback for node 69e114082eed175ae971a91d INFO: 172.21.0.1:51840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40696 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:54:45,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:54:45,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56504 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:55:29,531 - lava_callback - INFO - Received callback for node 69de7173f6535ffd5b3edc0c INFO: 172.21.0.1:56516 - "POST /node/69de7173f6535ffd5b3edc0c HTTP/1.0" 202 Accepted 2026-04-16 16:55:29,537 - lava_callback - INFO - Starting async job submit for node 69de7173f6535ffd5b3edc0c 2026-04-16 16:55:29,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:55:29,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7173f6535ffd5b3edc0c HTTP/1.1" 200 None 2026-04-16 16:55:29,554 - lava_callback - DEBUG - Processing node 69de7173f6535ffd5b3edc0c: baseline-arm-clabbe 2026-04-16 16:55:29,554 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7173f6535ffd5b3edc0c 2026-04-16 16:55:29,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:55:29,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7173f6535ffd5b3edc0c HTTP/1.1" 200 None 2026-04-16 16:55:29,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:55:29,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680092cda61b443d5b587 HTTP/1.1" 200 None 2026-04-16 16:55:29,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:55:29,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7173f6535ffd5b3edc0c HTTP/1.1" 200 None 2026-04-16 16:55:29,632 - lava_callback - ERROR - Error processing callback for node 69de7173f6535ffd5b3edc0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43606 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:55:43,883 - lava_callback - INFO - Received callback for node 69e1145f2eed175ae971a946 INFO: 172.21.0.1:36674 - "POST /node/69e1145f2eed175ae971a946 HTTP/1.0" 202 Accepted 2026-04-16 16:55:43,890 - lava_callback - INFO - Starting async job submit for node 69e1145f2eed175ae971a946 2026-04-16 16:55:43,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:55:43,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1145f2eed175ae971a946 HTTP/1.1" 200 None 2026-04-16 16:55:43,947 - lava_callback - DEBUG - Processing node 69e1145f2eed175ae971a946: baseline-arm64 2026-04-16 16:55:44,100 - lava_callback - WARNING - Failed to upload log 2026-04-16 16:55:44,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:55:44,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:55:44,332 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e1145f2eed175ae971a946/lava-logs.yaml 2026-04-16 16:55:44,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:55:44,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:55:44,443 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e1145f2eed175ae971a946/lava_callback.json.gz 2026-04-16 16:55:44,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:36686 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:55:44,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1145f2eed175ae971a946 HTTP/1.1" 200 None 2026-04-16 16:55:44,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:55:44,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:55:44,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:55:44,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1145f2eed175ae971a946 HTTP/1.1" 200 None 2026-04-16 16:55:44,615 - lava_callback - INFO - Completed processing callback for node 69e1145f2eed175ae971a946 2026-04-16 16:55:45,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:55:45,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36696 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:55:50,150 - lava_callback - INFO - Received callback for node 69e112072eed175ae971a660 INFO: 172.21.0.1:46274 - "POST /node/69e112072eed175ae971a660 HTTP/1.0" 202 Accepted 2026-04-16 16:55:50,157 - lava_callback - INFO - Starting async job submit for node 69e112072eed175ae971a660 2026-04-16 16:55:50,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:55:50,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112072eed175ae971a660 HTTP/1.1" 200 None 2026-04-16 16:55:50,197 - lava_callback - DEBUG - Processing node 69e112072eed175ae971a660: baseline-arm64 2026-04-16 16:55:50,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:55:50,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:55:50,818 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112072eed175ae971a660/log.txt.gz 2026-04-16 16:55:51,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:55:51,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:55:51,209 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112072eed175ae971a660/lava-logs.yaml 2026-04-16 16:55:51,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:55:51,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:55:51,365 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e112072eed175ae971a660/lava_callback.json.gz 2026-04-16 16:55:51,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:55:51,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112072eed175ae971a660 HTTP/1.1" 200 None 2026-04-16 16:55:51,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:55:51,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:55:51,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:55:51,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112072eed175ae971a660 HTTP/1.1" 200 None 2026-04-16 16:55:51,512 - lava_callback - INFO - Completed processing callback for node 69e112072eed175ae971a660 INFO: 172.21.0.1:46282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33986 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 16:56:15,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:56:15,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33998 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:56:20,458 - lava_callback - INFO - Received callback for node 69e112172eed175ae971a68d INFO: 172.21.0.1:42008 - "POST /node/69e112172eed175ae971a68d HTTP/1.0" 202 Accepted 2026-04-16 16:56:20,465 - lava_callback - INFO - Starting async job submit for node 69e112172eed175ae971a68d 2026-04-16 16:56:20,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:56:20,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112172eed175ae971a68d HTTP/1.1" 200 None 2026-04-16 16:56:20,507 - lava_callback - DEBUG - Processing node 69e112172eed175ae971a68d: baseline-nfs-arm64 2026-04-16 16:56:21,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:56:21,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:56:21,137 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112172eed175ae971a68d/log.txt.gz 2026-04-16 16:56:21,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:56:21,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:56:21,702 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112172eed175ae971a68d/lava-logs.yaml 2026-04-16 16:56:21,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 16:56:21,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 16:56:21,999 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112172eed175ae971a68d/lava_callback.json.gz 2026-04-16 16:56:22,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:56:22,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112172eed175ae971a68d HTTP/1.1" 200 None 2026-04-16 16:56:22,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:56:22,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 16:56:22,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:56:22,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112172eed175ae971a68d HTTP/1.1" 200 None 2026-04-16 16:56:22,150 - lava_callback - INFO - Completed processing callback for node 69e112172eed175ae971a68d INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:56:29,609 - lava_callback - INFO - Received callback for node 69de71aff6535ffd5b3edc2a INFO: 172.21.0.1:42034 - "POST /node/69de71aff6535ffd5b3edc2a HTTP/1.0" 202 Accepted 2026-04-16 16:56:29,614 - lava_callback - INFO - Starting async job submit for node 69de71aff6535ffd5b3edc2a 2026-04-16 16:56:29,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:56:29,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de71aff6535ffd5b3edc2a HTTP/1.1" 200 None 2026-04-16 16:56:29,631 - lava_callback - DEBUG - Processing node 69de71aff6535ffd5b3edc2a: baseline-arm-clabbe 2026-04-16 16:56:29,631 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de71aff6535ffd5b3edc2a 2026-04-16 16:56:29,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:56:29,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de71aff6535ffd5b3edc2a HTTP/1.1" 200 None 2026-04-16 16:56:29,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:56:29,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680092cda61b443d5b587 HTTP/1.1" 200 None 2026-04-16 16:56:29,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:56:29,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de71aff6535ffd5b3edc2a HTTP/1.1" 200 None 2026-04-16 16:56:29,704 - lava_callback - ERROR - Error processing callback for node 69de71aff6535ffd5b3edc2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36454 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:56:45,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:56:45,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36812 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:57:09,584 - lava_callback - INFO - Received callback for node 69de71d6f6535ffd5b3edc3f INFO: 172.21.0.1:36822 - "POST /node/69de71d6f6535ffd5b3edc3f HTTP/1.0" 202 Accepted 2026-04-16 16:57:09,601 - lava_callback - INFO - Starting async job submit for node 69de71d6f6535ffd5b3edc3f 2026-04-16 16:57:09,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:57:09,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de71d6f6535ffd5b3edc3f HTTP/1.1" 200 None 2026-04-16 16:57:09,653 - lava_callback - DEBUG - Processing node 69de71d6f6535ffd5b3edc3f: baseline-arm-clabbe 2026-04-16 16:57:09,653 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de71d6f6535ffd5b3edc3f 2026-04-16 16:57:09,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:57:09,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de71d6f6535ffd5b3edc3f HTTP/1.1" 200 None 2026-04-16 16:57:09,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:57:09,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680092cda61b443d5b587 HTTP/1.1" 200 None 2026-04-16 16:57:09,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:57:09,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de71d6f6535ffd5b3edc3f HTTP/1.1" 200 None 2026-04-16 16:57:09,745 - lava_callback - ERROR - Error processing callback for node 69de71d6f6535ffd5b3edc3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52998 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:57:49,636 - lava_callback - INFO - Received callback for node 69de7200f6535ffd5b3edc64 INFO: 172.21.0.1:53012 - "POST /node/69de7200f6535ffd5b3edc64 HTTP/1.0" 202 Accepted 2026-04-16 16:57:49,641 - lava_callback - INFO - Starting async job submit for node 69de7200f6535ffd5b3edc64 2026-04-16 16:57:49,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:57:49,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7200f6535ffd5b3edc64 HTTP/1.1" 200 None 2026-04-16 16:57:49,658 - lava_callback - DEBUG - Processing node 69de7200f6535ffd5b3edc64: baseline-arm-clabbe 2026-04-16 16:57:49,658 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7200f6535ffd5b3edc64 2026-04-16 16:57:49,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:57:49,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7200f6535ffd5b3edc64 HTTP/1.1" 200 None 2026-04-16 16:57:49,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:57:49,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680092cda61b443d5b587 HTTP/1.1" 200 None 2026-04-16 16:57:49,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:57:49,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7200f6535ffd5b3edc64 HTTP/1.1" 200 None 2026-04-16 16:57:49,704 - lava_callback - ERROR - Error processing callback for node 69de7200f6535ffd5b3edc64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37570 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:58:26,063 - lava_callback - INFO - Received callback for node 69de721df6535ffd5b3edc8b INFO: 172.21.0.1:54282 - "POST /node/69de721df6535ffd5b3edc8b HTTP/1.0" 202 Accepted 2026-04-16 16:58:26,072 - lava_callback - INFO - Starting async job submit for node 69de721df6535ffd5b3edc8b 2026-04-16 16:58:26,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:58:26,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de721df6535ffd5b3edc8b HTTP/1.1" 200 None 2026-04-16 16:58:26,100 - lava_callback - DEBUG - Processing node 69de721df6535ffd5b3edc8b: baseline-arm-baylibre 2026-04-16 16:58:26,100 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de721df6535ffd5b3edc8b 2026-04-16 16:58:26,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:58:26,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de721df6535ffd5b3edc8b HTTP/1.1" 200 None 2026-04-16 16:58:26,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:58:26,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-16 16:58:26,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:58:26,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de721df6535ffd5b3edc8b HTTP/1.1" 200 None 2026-04-16 16:58:26,184 - lava_callback - ERROR - Error processing callback for node 69de721df6535ffd5b3edc8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:58:46,021 - lava_callback - INFO - Received callback for node 69de7241f6535ffd5b3edcac INFO: 172.21.0.1:54952 - "POST /node/69de7241f6535ffd5b3edcac HTTP/1.0" 202 Accepted 2026-04-16 16:58:46,026 - lava_callback - INFO - Starting async job submit for node 69de7241f6535ffd5b3edcac 2026-04-16 16:58:46,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:58:46,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7241f6535ffd5b3edcac HTTP/1.1" 200 None 2026-04-16 16:58:46,043 - lava_callback - DEBUG - Processing node 69de7241f6535ffd5b3edcac: baseline-arm-baylibre 2026-04-16 16:58:46,043 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7241f6535ffd5b3edcac 2026-04-16 16:58:46,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:58:46,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7241f6535ffd5b3edcac HTTP/1.1" 200 None 2026-04-16 16:58:46,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:58:46,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-16 16:58:46,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:58:46,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7241f6535ffd5b3edcac HTTP/1.1" 200 None 2026-04-16 16:58:46,092 - lava_callback - ERROR - Error processing callback for node 69de7241f6535ffd5b3edcac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34956 - "GET / HTTP/1.0" 200 OK 2026-04-16 16:59:26,061 - lava_callback - INFO - Received callback for node 69de7266f6535ffd5b3edcc8 INFO: 172.21.0.1:34976 - "POST /node/69de7266f6535ffd5b3edcc8 HTTP/1.0" 202 Accepted 2026-04-16 16:59:26,067 - lava_callback - INFO - Starting async job submit for node 69de7266f6535ffd5b3edcc8 2026-04-16 16:59:26,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:59:26,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7266f6535ffd5b3edcc8 HTTP/1.1" 200 None 2026-04-16 16:59:26,083 - lava_callback - DEBUG - Processing node 69de7266f6535ffd5b3edcc8: baseline-arm-baylibre 2026-04-16 16:59:26,083 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7266f6535ffd5b3edcc8 2026-04-16 16:59:26,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:59:26,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7266f6535ffd5b3edcc8 HTTP/1.1" 200 None 2026-04-16 16:59:26,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:59:26,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-16 16:59:26,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 16:59:26,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7266f6535ffd5b3edcc8 HTTP/1.1" 200 None 2026-04-16 16:59:26,151 - lava_callback - ERROR - Error processing callback for node 69de7266f6535ffd5b3edcc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:00:06,061 - lava_callback - INFO - Received callback for node 69de7284f6535ffd5b3edce1 INFO: 172.21.0.1:53882 - "POST /node/69de7284f6535ffd5b3edce1 HTTP/1.0" 202 Accepted 2026-04-16 17:00:06,068 - lava_callback - INFO - Starting async job submit for node 69de7284f6535ffd5b3edce1 2026-04-16 17:00:06,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:00:06,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7284f6535ffd5b3edce1 HTTP/1.1" 200 None 2026-04-16 17:00:06,103 - lava_callback - DEBUG - Processing node 69de7284f6535ffd5b3edce1: baseline-arm-baylibre 2026-04-16 17:00:06,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7284f6535ffd5b3edce1 2026-04-16 17:00:06,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:00:06,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7284f6535ffd5b3edce1 HTTP/1.1" 200 None 2026-04-16 17:00:06,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:00:06,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-16 17:00:06,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:00:06,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7284f6535ffd5b3edce1 HTTP/1.1" 200 None 2026-04-16 17:00:06,190 - lava_callback - ERROR - Error processing callback for node 69de7284f6535ffd5b3edce1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39350 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:00:49,817 - lava_callback - INFO - Received callback for node 69de72acf6535ffd5b3edd11 INFO: 172.21.0.1:36262 - "POST /node/69de72acf6535ffd5b3edd11 HTTP/1.0" 202 Accepted 2026-04-16 17:00:49,823 - lava_callback - INFO - Starting async job submit for node 69de72acf6535ffd5b3edd11 2026-04-16 17:00:49,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:00:49,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de72acf6535ffd5b3edd11 HTTP/1.1" 200 None 2026-04-16 17:00:49,839 - lava_callback - DEBUG - Processing node 69de72acf6535ffd5b3edd11: baseline-arm-clabbe 2026-04-16 17:00:49,839 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de72acf6535ffd5b3edd11 2026-04-16 17:00:49,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:00:49,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de72acf6535ffd5b3edd11 HTTP/1.1" 200 None 2026-04-16 17:00:49,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:00:49,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-16 17:00:49,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:00:49,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de72acf6535ffd5b3edd11 HTTP/1.1" 200 None 2026-04-16 17:00:49,887 - lava_callback - ERROR - Error processing callback for node 69de72acf6535ffd5b3edd11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39770 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:01:09,791 - lava_callback - INFO - Received callback for node 69de72d0f6535ffd5b3edd37 INFO: 172.21.0.1:59642 - "POST /node/69de72d0f6535ffd5b3edd37 HTTP/1.0" 202 Accepted 2026-04-16 17:01:09,797 - lava_callback - INFO - Starting async job submit for node 69de72d0f6535ffd5b3edd37 2026-04-16 17:01:09,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:01:09,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de72d0f6535ffd5b3edd37 HTTP/1.1" 200 None 2026-04-16 17:01:09,812 - lava_callback - DEBUG - Processing node 69de72d0f6535ffd5b3edd37: baseline-arm-clabbe 2026-04-16 17:01:09,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de72d0f6535ffd5b3edd37 2026-04-16 17:01:09,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:01:09,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de72d0f6535ffd5b3edd37 HTTP/1.1" 200 None 2026-04-16 17:01:09,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:01:09,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-16 17:01:09,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:01:09,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de72d0f6535ffd5b3edd37 HTTP/1.1" 200 None 2026-04-16 17:01:09,869 - lava_callback - ERROR - Error processing callback for node 69de72d0f6535ffd5b3edd37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57042 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:01:49,902 - lava_callback - INFO - Received callback for node 69de72f4f6535ffd5b3edd50 INFO: 172.21.0.1:53250 - "POST /node/69de72f4f6535ffd5b3edd50 HTTP/1.0" 202 Accepted 2026-04-16 17:01:49,907 - lava_callback - INFO - Starting async job submit for node 69de72f4f6535ffd5b3edd50 2026-04-16 17:01:49,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:01:49,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de72f4f6535ffd5b3edd50 HTTP/1.1" 200 None 2026-04-16 17:01:49,922 - lava_callback - DEBUG - Processing node 69de72f4f6535ffd5b3edd50: baseline-arm-clabbe 2026-04-16 17:01:49,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de72f4f6535ffd5b3edd50 2026-04-16 17:01:49,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:01:49,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de72f4f6535ffd5b3edd50 HTTP/1.1" 200 None 2026-04-16 17:01:49,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:01:49,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-16 17:01:49,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:01:49,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de72f4f6535ffd5b3edd50 HTTP/1.1" 200 None 2026-04-16 17:01:49,983 - lava_callback - ERROR - Error processing callback for node 69de72f4f6535ffd5b3edd50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:02:29,845 - lava_callback - INFO - Received callback for node 69de7316f6535ffd5b3edd6f INFO: 172.21.0.1:60082 - "POST /node/69de7316f6535ffd5b3edd6f HTTP/1.0" 202 Accepted 2026-04-16 17:02:29,850 - lava_callback - INFO - Starting async job submit for node 69de7316f6535ffd5b3edd6f 2026-04-16 17:02:29,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:02:29,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7316f6535ffd5b3edd6f HTTP/1.1" 200 None 2026-04-16 17:02:29,894 - lava_callback - DEBUG - Processing node 69de7316f6535ffd5b3edd6f: baseline-arm-clabbe 2026-04-16 17:02:29,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7316f6535ffd5b3edd6f 2026-04-16 17:02:29,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:02:29,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7316f6535ffd5b3edd6f HTTP/1.1" 200 None 2026-04-16 17:02:29,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:02:29,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-16 17:02:29,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:02:29,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7316f6535ffd5b3edd6f HTTP/1.1" 200 None 2026-04-16 17:02:29,975 - lava_callback - ERROR - Error processing callback for node 69de7316f6535ffd5b3edd6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:03:09,930 - lava_callback - INFO - Received callback for node 69de733af6535ffd5b3edd90 INFO: 172.21.0.1:55960 - "POST /node/69de733af6535ffd5b3edd90 HTTP/1.0" 202 Accepted 2026-04-16 17:03:09,936 - lava_callback - INFO - Starting async job submit for node 69de733af6535ffd5b3edd90 2026-04-16 17:03:09,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:03:09,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de733af6535ffd5b3edd90 HTTP/1.1" 200 None 2026-04-16 17:03:09,951 - lava_callback - DEBUG - Processing node 69de733af6535ffd5b3edd90: baseline-arm-clabbe 2026-04-16 17:03:09,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de733af6535ffd5b3edd90 2026-04-16 17:03:09,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:03:09,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de733af6535ffd5b3edd90 HTTP/1.1" 200 None 2026-04-16 17:03:09,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:03:09,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-16 17:03:09,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:03:09,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de733af6535ffd5b3edd90 HTTP/1.1" 200 None 2026-04-16 17:03:10,000 - lava_callback - ERROR - Error processing callback for node 69de733af6535ffd5b3edd90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41876 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:03:29,907 - lava_callback - INFO - Received callback for node 69de735af6535ffd5b3edda6 INFO: 172.21.0.1:59802 - "POST /node/69de735af6535ffd5b3edda6 HTTP/1.0" 202 Accepted 2026-04-16 17:03:29,912 - lava_callback - INFO - Starting async job submit for node 69de735af6535ffd5b3edda6 2026-04-16 17:03:29,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:03:29,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de735af6535ffd5b3edda6 HTTP/1.1" 200 None 2026-04-16 17:03:29,928 - lava_callback - DEBUG - Processing node 69de735af6535ffd5b3edda6: baseline-arm-clabbe 2026-04-16 17:03:29,928 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de735af6535ffd5b3edda6 2026-04-16 17:03:29,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:03:29,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de735af6535ffd5b3edda6 HTTP/1.1" 200 None 2026-04-16 17:03:29,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:03:29,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-16 17:03:29,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:03:29,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de735af6535ffd5b3edda6 HTTP/1.1" 200 None 2026-04-16 17:03:29,979 - lava_callback - ERROR - Error processing callback for node 69de735af6535ffd5b3edda6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40386 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:04:09,968 - lava_callback - INFO - Received callback for node 69de737cf6535ffd5b3eddef INFO: 172.21.0.1:38870 - "POST /node/69de737cf6535ffd5b3eddef HTTP/1.0" 202 Accepted 2026-04-16 17:04:09,974 - lava_callback - INFO - Starting async job submit for node 69de737cf6535ffd5b3eddef 2026-04-16 17:04:09,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:04:09,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de737cf6535ffd5b3eddef HTTP/1.1" 200 None 2026-04-16 17:04:09,992 - lava_callback - DEBUG - Processing node 69de737cf6535ffd5b3eddef: baseline-arm-clabbe 2026-04-16 17:04:09,992 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de737cf6535ffd5b3eddef 2026-04-16 17:04:09,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:04:10,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de737cf6535ffd5b3eddef HTTP/1.1" 200 None 2026-04-16 17:04:10,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:04:10,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-16 17:04:10,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:04:10,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de737cf6535ffd5b3eddef HTTP/1.1" 200 None 2026-04-16 17:04:10,054 - lava_callback - ERROR - Error processing callback for node 69de737cf6535ffd5b3eddef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34102 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:04:48,329 - lava_callback - INFO - Received callback for node 69e116a12eed175ae971aa35 INFO: 172.21.0.1:34112 - "POST /node/69e116a12eed175ae971aa35 HTTP/1.0" 202 Accepted 2026-04-16 17:04:48,335 - lava_callback - INFO - Starting async job submit for node 69e116a12eed175ae971aa35 2026-04-16 17:04:48,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:04:48,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e116a12eed175ae971aa35 HTTP/1.1" 200 None 2026-04-16 17:04:48,352 - lava_callback - DEBUG - Processing node 69e116a12eed175ae971aa35: baseline-nfs-arm64 2026-04-16 17:04:48,353 - lava_callback - WARNING - Failed to upload log 2026-04-16 17:04:48,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:04:48,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:04:48,493 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e116a12eed175ae971aa35/lava-logs.yaml 2026-04-16 17:04:48,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:04:48,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:04:48,624 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e116a12eed175ae971aa35/lava_callback.json.gz 2026-04-16 17:04:48,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:04:48,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e116a12eed175ae971aa35 HTTP/1.1" 200 None 2026-04-16 17:04:48,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:04:48,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:04:48,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:04:48,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e116a12eed175ae971aa35 HTTP/1.1" 200 None 2026-04-16 17:04:48,677 - lava_callback - INFO - Completed processing callback for node 69e116a12eed175ae971aa35 2026-04-16 17:04:49,971 - lava_callback - INFO - Received callback for node 69de73a1f6535ffd5b3ede05 INFO: 172.21.0.1:51070 - "POST /node/69de73a1f6535ffd5b3ede05 HTTP/1.0" 202 Accepted 2026-04-16 17:04:49,977 - lava_callback - INFO - Starting async job submit for node 69de73a1f6535ffd5b3ede05 2026-04-16 17:04:49,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:04:49,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de73a1f6535ffd5b3ede05 HTTP/1.1" 200 None 2026-04-16 17:04:49,998 - lava_callback - DEBUG - Processing node 69de73a1f6535ffd5b3ede05: baseline-arm-clabbe 2026-04-16 17:04:49,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de73a1f6535ffd5b3ede05 2026-04-16 17:04:49,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:04:50,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de73a1f6535ffd5b3ede05 HTTP/1.1" 200 None 2026-04-16 17:04:50,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:04:50,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-16 17:04:50,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:04:50,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de73a1f6535ffd5b3ede05 HTTP/1.1" 200 None 2026-04-16 17:04:50,054 - lava_callback - ERROR - Error processing callback for node 69de73a1f6535ffd5b3ede05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60582 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:05:09,964 - lava_callback - INFO - Received callback for node 69de73c3f6535ffd5b3ede1d INFO: 172.21.0.1:33772 - "POST /node/69de73c3f6535ffd5b3ede1d HTTP/1.0" 202 Accepted 2026-04-16 17:05:09,971 - lava_callback - INFO - Starting async job submit for node 69de73c3f6535ffd5b3ede1d 2026-04-16 17:05:09,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:05:09,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de73c3f6535ffd5b3ede1d HTTP/1.1" 200 None 2026-04-16 17:05:09,991 - lava_callback - DEBUG - Processing node 69de73c3f6535ffd5b3ede1d: baseline-arm-clabbe 2026-04-16 17:05:09,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de73c3f6535ffd5b3ede1d 2026-04-16 17:05:09,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:05:10,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de73c3f6535ffd5b3ede1d HTTP/1.1" 200 None 2026-04-16 17:05:10,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:05:10,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d922f457c4e70f68e6a1ae HTTP/1.1" 200 None 2026-04-16 17:05:10,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:05:10,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de73c3f6535ffd5b3ede1d HTTP/1.1" 200 None 2026-04-16 17:05:10,058 - lava_callback - ERROR - Error processing callback for node 69de73c3f6535ffd5b3ede1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33788 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 17:05:15,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:05:15,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49958 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:05:32,379 - lava_callback - INFO - Received callback for node 69e112112eed175ae971a67e INFO: 172.21.0.1:60772 - "POST /node/69e112112eed175ae971a67e HTTP/1.0" 202 Accepted 2026-04-16 17:05:32,388 - lava_callback - INFO - Starting async job submit for node 69e112112eed175ae971a67e 2026-04-16 17:05:32,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:05:32,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112112eed175ae971a67e HTTP/1.1" 200 None 2026-04-16 17:05:32,448 - lava_callback - DEBUG - Processing node 69e112112eed175ae971a67e: baseline-nfs-arm64 2026-04-16 17:05:33,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:05:33,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:05:33,814 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112112eed175ae971a67e/log.txt.gz 2026-04-16 17:05:34,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:05:34,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:05:34,700 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112112eed175ae971a67e/lava-logs.yaml 2026-04-16 17:05:34,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:05:34,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:05:34,888 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e112112eed175ae971a67e/lava_callback.json.gz DEBUG: Setup failed for 69e112112eed175ae971a67e. Transitting job node result: incomplete -> fail 2026-04-16 17:05:34,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:05:34,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112112eed175ae971a67e HTTP/1.1" 200 None 2026-04-16 17:05:34,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:05:35,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:05:35,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:05:35,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112112eed175ae971a67e HTTP/1.1" 200 None 2026-04-16 17:05:35,124 - lava_callback - INFO - Completed processing callback for node 69e112112eed175ae971a67e INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49122 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:05:45,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:05:45,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35512 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:06:10,060 - lava_callback - INFO - Received callback for node 69de73f4f6535ffd5b3ede35 INFO: 172.21.0.1:45978 - "POST /node/69de73f4f6535ffd5b3ede35 HTTP/1.0" 202 Accepted 2026-04-16 17:06:10,066 - lava_callback - INFO - Starting async job submit for node 69de73f4f6535ffd5b3ede35 2026-04-16 17:06:10,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:06:10,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de73f4f6535ffd5b3ede35 HTTP/1.1" 200 None 2026-04-16 17:06:10,082 - lava_callback - DEBUG - Processing node 69de73f4f6535ffd5b3ede35: baseline-arm-clabbe 2026-04-16 17:06:10,082 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de73f4f6535ffd5b3ede35 2026-04-16 17:06:10,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:06:10,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de73f4f6535ffd5b3ede35 HTTP/1.1" 200 None 2026-04-16 17:06:10,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:06:10,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680092cda61b443d5b587 HTTP/1.1" 200 None 2026-04-16 17:06:10,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:06:10,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de73f4f6535ffd5b3ede35 HTTP/1.1" 200 None 2026-04-16 17:06:10,135 - lava_callback - ERROR - Error processing callback for node 69de73f4f6535ffd5b3ede35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58102 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:07:50,093 - lava_callback - INFO - Received callback for node 69de7458f6535ffd5b3ede4a INFO: 172.21.0.1:54226 - "POST /node/69de7458f6535ffd5b3ede4a HTTP/1.0" 202 Accepted 2026-04-16 17:07:50,098 - lava_callback - INFO - Starting async job submit for node 69de7458f6535ffd5b3ede4a 2026-04-16 17:07:50,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:07:50,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7458f6535ffd5b3ede4a HTTP/1.1" 200 None 2026-04-16 17:07:50,117 - lava_callback - DEBUG - Processing node 69de7458f6535ffd5b3ede4a: baseline-arm-clabbe 2026-04-16 17:07:50,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7458f6535ffd5b3ede4a 2026-04-16 17:07:50,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:07:50,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7458f6535ffd5b3ede4a HTTP/1.1" 200 None 2026-04-16 17:07:50,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:07:50,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680092cda61b443d5b587 HTTP/1.1" 200 None 2026-04-16 17:07:50,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:07:50,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7458f6535ffd5b3ede4a HTTP/1.1" 200 None 2026-04-16 17:07:50,165 - lava_callback - ERROR - Error processing callback for node 69de7458f6535ffd5b3ede4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58672 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:08:50,183 - lava_callback - INFO - Received callback for node 69de7494f6535ffd5b3ede67 INFO: 172.21.0.1:43514 - "POST /node/69de7494f6535ffd5b3ede67 HTTP/1.0" 202 Accepted 2026-04-16 17:08:50,189 - lava_callback - INFO - Starting async job submit for node 69de7494f6535ffd5b3ede67 2026-04-16 17:08:50,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:08:50,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7494f6535ffd5b3ede67 HTTP/1.1" 200 None 2026-04-16 17:08:50,206 - lava_callback - DEBUG - Processing node 69de7494f6535ffd5b3ede67: baseline-arm-clabbe 2026-04-16 17:08:50,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7494f6535ffd5b3ede67 2026-04-16 17:08:50,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:08:50,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7494f6535ffd5b3ede67 HTTP/1.1" 200 None 2026-04-16 17:08:50,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:08:50,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680092cda61b443d5b587 HTTP/1.1" 200 None 2026-04-16 17:08:50,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:08:50,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7494f6535ffd5b3ede67 HTTP/1.1" 200 None 2026-04-16 17:08:50,258 - lava_callback - ERROR - Error processing callback for node 69de7494f6535ffd5b3ede67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43900 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:09:37,613 - lava_callback - INFO - Received callback for node 69e1178f2eed175ae971b04f INFO: 172.21.0.1:43914 - "POST /node/69e1178f2eed175ae971b04f HTTP/1.0" 202 Accepted 2026-04-16 17:09:37,624 - lava_callback - INFO - Starting async job submit for node 69e1178f2eed175ae971b04f 2026-04-16 17:09:37,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:09:37,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1178f2eed175ae971b04f HTTP/1.1" 200 None 2026-04-16 17:09:37,694 - lava_callback - DEBUG - Processing node 69e1178f2eed175ae971b04f: baseline-arm64 2026-04-16 17:09:37,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:09:38,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:09:38,010 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e1178f2eed175ae971b04f/log.txt.gz 2026-04-16 17:09:38,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:09:38,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:09:38,267 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e1178f2eed175ae971b04f/lava-logs.yaml 2026-04-16 17:09:38,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:09:38,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:09:38,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e1178f2eed175ae971b04f/lava_callback.json.gz 2026-04-16 17:09:38,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:09:38,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1178f2eed175ae971b04f HTTP/1.1" 200 None 2026-04-16 17:09:38,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:09:38,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:09:38,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:09:38,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1178f2eed175ae971b04f HTTP/1.1" 200 None 2026-04-16 17:09:38,493 - lava_callback - INFO - Completed processing callback for node 69e1178f2eed175ae971b04f INFO: 172.21.0.1:33252 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:09:45,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:09:45,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42198 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:11:02,665 - lava_callback - INFO - Received callback for node 69e117e02eed175ae971b074 INFO: 172.21.0.1:39362 - "POST /node/69e117e02eed175ae971b074 HTTP/1.0" 202 Accepted 2026-04-16 17:11:02,672 - lava_callback - INFO - Starting async job submit for node 69e117e02eed175ae971b074 2026-04-16 17:11:02,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:11:02,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e117e02eed175ae971b074 HTTP/1.1" 200 None 2026-04-16 17:11:02,721 - lava_callback - DEBUG - Processing node 69e117e02eed175ae971b074: baseline-arm64 2026-04-16 17:11:02,919 - lava_callback - WARNING - Failed to upload log 2026-04-16 17:11:02,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:11:03,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:11:03,143 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e117e02eed175ae971b074/lava-logs.yaml 2026-04-16 17:11:03,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:11:03,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:11:03,244 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e117e02eed175ae971b074/lava_callback.json.gz 2026-04-16 17:11:03,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:11:03,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e117e02eed175ae971b074 HTTP/1.1" 200 None 2026-04-16 17:11:03,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:11:03,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:11:03,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:11:03,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e117e02eed175ae971b074 HTTP/1.1" 200 None 2026-04-16 17:11:03,406 - lava_callback - INFO - Completed processing callback for node 69e117e02eed175ae971b074 INFO: 172.21.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43102 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 17:11:15,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:11:15,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53058 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:11:45,645 - lava_callback - INFO - Received callback for node 69e118322eed175ae971b096 INFO: 172.21.0.1:53066 - "POST /node/69e118322eed175ae971b096 HTTP/1.0" 202 Accepted 2026-04-16 17:11:45,651 - lava_callback - INFO - Starting async job submit for node 69e118322eed175ae971b096 2026-04-16 17:11:45,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:11:45,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e118322eed175ae971b096 HTTP/1.1" 200 None 2026-04-16 17:11:45,687 - lava_callback - DEBUG - Processing node 69e118322eed175ae971b096: baseline-x86 2026-04-16 17:11:45,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:11:45,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:11:45,961 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e118322eed175ae971b096/log.txt.gz 2026-04-16 17:11:46,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:11:46,190 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:11:46,192 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e118322eed175ae971b096/lava-logs.yaml 2026-04-16 17:11:46,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:11:46,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:11:46,300 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e118322eed175ae971b096/lava_callback.json.gz 2026-04-16 17:11:46,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:11:46,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e118322eed175ae971b096 HTTP/1.1" 200 None 2026-04-16 17:11:46,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:11:46,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10be52eed175ae971a5b3 HTTP/1.1" 200 None 2026-04-16 17:11:46,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:11:46,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e118322eed175ae971b096 HTTP/1.1" 200 None 2026-04-16 17:11:46,372 - lava_callback - INFO - Completed processing callback for node 69e118322eed175ae971b096 INFO: 172.21.0.1:53068 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:11:46,556 - lava_callback - INFO - Received callback for node 69e118352eed175ae971b0a6 INFO: 172.21.0.1:53070 - "POST /node/69e118352eed175ae971b0a6 HTTP/1.0" 202 Accepted 2026-04-16 17:11:46,563 - lava_callback - INFO - Starting async job submit for node 69e118352eed175ae971b0a6 2026-04-16 17:11:46,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:11:46,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e118352eed175ae971b0a6 HTTP/1.1" 200 None 2026-04-16 17:11:46,598 - lava_callback - DEBUG - Processing node 69e118352eed175ae971b0a6: baseline-x86 2026-04-16 17:11:46,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:11:46,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:11:46,845 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e118352eed175ae971b0a6/log.txt.gz 2026-04-16 17:11:46,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:11:47,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:11:47,067 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e118352eed175ae971b0a6/lava-logs.yaml 2026-04-16 17:11:47,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:11:47,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:11:47,158 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e118352eed175ae971b0a6/lava_callback.json.gz 2026-04-16 17:11:47,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:11:47,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e118352eed175ae971b0a6 HTTP/1.1" 200 None 2026-04-16 17:11:47,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:11:47,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10be52eed175ae971a5b3 HTTP/1.1" 200 None 2026-04-16 17:11:47,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:11:47,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e118352eed175ae971b0a6 HTTP/1.1" 200 None 2026-04-16 17:11:47,229 - lava_callback - INFO - Completed processing callback for node 69e118352eed175ae971b0a6 INFO: 172.21.0.1:41246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47288 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 17:12:15,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:12:15,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:12:35,798 - lava_callback - INFO - Received callback for node 69e118332eed175ae971b09f INFO: 172.21.0.1:58514 - "POST /node/69e118332eed175ae971b09f HTTP/1.0" 202 Accepted 2026-04-16 17:12:35,805 - lava_callback - INFO - Starting async job submit for node 69e118332eed175ae971b09f 2026-04-16 17:12:35,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:12:35,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e118332eed175ae971b09f HTTP/1.1" 200 None 2026-04-16 17:12:35,847 - lava_callback - DEBUG - Processing node 69e118332eed175ae971b09f: baseline-x86 2026-04-16 17:12:36,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:12:36,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:12:36,335 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e118332eed175ae971b09f/log.txt.gz 2026-04-16 17:12:36,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58516 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:12:36,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:12:36,704 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e118332eed175ae971b09f/lava-logs.yaml 2026-04-16 17:12:36,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:12:36,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:12:36,823 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e118332eed175ae971b09f/lava_callback.json.gz 2026-04-16 17:12:36,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:12:36,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e118332eed175ae971b09f HTTP/1.1" 200 None 2026-04-16 17:12:36,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:12:36,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10be52eed175ae971a5b3 HTTP/1.1" 200 None 2026-04-16 17:12:36,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:12:36,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e118332eed175ae971b09f HTTP/1.1" 200 None 2026-04-16 17:12:36,921 - lava_callback - INFO - Completed processing callback for node 69e118332eed175ae971b09f INFO: 172.21.0.1:42144 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:12:45,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:12:45,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48306 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:13:02,409 - lava_callback - INFO - Received callback for node 69e117422eed175ae971b030 INFO: 172.21.0.1:53606 - "POST /node/69e117422eed175ae971b030 HTTP/1.0" 202 Accepted 2026-04-16 17:13:02,417 - lava_callback - INFO - Starting async job submit for node 69e117422eed175ae971b030 2026-04-16 17:13:02,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:13:02,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e117422eed175ae971b030 HTTP/1.1" 200 None 2026-04-16 17:13:02,468 - lava_callback - DEBUG - Processing node 69e117422eed175ae971b030: baseline-arm64 2026-04-16 17:13:02,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:13:02,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:13:02,976 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e117422eed175ae971b030/log.txt.gz 2026-04-16 17:13:03,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:13:03,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:13:03,444 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e117422eed175ae971b030/lava-logs.yaml 2026-04-16 17:13:03,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:13:03,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:13:03,587 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e117422eed175ae971b030/lava_callback.json.gz DEBUG: Setup failed for 69e117422eed175ae971b030. Transitting job node result: incomplete -> fail 2026-04-16 17:13:03,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:13:03,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e117422eed175ae971b030 HTTP/1.1" 200 None 2026-04-16 17:13:03,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:13:03,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:13:03,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:13:03,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e117422eed175ae971b030 HTTP/1.1" 200 None 2026-04-16 17:13:03,823 - lava_callback - INFO - Completed processing callback for node 69e117422eed175ae971b030 2026-04-16 17:13:04,972 - lava_callback - INFO - Received callback for node 69e118362eed175ae971b0a9 INFO: 172.21.0.1:53622 - "POST /node/69e118362eed175ae971b0a9 HTTP/1.0" 202 Accepted 2026-04-16 17:13:04,978 - lava_callback - INFO - Starting async job submit for node 69e118362eed175ae971b0a9 2026-04-16 17:13:04,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:13:05,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e118362eed175ae971b0a9 HTTP/1.1" 200 None 2026-04-16 17:13:05,011 - lava_callback - DEBUG - Processing node 69e118362eed175ae971b0a9: baseline-x86 2026-04-16 17:13:05,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:13:05,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:13:05,419 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e118362eed175ae971b0a9/log.txt.gz 2026-04-16 17:13:05,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:13:05,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:13:05,713 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e118362eed175ae971b0a9/lava-logs.yaml 2026-04-16 17:13:05,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:13:05,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:13:05,812 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e118362eed175ae971b0a9/lava_callback.json.gz 2026-04-16 17:13:05,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:13:05,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e118362eed175ae971b0a9 HTTP/1.1" 200 None 2026-04-16 17:13:05,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:13:05,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10be52eed175ae971a5b3 HTTP/1.1" 200 None 2026-04-16 17:13:05,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:13:05,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e118362eed175ae971b0a9 HTTP/1.1" 200 None 2026-04-16 17:13:05,890 - lava_callback - INFO - Completed processing callback for node 69e118362eed175ae971b0a9 INFO: 172.21.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 17:13:15,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:13:15,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:14:27,117 - lava_callback - INFO - Received callback for node 69de75eff6535ffd5b3edee1 INFO: 172.21.0.1:55340 - "POST /node/69de75eff6535ffd5b3edee1 HTTP/1.0" 202 Accepted 2026-04-16 17:14:27,126 - lava_callback - INFO - Starting async job submit for node 69de75eff6535ffd5b3edee1 2026-04-16 17:14:27,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:14:27,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de75eff6535ffd5b3edee1 HTTP/1.1" 200 None 2026-04-16 17:14:27,143 - lava_callback - DEBUG - Processing node 69de75eff6535ffd5b3edee1: baseline-arm64-baylibre 2026-04-16 17:14:27,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de75eff6535ffd5b3edee1 2026-04-16 17:14:27,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:14:27,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de75eff6535ffd5b3edee1 HTTP/1.1" 200 None 2026-04-16 17:14:27,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:14:27,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-16 17:14:27,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:14:27,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de75eff6535ffd5b3edee1 HTTP/1.1" 200 None 2026-04-16 17:14:27,213 - lava_callback - ERROR - Error processing callback for node 69de75eff6535ffd5b3edee1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:15:46,988 - lava_callback - INFO - Received callback for node 69de763bf6535ffd5b3edf2c INFO: 172.21.0.1:45942 - "POST /node/69de763bf6535ffd5b3edf2c HTTP/1.0" 202 Accepted 2026-04-16 17:15:46,994 - lava_callback - INFO - Starting async job submit for node 69de763bf6535ffd5b3edf2c 2026-04-16 17:15:46,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:15:47,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de763bf6535ffd5b3edf2c HTTP/1.1" 200 None 2026-04-16 17:15:47,010 - lava_callback - DEBUG - Processing node 69de763bf6535ffd5b3edf2c: baseline-arm64-baylibre 2026-04-16 17:15:47,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de763bf6535ffd5b3edf2c 2026-04-16 17:15:47,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:15:47,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de763bf6535ffd5b3edf2c HTTP/1.1" 200 None 2026-04-16 17:15:47,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:15:47,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-16 17:15:47,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:15:47,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de763bf6535ffd5b3edf2c HTTP/1.1" 200 None 2026-04-16 17:15:47,058 - lava_callback - ERROR - Error processing callback for node 69de763bf6535ffd5b3edf2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 17:16:16,372 - lava_callback - INFO - Received callback for node 69e1122d2eed175ae971a6e7 INFO: 172.21.0.1:58514 - "POST /node/69e1122d2eed175ae971a6e7 HTTP/1.0" 202 Accepted 2026-04-16 17:16:16,378 - lava_callback - INFO - Starting async job submit for node 69e1122d2eed175ae971a6e7 2026-04-16 17:16:16,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:16:16,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1122d2eed175ae971a6e7 HTTP/1.1" 200 None 2026-04-16 17:16:16,416 - lava_callback - DEBUG - Processing node 69e1122d2eed175ae971a6e7: baseline-arm64-broonie INFO: 172.21.0.1:58524 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:16:16,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:16:16,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:16:16,805 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e1122d2eed175ae971a6e7/log.txt.gz 2026-04-16 17:16:17,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:16:17,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:16:17,169 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e1122d2eed175ae971a6e7/lava-logs.yaml 2026-04-16 17:16:17,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:16:17,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:16:17,282 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e1122d2eed175ae971a6e7/lava_callback.json.gz 2026-04-16 17:16:17,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:16:17,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1122d2eed175ae971a6e7 HTTP/1.1" 200 None 2026-04-16 17:16:17,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:16:17,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:16:17,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:16:17,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1122d2eed175ae971a6e7 HTTP/1.1" 200 None 2026-04-16 17:16:17,376 - lava_callback - INFO - Completed processing callback for node 69e1122d2eed175ae971a6e7 INFO: 172.21.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:16:45,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:16:45,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39254 - "GET /node/698ef1c3f0e3ffbba67d2b8c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:17:07,067 - lava_callback - INFO - Received callback for node 69de768af6535ffd5b3edf72 INFO: 172.21.0.1:54382 - "POST /node/69de768af6535ffd5b3edf72 HTTP/1.0" 202 Accepted 2026-04-16 17:17:07,073 - lava_callback - INFO - Starting async job submit for node 69de768af6535ffd5b3edf72 2026-04-16 17:17:07,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:17:07,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de768af6535ffd5b3edf72 HTTP/1.1" 200 None 2026-04-16 17:17:07,091 - lava_callback - DEBUG - Processing node 69de768af6535ffd5b3edf72: baseline-arm64-baylibre 2026-04-16 17:17:07,091 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de768af6535ffd5b3edf72 2026-04-16 17:17:07,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:17:07,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de768af6535ffd5b3edf72 HTTP/1.1" 200 None 2026-04-16 17:17:07,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:17:07,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-16 17:17:07,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:17:07,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de768af6535ffd5b3edf72 HTTP/1.1" 200 None 2026-04-16 17:17:07,148 - lava_callback - ERROR - Error processing callback for node 69de768af6535ffd5b3edf72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35436 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:17:37,368 - lava_callback - INFO - Received callback for node 69e114e42eed175ae971a97e INFO: 172.21.0.1:35438 - "POST /node/69e114e42eed175ae971a97e HTTP/1.0" 202 Accepted 2026-04-16 17:17:37,379 - lava_callback - INFO - Starting async job submit for node 69e114e42eed175ae971a97e 2026-04-16 17:17:37,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:17:37,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e114e42eed175ae971a97e HTTP/1.1" 200 None 2026-04-16 17:17:37,441 - lava_callback - DEBUG - Processing node 69e114e42eed175ae971a97e: baseline-arm64 2026-04-16 17:17:37,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:17:38,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:17:38,103 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e114e42eed175ae971a97e/log.txt.gz 2026-04-16 17:17:38,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:17:38,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:17:38,703 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e114e42eed175ae971a97e/lava-logs.yaml 2026-04-16 17:17:38,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:17:38,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:17:38,856 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e114e42eed175ae971a97e/lava_callback.json.gz DEBUG: Setup failed for 69e114e42eed175ae971a97e. Transitting job node result: incomplete -> fail 2026-04-16 17:17:38,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:17:38,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e114e42eed175ae971a97e HTTP/1.1" 200 None 2026-04-16 17:17:38,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:17:38,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:17:38,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:17:39,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e114e42eed175ae971a97e HTTP/1.1" 200 None 2026-04-16 17:17:39,076 - lava_callback - INFO - Completed processing callback for node 69e114e42eed175ae971a97e INFO: 172.21.0.1:57038 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:17:45,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:17:45,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42898 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:18:27,153 - lava_callback - INFO - Received callback for node 69de76d3f6535ffd5b3edfb5 INFO: 172.21.0.1:42900 - "POST /node/69de76d3f6535ffd5b3edfb5 HTTP/1.0" 202 Accepted 2026-04-16 17:18:27,159 - lava_callback - INFO - Starting async job submit for node 69de76d3f6535ffd5b3edfb5 2026-04-16 17:18:27,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:18:27,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de76d3f6535ffd5b3edfb5 HTTP/1.1" 200 None 2026-04-16 17:18:27,179 - lava_callback - DEBUG - Processing node 69de76d3f6535ffd5b3edfb5: baseline-arm64-baylibre 2026-04-16 17:18:27,179 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de76d3f6535ffd5b3edfb5 2026-04-16 17:18:27,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:18:27,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de76d3f6535ffd5b3edfb5 HTTP/1.1" 200 None 2026-04-16 17:18:27,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:18:27,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-16 17:18:27,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:18:27,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de76d3f6535ffd5b3edfb5 HTTP/1.1" 200 None 2026-04-16 17:18:27,235 - lava_callback - ERROR - Error processing callback for node 69de76d3f6535ffd5b3edfb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55548 - "GET /node/699c161322d3e3c838d85d39%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55558 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:19:47,213 - lava_callback - INFO - Received callback for node 69de7720f6535ffd5b3ee001 INFO: 172.21.0.1:55574 - "POST /node/69de7720f6535ffd5b3ee001 HTTP/1.0" 202 Accepted 2026-04-16 17:19:47,219 - lava_callback - INFO - Starting async job submit for node 69de7720f6535ffd5b3ee001 2026-04-16 17:19:47,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:19:47,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7720f6535ffd5b3ee001 HTTP/1.1" 200 None 2026-04-16 17:19:47,234 - lava_callback - DEBUG - Processing node 69de7720f6535ffd5b3ee001: baseline-arm64-baylibre 2026-04-16 17:19:47,235 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7720f6535ffd5b3ee001 2026-04-16 17:19:47,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:19:47,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7720f6535ffd5b3ee001 HTTP/1.1" 200 None 2026-04-16 17:19:47,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:19:47,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-16 17:19:47,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:19:47,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7720f6535ffd5b3ee001 HTTP/1.1" 200 None 2026-04-16 17:19:47,291 - lava_callback - ERROR - Error processing callback for node 69de7720f6535ffd5b3ee001: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32874 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:20:47,213 - lava_callback - INFO - Received callback for node 69de7769f6535ffd5b3ee047 INFO: 172.21.0.1:32884 - "POST /node/69de7769f6535ffd5b3ee047 HTTP/1.0" 202 Accepted 2026-04-16 17:20:47,218 - lava_callback - INFO - Starting async job submit for node 69de7769f6535ffd5b3ee047 2026-04-16 17:20:47,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:20:47,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7769f6535ffd5b3ee047 HTTP/1.1" 200 None 2026-04-16 17:20:47,235 - lava_callback - DEBUG - Processing node 69de7769f6535ffd5b3ee047: baseline-arm64-baylibre 2026-04-16 17:20:47,235 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7769f6535ffd5b3ee047 2026-04-16 17:20:47,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:20:47,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7769f6535ffd5b3ee047 HTTP/1.1" 200 None 2026-04-16 17:20:47,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:20:47,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-16 17:20:47,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:20:47,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7769f6535ffd5b3ee047 HTTP/1.1" 200 None 2026-04-16 17:20:47,296 - lava_callback - ERROR - Error processing callback for node 69de7769f6535ffd5b3ee047: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58652 - "GET /node/6990411b985e4efca431f139%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39132 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:21:52,435 - lava_callback - INFO - Received callback for node 69e118362eed175ae971b0ab INFO: 172.21.0.1:49940 - "POST /node/69e118362eed175ae971b0ab HTTP/1.0" 202 Accepted 2026-04-16 17:21:52,442 - lava_callback - INFO - Starting async job submit for node 69e118362eed175ae971b0ab 2026-04-16 17:21:52,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:21:52,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e118362eed175ae971b0ab HTTP/1.1" 200 None 2026-04-16 17:21:52,483 - lava_callback - DEBUG - Processing node 69e118362eed175ae971b0ab: baseline-arm64 2026-04-16 17:21:53,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:21:53,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:21:53,148 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e118362eed175ae971b0ab/log.txt.gz 2026-04-16 17:21:53,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:21:53,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:21:53,668 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e118362eed175ae971b0ab/lava-logs.yaml 2026-04-16 17:21:53,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:21:53,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:21:53,963 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e118362eed175ae971b0ab/lava_callback.json.gz 2026-04-16 17:21:53,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:21:54,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e118362eed175ae971b0ab HTTP/1.1" 200 None 2026-04-16 17:21:54,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:21:54,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:21:54,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:21:54,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e118362eed175ae971b0ab HTTP/1.1" 200 None 2026-04-16 17:21:54,091 - lava_callback - INFO - Completed processing callback for node 69e118362eed175ae971b0ab INFO: 172.21.0.1:49946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53248 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:22:07,326 - lava_callback - INFO - Received callback for node 69de77b2f6535ffd5b3ee08c INFO: 172.21.0.1:53264 - "POST /node/69de77b2f6535ffd5b3ee08c HTTP/1.0" 202 Accepted 2026-04-16 17:22:07,331 - lava_callback - INFO - Starting async job submit for node 69de77b2f6535ffd5b3ee08c 2026-04-16 17:22:07,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:22:07,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de77b2f6535ffd5b3ee08c HTTP/1.1" 200 None 2026-04-16 17:22:07,348 - lava_callback - DEBUG - Processing node 69de77b2f6535ffd5b3ee08c: baseline-arm64-baylibre 2026-04-16 17:22:07,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de77b2f6535ffd5b3ee08c 2026-04-16 17:22:07,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:22:07,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de77b2f6535ffd5b3ee08c HTTP/1.1" 200 None 2026-04-16 17:22:07,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:22:07,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-16 17:22:07,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:22:07,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de77b2f6535ffd5b3ee08c HTTP/1.1" 200 None 2026-04-16 17:22:07,396 - lava_callback - ERROR - Error processing callback for node 69de77b2f6535ffd5b3ee08c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41704 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 17:22:15,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:22:15,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53760 - "GET /node/6940ffb1460bc8e265116611%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55520 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:23:07,365 - lava_callback - INFO - Received callback for node 69de77f9f6535ffd5b3ee0e7 INFO: 172.21.0.1:55532 - "POST /node/69de77f9f6535ffd5b3ee0e7 HTTP/1.0" 202 Accepted 2026-04-16 17:23:07,371 - lava_callback - INFO - Starting async job submit for node 69de77f9f6535ffd5b3ee0e7 2026-04-16 17:23:07,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:23:07,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de77f9f6535ffd5b3ee0e7 HTTP/1.1" 200 None 2026-04-16 17:23:07,387 - lava_callback - DEBUG - Processing node 69de77f9f6535ffd5b3ee0e7: baseline-arm64-baylibre 2026-04-16 17:23:07,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de77f9f6535ffd5b3ee0e7 2026-04-16 17:23:07,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:23:07,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de77f9f6535ffd5b3ee0e7 HTTP/1.1" 200 None 2026-04-16 17:23:07,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:23:07,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-16 17:23:07,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:23:07,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de77f9f6535ffd5b3ee0e7 HTTP/1.1" 200 None 2026-04-16 17:23:07,436 - lava_callback - ERROR - Error processing callback for node 69de77f9f6535ffd5b3ee0e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52362 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:23:44,972 - lava_callback - INFO - Received callback for node 69e1188d2eed175ae971b0ee INFO: 172.21.0.1:52376 - "POST /node/69e1188d2eed175ae971b0ee HTTP/1.0" 202 Accepted 2026-04-16 17:23:44,982 - lava_callback - INFO - Starting async job submit for node 69e1188d2eed175ae971b0ee 2026-04-16 17:23:45,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:23:45,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1188d2eed175ae971b0ee HTTP/1.1" 200 None 2026-04-16 17:23:45,026 - lava_callback - DEBUG - Processing node 69e1188d2eed175ae971b0ee: baseline-nfs-arm64 2026-04-16 17:23:45,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:23:45,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:23:45,820 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e1188d2eed175ae971b0ee/log.txt.gz 2026-04-16 17:23:46,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:23:46,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:23:46,310 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e1188d2eed175ae971b0ee/lava-logs.yaml 2026-04-16 17:23:46,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:23:46,438 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:23:46,439 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e1188d2eed175ae971b0ee/lava_callback.json.gz 2026-04-16 17:23:46,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:23:46,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1188d2eed175ae971b0ee HTTP/1.1" 200 None 2026-04-16 17:23:46,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:23:46,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:23:46,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:52392 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:23:46,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1188d2eed175ae971b0ee HTTP/1.1" 200 None 2026-04-16 17:23:46,592 - lava_callback - INFO - Completed processing callback for node 69e1188d2eed175ae971b0ee INFO: 172.21.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43372 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:24:08,604 - lava_callback - INFO - Received callback for node 69e11b252eed175ae971b1f6 INFO: 172.21.0.1:43380 - "POST /node/69e11b252eed175ae971b1f6 HTTP/1.0" 202 Accepted 2026-04-16 17:24:08,610 - lava_callback - INFO - Starting async job submit for node 69e11b252eed175ae971b1f6 2026-04-16 17:24:08,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:24:08,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11b252eed175ae971b1f6 HTTP/1.1" 200 None 2026-04-16 17:24:08,627 - lava_callback - DEBUG - Processing node 69e11b252eed175ae971b1f6: baseline-nfs-arm64 2026-04-16 17:24:08,628 - lava_callback - WARNING - Failed to upload log 2026-04-16 17:24:08,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:24:08,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:24:08,712 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e11b252eed175ae971b1f6/lava-logs.yaml 2026-04-16 17:24:08,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:24:08,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:24:08,807 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e11b252eed175ae971b1f6/lava_callback.json.gz 2026-04-16 17:24:08,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:24:08,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11b252eed175ae971b1f6 HTTP/1.1" 200 None 2026-04-16 17:24:08,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:24:08,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:24:08,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:24:08,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11b252eed175ae971b1f6 HTTP/1.1" 200 None 2026-04-16 17:24:08,881 - lava_callback - INFO - Completed processing callback for node 69e11b252eed175ae971b1f6 INFO: 172.21.0.1:42340 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 17:24:15,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:24:15,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54534 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:24:27,456 - lava_callback - INFO - Received callback for node 69de7848f6535ffd5b3ee121 INFO: 172.21.0.1:54550 - "POST /node/69de7848f6535ffd5b3ee121 HTTP/1.0" 202 Accepted 2026-04-16 17:24:27,462 - lava_callback - INFO - Starting async job submit for node 69de7848f6535ffd5b3ee121 2026-04-16 17:24:27,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:24:27,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7848f6535ffd5b3ee121 HTTP/1.1" 200 None 2026-04-16 17:24:27,483 - lava_callback - DEBUG - Processing node 69de7848f6535ffd5b3ee121: baseline-arm64-baylibre 2026-04-16 17:24:27,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7848f6535ffd5b3ee121 2026-04-16 17:24:27,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:24:27,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7848f6535ffd5b3ee121 HTTP/1.1" 200 None 2026-04-16 17:24:27,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:24:27,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-16 17:24:27,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:24:27,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7848f6535ffd5b3ee121 HTTP/1.1" 200 None 2026-04-16 17:24:27,535 - lava_callback - ERROR - Error processing callback for node 69de7848f6535ffd5b3ee121: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54562 - "GET /node/6985d6f671989fb14149a711%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59348 - "GET /node/693fca34575bc060ce14a1ac%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59358 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:25:50,915 - lava_callback - INFO - Received callback for node 69de7896f6535ffd5b3ee180 INFO: 172.21.0.1:53708 - "POST /node/69de7896f6535ffd5b3ee180 HTTP/1.0" 202 Accepted 2026-04-16 17:25:50,921 - lava_callback - INFO - Starting async job submit for node 69de7896f6535ffd5b3ee180 2026-04-16 17:25:50,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:25:50,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7896f6535ffd5b3ee180 HTTP/1.1" 200 None 2026-04-16 17:25:50,937 - lava_callback - DEBUG - Processing node 69de7896f6535ffd5b3ee180: baseline-arm64-clabbe 2026-04-16 17:25:50,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7896f6535ffd5b3ee180 2026-04-16 17:25:50,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:25:50,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7896f6535ffd5b3ee180 HTTP/1.1" 200 None 2026-04-16 17:25:50,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:25:50,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-16 17:25:50,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:25:51,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7896f6535ffd5b3ee180 HTTP/1.1" 200 None 2026-04-16 17:25:51,005 - lava_callback - ERROR - Error processing callback for node 69de7896f6535ffd5b3ee180: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41082 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:26:58,202 - lava_callback - INFO - Received callback for node 69e118342eed175ae971b0a3 INFO: 172.21.0.1:41092 - "POST /node/69e118342eed175ae971b0a3 HTTP/1.0" 202 Accepted 2026-04-16 17:26:58,209 - lava_callback - INFO - Starting async job submit for node 69e118342eed175ae971b0a3 2026-04-16 17:26:58,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:26:58,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e118342eed175ae971b0a3 HTTP/1.1" 200 None 2026-04-16 17:26:58,295 - lava_callback - DEBUG - Processing node 69e118342eed175ae971b0a3: baseline-x86 2026-04-16 17:26:59,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:26:59,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:26:59,390 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e118342eed175ae971b0a3/log.txt.gz 2026-04-16 17:26:59,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:26:59,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:26:59,987 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e118342eed175ae971b0a3/lava-logs.yaml 2026-04-16 17:27:00,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:27:00,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:27:00,154 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e118342eed175ae971b0a3/lava_callback.json.gz DEBUG: Setup failed for 69e118342eed175ae971b0a3. Transitting job node result: incomplete -> fail 2026-04-16 17:27:00,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:27:00,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e118342eed175ae971b0a3 HTTP/1.1" 200 None 2026-04-16 17:27:00,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:27:00,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10be52eed175ae971a5b3 HTTP/1.1" 200 None 2026-04-16 17:27:00,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:27:00,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e118342eed175ae971b0a3 HTTP/1.1" 200 None 2026-04-16 17:27:00,396 - lava_callback - INFO - Completed processing callback for node 69e118342eed175ae971b0a3 INFO: 172.21.0.1:52872 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:27:10,980 - lava_callback - INFO - Received callback for node 69de78e0f6535ffd5b3ee1bf INFO: 172.21.0.1:45402 - "POST /node/69de78e0f6535ffd5b3ee1bf HTTP/1.0" 202 Accepted 2026-04-16 17:27:10,986 - lava_callback - INFO - Starting async job submit for node 69de78e0f6535ffd5b3ee1bf 2026-04-16 17:27:10,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:27:11,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de78e0f6535ffd5b3ee1bf HTTP/1.1" 200 None 2026-04-16 17:27:11,004 - lava_callback - DEBUG - Processing node 69de78e0f6535ffd5b3ee1bf: baseline-arm64-clabbe 2026-04-16 17:27:11,004 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de78e0f6535ffd5b3ee1bf 2026-04-16 17:27:11,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:27:11,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de78e0f6535ffd5b3ee1bf HTTP/1.1" 200 None 2026-04-16 17:27:11,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:27:11,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-16 17:27:11,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:27:11,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de78e0f6535ffd5b3ee1bf HTTP/1.1" 200 None 2026-04-16 17:27:11,058 - lava_callback - ERROR - Error processing callback for node 69de78e0f6535ffd5b3ee1bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45412 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 17:27:15,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:27:15,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54664 - "GET /node/698ff1dd76d4b6342e9db8af%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54680 - "GET /node/695359f631522df6df79d1e9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37982 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:28:30,966 - lava_callback - INFO - Received callback for node 69de792bf6535ffd5b3ee205 INFO: 172.21.0.1:36486 - "POST /node/69de792bf6535ffd5b3ee205 HTTP/1.0" 202 Accepted 2026-04-16 17:28:30,976 - lava_callback - INFO - Starting async job submit for node 69de792bf6535ffd5b3ee205 2026-04-16 17:28:30,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:28:31,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de792bf6535ffd5b3ee205 HTTP/1.1" 200 None 2026-04-16 17:28:31,005 - lava_callback - DEBUG - Processing node 69de792bf6535ffd5b3ee205: baseline-arm64-clabbe 2026-04-16 17:28:31,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de792bf6535ffd5b3ee205 2026-04-16 17:28:31,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:28:31,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de792bf6535ffd5b3ee205 HTTP/1.1" 200 None 2026-04-16 17:28:31,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:28:31,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-16 17:28:31,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:28:31,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de792bf6535ffd5b3ee205 HTTP/1.1" 200 None 2026-04-16 17:28:31,058 - lava_callback - ERROR - Error processing callback for node 69de792bf6535ffd5b3ee205: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59786 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:29:18,293 - lava_callback - INFO - Received callback for node 69e11c0a2eed175ae971b255 INFO: 172.21.0.1:59796 - "POST /node/69e11c0a2eed175ae971b255 HTTP/1.0" 202 Accepted 2026-04-16 17:29:18,300 - lava_callback - INFO - Starting async job submit for node 69e11c0a2eed175ae971b255 2026-04-16 17:29:18,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:29:18,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11c0a2eed175ae971b255 HTTP/1.1" 200 None 2026-04-16 17:29:18,345 - lava_callback - DEBUG - Processing node 69e11c0a2eed175ae971b255: baseline-arm64 2026-04-16 17:29:18,572 - lava_callback - WARNING - Failed to upload log 2026-04-16 17:29:18,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:29:19,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:29:19,117 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e11c0a2eed175ae971b255/lava-logs.yaml 2026-04-16 17:29:19,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:29:19,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:29:19,221 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e11c0a2eed175ae971b255/lava_callback.json.gz 2026-04-16 17:29:19,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:29:19,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11c0a2eed175ae971b255 HTTP/1.1" 200 None 2026-04-16 17:29:19,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:29:19,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:29:19,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:29:19,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11c0a2eed175ae971b255 HTTP/1.1" 200 None 2026-04-16 17:29:19,412 - lava_callback - INFO - Completed processing callback for node 69e11c0a2eed175ae971b255 INFO: 172.21.0.1:39264 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:29:30,939 - lava_callback - INFO - Received callback for node 69de7973f6535ffd5b3ee255 INFO: 172.21.0.1:51392 - "POST /node/69de7973f6535ffd5b3ee255 HTTP/1.0" 202 Accepted 2026-04-16 17:29:30,945 - lava_callback - INFO - Starting async job submit for node 69de7973f6535ffd5b3ee255 2026-04-16 17:29:30,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:29:30,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7973f6535ffd5b3ee255 HTTP/1.1" 200 None 2026-04-16 17:29:30,960 - lava_callback - DEBUG - Processing node 69de7973f6535ffd5b3ee255: baseline-arm64-clabbe 2026-04-16 17:29:30,961 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7973f6535ffd5b3ee255 2026-04-16 17:29:30,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:29:30,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7973f6535ffd5b3ee255 HTTP/1.1" 200 None 2026-04-16 17:29:30,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:29:30,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-16 17:29:30,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:29:31,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7973f6535ffd5b3ee255 HTTP/1.1" 200 None 2026-04-16 17:29:31,009 - lava_callback - ERROR - Error processing callback for node 69de7973f6535ffd5b3ee255: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51764 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:29:45,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:29:45,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51772 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:29:47,858 - lava_callback - INFO - Received callback for node 69e11c592eed175ae971b279 INFO: 172.21.0.1:51784 - "POST /node/69e11c592eed175ae971b279 HTTP/1.0" 202 Accepted 2026-04-16 17:29:47,864 - lava_callback - INFO - Starting async job submit for node 69e11c592eed175ae971b279 2026-04-16 17:29:47,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:29:47,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11c592eed175ae971b279 HTTP/1.1" 200 None 2026-04-16 17:29:47,911 - lava_callback - DEBUG - Processing node 69e11c592eed175ae971b279: baseline-arm64 2026-04-16 17:29:48,054 - lava_callback - WARNING - Failed to upload log 2026-04-16 17:29:48,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:29:48,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:29:48,238 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e11c592eed175ae971b279/lava-logs.yaml 2026-04-16 17:29:48,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:29:48,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:29:48,332 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e11c592eed175ae971b279/lava_callback.json.gz 2026-04-16 17:29:48,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:29:48,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11c592eed175ae971b279 HTTP/1.1" 200 None 2026-04-16 17:29:48,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:29:48,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:29:48,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:29:48,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11c592eed175ae971b279 HTTP/1.1" 200 None 2026-04-16 17:29:48,517 - lava_callback - INFO - Completed processing callback for node 69e11c592eed175ae971b279 INFO: 172.21.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53226 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 17:30:15,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:30:15,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:30:51,038 - lava_callback - INFO - Received callback for node 69de79bcf6535ffd5b3ee2a3 INFO: 172.21.0.1:43868 - "POST /node/69de79bcf6535ffd5b3ee2a3 HTTP/1.0" 202 Accepted 2026-04-16 17:30:51,043 - lava_callback - INFO - Starting async job submit for node 69de79bcf6535ffd5b3ee2a3 2026-04-16 17:30:51,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:30:51,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de79bcf6535ffd5b3ee2a3 HTTP/1.1" 200 None 2026-04-16 17:30:51,059 - lava_callback - DEBUG - Processing node 69de79bcf6535ffd5b3ee2a3: baseline-arm64-clabbe 2026-04-16 17:30:51,059 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de79bcf6535ffd5b3ee2a3 2026-04-16 17:30:51,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:30:51,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de79bcf6535ffd5b3ee2a3 HTTP/1.1" 200 None 2026-04-16 17:30:51,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:30:51,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-16 17:30:51,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:30:51,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de79bcf6535ffd5b3ee2a3 HTTP/1.1" 200 None 2026-04-16 17:30:51,108 - lava_callback - ERROR - Error processing callback for node 69de79bcf6535ffd5b3ee2a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38730 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:31:51,076 - lava_callback - INFO - Received callback for node 69de7a04f6535ffd5b3ee2e5 INFO: 172.21.0.1:51750 - "POST /node/69de7a04f6535ffd5b3ee2e5 HTTP/1.0" 202 Accepted 2026-04-16 17:31:51,081 - lava_callback - INFO - Starting async job submit for node 69de7a04f6535ffd5b3ee2e5 2026-04-16 17:31:51,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:31:51,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7a04f6535ffd5b3ee2e5 HTTP/1.1" 200 None 2026-04-16 17:31:51,097 - lava_callback - DEBUG - Processing node 69de7a04f6535ffd5b3ee2e5: baseline-arm64-clabbe 2026-04-16 17:31:51,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7a04f6535ffd5b3ee2e5 2026-04-16 17:31:51,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:31:51,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7a04f6535ffd5b3ee2e5 HTTP/1.1" 200 None 2026-04-16 17:31:51,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:31:51,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-16 17:31:51,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:31:51,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7a04f6535ffd5b3ee2e5 HTTP/1.1" 200 None 2026-04-16 17:31:51,161 - lava_callback - ERROR - Error processing callback for node 69de7a04f6535ffd5b3ee2e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45530 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:33:11,144 - lava_callback - INFO - Received callback for node 69de7a4ff6535ffd5b3ee328 INFO: 172.21.0.1:45624 - "POST /node/69de7a4ff6535ffd5b3ee328 HTTP/1.0" 202 Accepted 2026-04-16 17:33:11,150 - lava_callback - INFO - Starting async job submit for node 69de7a4ff6535ffd5b3ee328 2026-04-16 17:33:11,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:33:11,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7a4ff6535ffd5b3ee328 HTTP/1.1" 200 None 2026-04-16 17:33:11,170 - lava_callback - DEBUG - Processing node 69de7a4ff6535ffd5b3ee328: baseline-arm64-clabbe 2026-04-16 17:33:11,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7a4ff6535ffd5b3ee328 2026-04-16 17:33:11,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:33:11,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7a4ff6535ffd5b3ee328 HTTP/1.1" 200 None 2026-04-16 17:33:11,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:33:11,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-16 17:33:11,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:33:11,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7a4ff6535ffd5b3ee328 HTTP/1.1" 200 None 2026-04-16 17:33:11,237 - lava_callback - ERROR - Error processing callback for node 69de7a4ff6535ffd5b3ee328: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51618 - "GET /node/69876c10e31b58f834f198ca%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51756 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:33:48,207 - lava_callback - INFO - Received callback for node 69e11d3c2eed175ae971b2cb INFO: 172.21.0.1:51762 - "POST /node/69e11d3c2eed175ae971b2cb HTTP/1.0" 202 Accepted 2026-04-16 17:33:48,219 - lava_callback - INFO - Starting async job submit for node 69e11d3c2eed175ae971b2cb 2026-04-16 17:33:48,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:33:48,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11d3c2eed175ae971b2cb HTTP/1.1" 200 None 2026-04-16 17:33:48,296 - lava_callback - DEBUG - Processing node 69e11d3c2eed175ae971b2cb: baseline-arm64 2026-04-16 17:33:48,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:33:49,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:33:49,005 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e11d3c2eed175ae971b2cb/log.txt.gz 2026-04-16 17:33:49,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:33:49,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:33:49,559 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e11d3c2eed175ae971b2cb/lava-logs.yaml 2026-04-16 17:33:49,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:33:49,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:33:49,709 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e11d3c2eed175ae971b2cb/lava_callback.json.gz 2026-04-16 17:33:49,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:33:49,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11d3c2eed175ae971b2cb HTTP/1.1" 200 None 2026-04-16 17:33:49,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:33:49,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:33:49,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:33:49,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11d3c2eed175ae971b2cb HTTP/1.1" 200 None 2026-04-16 17:33:49,929 - lava_callback - INFO - Completed processing callback for node 69e11d3c2eed175ae971b2cb INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36990 - "GET /node/690ff8d2f4a91d81a0ebffad%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36996 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 17:34:15,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:34:15,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:34:28,098 - lava_callback - INFO - Received callback for node 69de7a93f6535ffd5b3ee362 INFO: 172.21.0.1:48498 - "POST /node/69de7a93f6535ffd5b3ee362 HTTP/1.0" 202 Accepted 2026-04-16 17:34:28,103 - lava_callback - INFO - Starting async job submit for node 69de7a93f6535ffd5b3ee362 2026-04-16 17:34:28,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:34:28,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7a93f6535ffd5b3ee362 HTTP/1.1" 200 None 2026-04-16 17:34:28,119 - lava_callback - DEBUG - Processing node 69de7a93f6535ffd5b3ee362: baseline-arm64-baylibre 2026-04-16 17:34:28,120 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7a93f6535ffd5b3ee362 2026-04-16 17:34:28,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:34:28,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7a93f6535ffd5b3ee362 HTTP/1.1" 200 None 2026-04-16 17:34:28,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:34:28,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-16 17:34:28,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:34:28,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7a93f6535ffd5b3ee362 HTTP/1.1" 200 None 2026-04-16 17:34:28,168 - lava_callback - ERROR - Error processing callback for node 69de7a93f6535ffd5b3ee362: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58284 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:35:28,083 - lava_callback - INFO - Received callback for node 69de7adaf6535ffd5b3ee3ae INFO: 172.21.0.1:58288 - "POST /node/69de7adaf6535ffd5b3ee3ae HTTP/1.0" 202 Accepted 2026-04-16 17:35:28,089 - lava_callback - INFO - Starting async job submit for node 69de7adaf6535ffd5b3ee3ae 2026-04-16 17:35:28,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:35:28,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7adaf6535ffd5b3ee3ae HTTP/1.1" 200 None 2026-04-16 17:35:28,111 - lava_callback - DEBUG - Processing node 69de7adaf6535ffd5b3ee3ae: baseline-arm64-baylibre 2026-04-16 17:35:28,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7adaf6535ffd5b3ee3ae 2026-04-16 17:35:28,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:35:28,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7adaf6535ffd5b3ee3ae HTTP/1.1" 200 None 2026-04-16 17:35:28,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:35:28,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-16 17:35:28,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:35:28,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7adaf6535ffd5b3ee3ae HTTP/1.1" 200 None 2026-04-16 17:35:28,160 - lava_callback - ERROR - Error processing callback for node 69de7adaf6535ffd5b3ee3ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47680 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:36:48,208 - lava_callback - INFO - Received callback for node 69de7b23f6535ffd5b3ee40c INFO: 172.21.0.1:47696 - "POST /node/69de7b23f6535ffd5b3ee40c HTTP/1.0" 202 Accepted 2026-04-16 17:36:48,213 - lava_callback - INFO - Starting async job submit for node 69de7b23f6535ffd5b3ee40c 2026-04-16 17:36:48,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:36:48,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7b23f6535ffd5b3ee40c HTTP/1.1" 200 None 2026-04-16 17:36:48,230 - lava_callback - DEBUG - Processing node 69de7b23f6535ffd5b3ee40c: baseline-arm64-baylibre 2026-04-16 17:36:48,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7b23f6535ffd5b3ee40c 2026-04-16 17:36:48,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:36:48,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7b23f6535ffd5b3ee40c HTTP/1.1" 200 None 2026-04-16 17:36:48,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:36:48,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-16 17:36:48,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:36:48,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7b23f6535ffd5b3ee40c HTTP/1.1" 200 None 2026-04-16 17:36:48,279 - lava_callback - ERROR - Error processing callback for node 69de7b23f6535ffd5b3ee40c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40630 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:37:09,938 - lava_callback - INFO - Received callback for node 69e11cf22eed175ae971b2a3 INFO: 172.21.0.1:44404 - "POST /node/69e11cf22eed175ae971b2a3 HTTP/1.0" 202 Accepted 2026-04-16 17:37:09,950 - lava_callback - INFO - Starting async job submit for node 69e11cf22eed175ae971b2a3 2026-04-16 17:37:09,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:37:10,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11cf22eed175ae971b2a3 HTTP/1.1" 200 None 2026-04-16 17:37:10,008 - lava_callback - DEBUG - Processing node 69e11cf22eed175ae971b2a3: baseline-arm64 2026-04-16 17:37:10,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:37:10,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:37:10,539 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e11cf22eed175ae971b2a3/log.txt.gz 2026-04-16 17:37:10,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:37:10,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:37:10,934 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e11cf22eed175ae971b2a3/lava-logs.yaml 2026-04-16 17:37:10,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:37:11,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:37:11,079 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e11cf22eed175ae971b2a3/lava_callback.json.gz DEBUG: Setup failed for 69e11cf22eed175ae971b2a3. Transitting job node result: incomplete -> fail 2026-04-16 17:37:11,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:37:11,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11cf22eed175ae971b2a3 HTTP/1.1" 200 None 2026-04-16 17:37:11,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:37:11,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:37:11,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:37:11,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11cf22eed175ae971b2a3 HTTP/1.1" 200 None 2026-04-16 17:37:11,303 - lava_callback - INFO - Completed processing callback for node 69e11cf22eed175ae971b2a3 INFO: 172.21.0.1:44406 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 17:37:15,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:37:15,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:38:08,249 - lava_callback - INFO - Received callback for node 69de7b6ef6535ffd5b3ee452 INFO: 172.21.0.1:41762 - "POST /node/69de7b6ef6535ffd5b3ee452 HTTP/1.0" 202 Accepted 2026-04-16 17:38:08,255 - lava_callback - INFO - Starting async job submit for node 69de7b6ef6535ffd5b3ee452 2026-04-16 17:38:08,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:38:08,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7b6ef6535ffd5b3ee452 HTTP/1.1" 200 None 2026-04-16 17:38:08,280 - lava_callback - DEBUG - Processing node 69de7b6ef6535ffd5b3ee452: baseline-arm64-baylibre 2026-04-16 17:38:08,280 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7b6ef6535ffd5b3ee452 2026-04-16 17:38:08,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:38:08,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7b6ef6535ffd5b3ee452 HTTP/1.1" 200 None 2026-04-16 17:38:08,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:38:08,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-16 17:38:08,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:38:08,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7b6ef6535ffd5b3ee452 HTTP/1.1" 200 None 2026-04-16 17:38:08,341 - lava_callback - ERROR - Error processing callback for node 69de7b6ef6535ffd5b3ee452: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57716 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:39:08,281 - lava_callback - INFO - Received callback for node 69de7bb5f6535ffd5b3ee49a INFO: 172.21.0.1:57720 - "POST /node/69de7bb5f6535ffd5b3ee49a HTTP/1.0" 202 Accepted 2026-04-16 17:39:08,287 - lava_callback - INFO - Starting async job submit for node 69de7bb5f6535ffd5b3ee49a 2026-04-16 17:39:08,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:39:08,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7bb5f6535ffd5b3ee49a HTTP/1.1" 200 None 2026-04-16 17:39:08,302 - lava_callback - DEBUG - Processing node 69de7bb5f6535ffd5b3ee49a: baseline-arm64-baylibre 2026-04-16 17:39:08,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7bb5f6535ffd5b3ee49a 2026-04-16 17:39:08,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:39:08,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7bb5f6535ffd5b3ee49a HTTP/1.1" 200 None 2026-04-16 17:39:08,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:39:08,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-16 17:39:08,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:39:08,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7bb5f6535ffd5b3ee49a HTTP/1.1" 200 None 2026-04-16 17:39:08,365 - lava_callback - ERROR - Error processing callback for node 69de7bb5f6535ffd5b3ee49a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:40:28,389 - lava_callback - INFO - Received callback for node 69de7bfef6535ffd5b3ee4e3 INFO: 172.21.0.1:59672 - "POST /node/69de7bfef6535ffd5b3ee4e3 HTTP/1.0" 202 Accepted 2026-04-16 17:40:28,396 - lava_callback - INFO - Starting async job submit for node 69de7bfef6535ffd5b3ee4e3 2026-04-16 17:40:28,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:40:28,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7bfef6535ffd5b3ee4e3 HTTP/1.1" 200 None 2026-04-16 17:40:28,413 - lava_callback - DEBUG - Processing node 69de7bfef6535ffd5b3ee4e3: baseline-arm64-baylibre 2026-04-16 17:40:28,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7bfef6535ffd5b3ee4e3 2026-04-16 17:40:28,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:40:28,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7bfef6535ffd5b3ee4e3 HTTP/1.1" 200 None 2026-04-16 17:40:28,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:40:28,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-16 17:40:28,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:40:28,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7bfef6535ffd5b3ee4e3 HTTP/1.1" 200 None 2026-04-16 17:40:28,477 - lava_callback - ERROR - Error processing callback for node 69de7bfef6535ffd5b3ee4e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:42:48,538 - lava_callback - INFO - Received callback for node 69de7c8cf6535ffd5b3ee538 INFO: 172.21.0.1:41782 - "POST /node/69de7c8cf6535ffd5b3ee538 HTTP/1.0" 202 Accepted 2026-04-16 17:42:48,548 - lava_callback - INFO - Starting async job submit for node 69de7c8cf6535ffd5b3ee538 2026-04-16 17:42:48,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:42:48,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7c8cf6535ffd5b3ee538 HTTP/1.1" 200 None 2026-04-16 17:42:48,573 - lava_callback - DEBUG - Processing node 69de7c8cf6535ffd5b3ee538: baseline-arm64-baylibre 2026-04-16 17:42:48,573 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7c8cf6535ffd5b3ee538 2026-04-16 17:42:48,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:42:48,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7c8cf6535ffd5b3ee538 HTTP/1.1" 200 None 2026-04-16 17:42:48,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:42:48,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-16 17:42:48,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:42:48,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7c8cf6535ffd5b3ee538 HTTP/1.1" 200 None 2026-04-16 17:42:48,684 - lava_callback - ERROR - Error processing callback for node 69de7c8cf6535ffd5b3ee538: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52456 - "GET /node/698a24c922b4cc0f227af9dc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:44:11,565 - lava_callback - INFO - Received callback for node 69de7cdcf6535ffd5b3ee575 INFO: 172.21.0.1:43376 - "POST /node/69de7cdcf6535ffd5b3ee575 HTTP/1.0" 202 Accepted 2026-04-16 17:44:11,574 - lava_callback - INFO - Starting async job submit for node 69de7cdcf6535ffd5b3ee575 2026-04-16 17:44:11,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:44:11,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7cdcf6535ffd5b3ee575 HTTP/1.1" 200 None 2026-04-16 17:44:11,600 - lava_callback - DEBUG - Processing node 69de7cdcf6535ffd5b3ee575: baseline-arm64-clabbe 2026-04-16 17:44:11,600 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7cdcf6535ffd5b3ee575 2026-04-16 17:44:11,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:44:11,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7cdcf6535ffd5b3ee575 HTTP/1.1" 200 None 2026-04-16 17:44:11,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:44:11,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-16 17:44:11,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:44:11,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7cdcf6535ffd5b3ee575 HTTP/1.1" 200 None 2026-04-16 17:44:11,687 - lava_callback - ERROR - Error processing callback for node 69de7cdcf6535ffd5b3ee575: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44148 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:45:31,575 - lava_callback - INFO - Received callback for node 69de7d26f6535ffd5b3ee5d0 INFO: 172.21.0.1:47366 - "POST /node/69de7d26f6535ffd5b3ee5d0 HTTP/1.0" 202 Accepted 2026-04-16 17:45:31,582 - lava_callback - INFO - Starting async job submit for node 69de7d26f6535ffd5b3ee5d0 2026-04-16 17:45:31,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:45:31,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7d26f6535ffd5b3ee5d0 HTTP/1.1" 200 None 2026-04-16 17:45:31,608 - lava_callback - DEBUG - Processing node 69de7d26f6535ffd5b3ee5d0: baseline-arm64-clabbe 2026-04-16 17:45:31,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7d26f6535ffd5b3ee5d0 2026-04-16 17:45:31,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:45:31,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7d26f6535ffd5b3ee5d0 HTTP/1.1" 200 None 2026-04-16 17:45:31,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:45:31,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-16 17:45:31,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:45:31,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7d26f6535ffd5b3ee5d0 HTTP/1.1" 200 None 2026-04-16 17:45:31,680 - lava_callback - ERROR - Error processing callback for node 69de7d26f6535ffd5b3ee5d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44728 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:46:11,669 - lava_callback - INFO - Received callback for node 69e11bc12eed175ae971b230 INFO: 172.21.0.1:33552 - "POST /node/69e11bc12eed175ae971b230 HTTP/1.0" 202 Accepted 2026-04-16 17:46:11,678 - lava_callback - INFO - Starting async job submit for node 69e11bc12eed175ae971b230 2026-04-16 17:46:11,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:46:11,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11bc12eed175ae971b230 HTTP/1.1" 200 None 2026-04-16 17:46:11,760 - lava_callback - DEBUG - Processing node 69e11bc12eed175ae971b230: baseline-nfs-arm64 2026-04-16 17:46:13,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:46:13,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:46:13,247 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e11bc12eed175ae971b230/log.txt.gz 2026-04-16 17:46:13,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:46:14,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:46:14,096 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e11bc12eed175ae971b230/lava-logs.yaml 2026-04-16 17:46:14,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:46:14,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:46:14,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e11bc12eed175ae971b230/lava_callback.json.gz DEBUG: Setup failed for 69e11bc12eed175ae971b230. Transitting job node result: incomplete -> fail 2026-04-16 17:46:14,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:46:14,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11bc12eed175ae971b230 HTTP/1.1" 200 None 2026-04-16 17:46:14,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:46:14,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:46:14,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:46:14,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11bc12eed175ae971b230 HTTP/1.1" 200 None 2026-04-16 17:46:14,528 - lava_callback - INFO - Completed processing callback for node 69e11bc12eed175ae971b230 INFO: 172.21.0.1:33564 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 17:46:15,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:46:15,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48206 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:46:31,724 - lava_callback - INFO - Received callback for node 69de7d70f6535ffd5b3ee615 INFO: 172.21.0.1:47000 - "POST /node/69de7d70f6535ffd5b3ee615 HTTP/1.0" 202 Accepted 2026-04-16 17:46:31,729 - lava_callback - INFO - Starting async job submit for node 69de7d70f6535ffd5b3ee615 2026-04-16 17:46:31,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:46:31,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7d70f6535ffd5b3ee615 HTTP/1.1" 200 None 2026-04-16 17:46:31,745 - lava_callback - DEBUG - Processing node 69de7d70f6535ffd5b3ee615: baseline-arm64-clabbe 2026-04-16 17:46:31,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7d70f6535ffd5b3ee615 2026-04-16 17:46:31,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:46:31,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7d70f6535ffd5b3ee615 HTTP/1.1" 200 None 2026-04-16 17:46:31,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:46:31,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-16 17:46:31,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:46:31,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7d70f6535ffd5b3ee615 HTTP/1.1" 200 None 2026-04-16 17:46:31,809 - lava_callback - ERROR - Error processing callback for node 69de7d70f6535ffd5b3ee615: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58094 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:47:51,695 - lava_callback - INFO - Received callback for node 69de7dbaf6535ffd5b3ee661 INFO: 172.21.0.1:47882 - "POST /node/69de7dbaf6535ffd5b3ee661 HTTP/1.0" 202 Accepted 2026-04-16 17:47:51,702 - lava_callback - INFO - Starting async job submit for node 69de7dbaf6535ffd5b3ee661 2026-04-16 17:47:51,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:47:51,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7dbaf6535ffd5b3ee661 HTTP/1.1" 200 None 2026-04-16 17:47:51,720 - lava_callback - DEBUG - Processing node 69de7dbaf6535ffd5b3ee661: baseline-arm64-clabbe 2026-04-16 17:47:51,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7dbaf6535ffd5b3ee661 2026-04-16 17:47:51,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:47:51,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7dbaf6535ffd5b3ee661 HTTP/1.1" 200 None 2026-04-16 17:47:51,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:47:51,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-16 17:47:51,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:47:51,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7dbaf6535ffd5b3ee661 HTTP/1.1" 200 None 2026-04-16 17:47:51,785 - lava_callback - ERROR - Error processing callback for node 69de7dbaf6535ffd5b3ee661: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:49:11,719 - lava_callback - INFO - Received callback for node 69de7e08f6535ffd5b3ee68d INFO: 172.21.0.1:51350 - "POST /node/69de7e08f6535ffd5b3ee68d HTTP/1.0" 202 Accepted 2026-04-16 17:49:11,727 - lava_callback - INFO - Starting async job submit for node 69de7e08f6535ffd5b3ee68d 2026-04-16 17:49:11,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:49:11,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7e08f6535ffd5b3ee68d HTTP/1.1" 200 None 2026-04-16 17:49:11,745 - lava_callback - DEBUG - Processing node 69de7e08f6535ffd5b3ee68d: baseline-arm64-clabbe 2026-04-16 17:49:11,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7e08f6535ffd5b3ee68d 2026-04-16 17:49:11,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:49:11,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7e08f6535ffd5b3ee68d HTTP/1.1" 200 None 2026-04-16 17:49:11,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:49:11,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-16 17:49:11,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:49:11,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7e08f6535ffd5b3ee68d HTTP/1.1" 200 None 2026-04-16 17:49:11,807 - lava_callback - ERROR - Error processing callback for node 69de7e08f6535ffd5b3ee68d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51360 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 17:49:15,434 - lava_callback - INFO - Received callback for node 69e112322eed175ae971a6f4 INFO: 172.21.0.1:51372 - "POST /node/69e112322eed175ae971a6f4 HTTP/1.0" 202 Accepted 2026-04-16 17:49:15,440 - lava_callback - INFO - Starting async job submit for node 69e112322eed175ae971a6f4 2026-04-16 17:49:15,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:49:15,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112322eed175ae971a6f4 HTTP/1.1" 200 None 2026-04-16 17:49:15,478 - lava_callback - DEBUG - Processing node 69e112322eed175ae971a6f4: baseline-arm64-broonie 2026-04-16 17:49:15,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:49:15,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:49:15,835 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e112322eed175ae971a6f4/log.txt.gz 2026-04-16 17:49:16,059 - lava_callback - INFO - Received callback for node 69e11e7f2eed175ae971b359 INFO: 172.21.0.1:51378 - "POST /node/69e11e7f2eed175ae971b359 HTTP/1.0" 202 Accepted 2026-04-16 17:49:16,067 - lava_callback - INFO - Starting async job submit for node 69e11e7f2eed175ae971b359 2026-04-16 17:49:16,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:49:16,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:49:16,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11e7f2eed175ae971b359 HTTP/1.1" 200 None 2026-04-16 17:49:16,125 - lava_callback - DEBUG - Processing node 69e11e7f2eed175ae971b359: baseline-arm64 2026-04-16 17:49:16,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:49:16,332 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e112322eed175ae971a6f4/lava-logs.yaml 2026-04-16 17:49:16,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51384 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:49:16,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:49:16,702 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e112322eed175ae971a6f4/lava_callback.json.gz 2026-04-16 17:49:16,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:49:16,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:49:16,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112322eed175ae971a6f4 HTTP/1.1" 200 None 2026-04-16 17:49:16,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:49:16,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:49:16,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:49:16,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112322eed175ae971a6f4 HTTP/1.1" 200 None 2026-04-16 17:49:16,882 - lava_callback - INFO - Completed processing callback for node 69e112322eed175ae971a6f4 2026-04-16 17:49:16,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:49:16,961 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e11e7f2eed175ae971b359/log.txt.gz 2026-04-16 17:49:17,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:49:17,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:49:17,414 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e11e7f2eed175ae971b359/lava-logs.yaml 2026-04-16 17:49:17,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:49:17,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:49:17,546 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e11e7f2eed175ae971b359/lava_callback.json.gz 2026-04-16 17:49:17,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:49:17,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11e7f2eed175ae971b359 HTTP/1.1" 200 None 2026-04-16 17:49:17,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:49:17,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:49:17,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:49:17,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11e7f2eed175ae971b359 HTTP/1.1" 200 None 2026-04-16 17:49:17,692 - lava_callback - INFO - Completed processing callback for node 69e11e7f2eed175ae971b359 INFO: 172.21.0.1:40806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48766 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:49:45,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:49:45,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38780 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 17:50:15,426 - lava_callback - INFO - Received callback for node 69e1122b2eed175ae971a6e2 INFO: 172.21.0.1:38782 - "POST /node/69e1122b2eed175ae971a6e2 HTTP/1.0" 202 Accepted 2026-04-16 17:50:15,433 - lava_callback - INFO - Starting async job submit for node 69e1122b2eed175ae971a6e2 2026-04-16 17:50:15,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:50:15,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1122b2eed175ae971a6e2 HTTP/1.1" 200 None 2026-04-16 17:50:15,479 - lava_callback - DEBUG - Processing node 69e1122b2eed175ae971a6e2: baseline-arm64-broonie 2026-04-16 17:50:15,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:50:15,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:50:15,918 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e1122b2eed175ae971a6e2/log.txt.gz 2026-04-16 17:50:16,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:50:16,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:50:16,253 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e1122b2eed175ae971a6e2/lava-logs.yaml 2026-04-16 17:50:16,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:50:16,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:50:16,381 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e1122b2eed175ae971a6e2/lava_callback.json.gz 2026-04-16 17:50:16,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:50:16,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1122b2eed175ae971a6e2 HTTP/1.1" 200 None 2026-04-16 17:50:16,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:50:16,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:50:16,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:50:16,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1122b2eed175ae971a6e2 HTTP/1.1" 200 None 2026-04-16 17:50:16,481 - lava_callback - INFO - Completed processing callback for node 69e1122b2eed175ae971a6e2 INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50524 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:50:31,847 - lava_callback - INFO - Received callback for node 69de7e57f6535ffd5b3ee6bc INFO: 172.21.0.1:37236 - "POST /node/69de7e57f6535ffd5b3ee6bc HTTP/1.0" 202 Accepted 2026-04-16 17:50:31,852 - lava_callback - INFO - Starting async job submit for node 69de7e57f6535ffd5b3ee6bc 2026-04-16 17:50:31,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:50:31,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7e57f6535ffd5b3ee6bc HTTP/1.1" 200 None 2026-04-16 17:50:31,876 - lava_callback - DEBUG - Processing node 69de7e57f6535ffd5b3ee6bc: baseline-arm64-clabbe 2026-04-16 17:50:31,876 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7e57f6535ffd5b3ee6bc 2026-04-16 17:50:31,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:50:31,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7e57f6535ffd5b3ee6bc HTTP/1.1" 200 None 2026-04-16 17:50:31,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:50:31,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-16 17:50:31,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:50:31,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7e57f6535ffd5b3ee6bc HTTP/1.1" 200 None 2026-04-16 17:50:31,942 - lava_callback - ERROR - Error processing callback for node 69de7e57f6535ffd5b3ee6bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52350 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:50:45,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:50:45,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:51:52,256 - lava_callback - INFO - Received callback for node 69de7ea2f6535ffd5b3ee70a INFO: 172.21.0.1:45524 - "POST /node/69de7ea2f6535ffd5b3ee70a HTTP/1.0" 202 Accepted 2026-04-16 17:51:52,262 - lava_callback - INFO - Starting async job submit for node 69de7ea2f6535ffd5b3ee70a 2026-04-16 17:51:52,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:51:52,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7ea2f6535ffd5b3ee70a HTTP/1.1" 200 None 2026-04-16 17:51:52,279 - lava_callback - DEBUG - Processing node 69de7ea2f6535ffd5b3ee70a: baseline-arm64-clabbe 2026-04-16 17:51:52,280 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7ea2f6535ffd5b3ee70a 2026-04-16 17:51:52,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:51:52,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7ea2f6535ffd5b3ee70a HTTP/1.1" 200 None 2026-04-16 17:51:52,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:51:52,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9230657c4e70f68e6a1bd HTTP/1.1" 200 None 2026-04-16 17:51:52,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:51:52,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7ea2f6535ffd5b3ee70a HTTP/1.1" 200 None 2026-04-16 17:51:52,336 - lava_callback - ERROR - Error processing callback for node 69de7ea2f6535ffd5b3ee70a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43166 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:52:49,128 - lava_callback - INFO - Received callback for node 69de7eeaf6535ffd5b3ee732 INFO: 172.21.0.1:43170 - "POST /node/69de7eeaf6535ffd5b3ee732 HTTP/1.0" 202 Accepted 2026-04-16 17:52:49,135 - lava_callback - INFO - Starting async job submit for node 69de7eeaf6535ffd5b3ee732 2026-04-16 17:52:49,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:52:49,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7eeaf6535ffd5b3ee732 HTTP/1.1" 200 None 2026-04-16 17:52:49,150 - lava_callback - DEBUG - Processing node 69de7eeaf6535ffd5b3ee732: baseline-arm64-baylibre 2026-04-16 17:52:49,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7eeaf6535ffd5b3ee732 2026-04-16 17:52:49,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:52:49,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7eeaf6535ffd5b3ee732 HTTP/1.1" 200 None 2026-04-16 17:52:49,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:52:49,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-16 17:52:49,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:52:49,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7eeaf6535ffd5b3ee732 HTTP/1.1" 200 None 2026-04-16 17:52:49,201 - lava_callback - ERROR - Error processing callback for node 69de7eeaf6535ffd5b3ee732: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49544 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:53:06,418 - lava_callback - INFO - Received callback for node 69e11f7b2eed175ae971b3be INFO: 172.21.0.1:46544 - "POST /node/69e11f7b2eed175ae971b3be HTTP/1.0" 202 Accepted 2026-04-16 17:53:06,425 - lava_callback - INFO - Starting async job submit for node 69e11f7b2eed175ae971b3be 2026-04-16 17:53:06,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:53:06,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11f7b2eed175ae971b3be HTTP/1.1" 200 None 2026-04-16 17:53:06,470 - lava_callback - DEBUG - Processing node 69e11f7b2eed175ae971b3be: baseline-nfs-arm64 INFO: 172.21.0.1:46554 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:53:07,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:53:07,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:53:07,221 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e11f7b2eed175ae971b3be/log.txt.gz 2026-04-16 17:53:07,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:53:07,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:53:07,722 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e11f7b2eed175ae971b3be/lava-logs.yaml 2026-04-16 17:53:07,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:53:07,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:53:07,844 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e11f7b2eed175ae971b3be/lava_callback.json.gz 2026-04-16 17:53:07,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:53:07,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e11f7b2eed175ae971b3be HTTP/1.1" 200 None 2026-04-16 17:53:07,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:53:07,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:53:07,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:53:07,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e11f7b2eed175ae971b3be HTTP/1.1" 200 None 2026-04-16 17:53:07,986 - lava_callback - INFO - Completed processing callback for node 69e11f7b2eed175ae971b3be INFO: 172.21.0.1:59484 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 17:53:15,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:53:15,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59496 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:53:17,834 - lava_callback - INFO - Received callback for node 69e1218f2eed175ae971b494 INFO: 172.21.0.1:59510 - "POST /node/69e1218f2eed175ae971b494 HTTP/1.0" 202 Accepted 2026-04-16 17:53:17,840 - lava_callback - INFO - Starting async job submit for node 69e1218f2eed175ae971b494 2026-04-16 17:53:17,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:53:17,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1218f2eed175ae971b494 HTTP/1.1" 200 None 2026-04-16 17:53:17,880 - lava_callback - DEBUG - Processing node 69e1218f2eed175ae971b494: baseline-arm 2026-04-16 17:53:18,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:53:18,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:53:18,200 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e1218f2eed175ae971b494/log.txt.gz 2026-04-16 17:53:18,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:53:18,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:53:18,427 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e1218f2eed175ae971b494/lava-logs.yaml 2026-04-16 17:53:18,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:53:18,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:53:18,528 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e1218f2eed175ae971b494/lava_callback.json.gz 2026-04-16 17:53:18,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:53:18,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1218f2eed175ae971b494 HTTP/1.1" 200 None 2026-04-16 17:53:18,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:53:18,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bbe2eed175ae971a58b HTTP/1.1" 200 None 2026-04-16 17:53:18,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:53:18,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1218f2eed175ae971b494 HTTP/1.1" 200 None 2026-04-16 17:53:18,613 - lava_callback - INFO - Completed processing callback for node 69e1218f2eed175ae971b494 INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48574 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:53:45,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:53:45,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:54:09,168 - lava_callback - INFO - Received callback for node 69de7f3df6535ffd5b3ee762 INFO: 172.21.0.1:40124 - "POST /node/69de7f3df6535ffd5b3ee762 HTTP/1.0" 202 Accepted 2026-04-16 17:54:09,174 - lava_callback - INFO - Starting async job submit for node 69de7f3df6535ffd5b3ee762 2026-04-16 17:54:09,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:54:09,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7f3df6535ffd5b3ee762 HTTP/1.1" 200 None 2026-04-16 17:54:09,190 - lava_callback - DEBUG - Processing node 69de7f3df6535ffd5b3ee762: baseline-arm64-baylibre 2026-04-16 17:54:09,190 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7f3df6535ffd5b3ee762 2026-04-16 17:54:09,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:54:09,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7f3df6535ffd5b3ee762 HTTP/1.1" 200 None 2026-04-16 17:54:09,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:54:09,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-16 17:54:09,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:54:09,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7f3df6535ffd5b3ee762 HTTP/1.1" 200 None 2026-04-16 17:54:09,240 - lava_callback - ERROR - Error processing callback for node 69de7f3df6535ffd5b3ee762: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39996 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:55:32,056 - lava_callback - INFO - Received callback for node 69de7f8ef6535ffd5b3ee793 INFO: 172.21.0.1:50016 - "POST /node/69de7f8ef6535ffd5b3ee793 HTTP/1.0" 202 Accepted 2026-04-16 17:55:32,062 - lava_callback - INFO - Starting async job submit for node 69de7f8ef6535ffd5b3ee793 2026-04-16 17:55:32,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:55:32,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7f8ef6535ffd5b3ee793 HTTP/1.1" 200 None 2026-04-16 17:55:32,078 - lava_callback - DEBUG - Processing node 69de7f8ef6535ffd5b3ee793: baseline-arm64-clabbe 2026-04-16 17:55:32,078 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7f8ef6535ffd5b3ee793 2026-04-16 17:55:32,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:55:32,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7f8ef6535ffd5b3ee793 HTTP/1.1" 200 None 2026-04-16 17:55:32,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:55:32,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-16 17:55:32,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:55:32,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7f8ef6535ffd5b3ee793 HTTP/1.1" 200 None 2026-04-16 17:55:32,157 - lava_callback - ERROR - Error processing callback for node 69de7f8ef6535ffd5b3ee793: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41668 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:56:52,137 - lava_callback - INFO - Received callback for node 69de7fd6f6535ffd5b3ee7f6 INFO: 172.21.0.1:58280 - "POST /node/69de7fd6f6535ffd5b3ee7f6 HTTP/1.0" 202 Accepted 2026-04-16 17:56:52,143 - lava_callback - INFO - Starting async job submit for node 69de7fd6f6535ffd5b3ee7f6 2026-04-16 17:56:52,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:56:52,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7fd6f6535ffd5b3ee7f6 HTTP/1.1" 200 None 2026-04-16 17:56:52,159 - lava_callback - DEBUG - Processing node 69de7fd6f6535ffd5b3ee7f6: baseline-arm64-clabbe 2026-04-16 17:56:52,159 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de7fd6f6535ffd5b3ee7f6 2026-04-16 17:56:52,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:56:52,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de7fd6f6535ffd5b3ee7f6 HTTP/1.1" 200 None 2026-04-16 17:56:52,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:56:52,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-16 17:56:52,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:56:52,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de7fd6f6535ffd5b3ee7f6 HTTP/1.1" 200 None 2026-04-16 17:56:52,228 - lava_callback - ERROR - Error processing callback for node 69de7fd6f6535ffd5b3ee7f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52736 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:57:48,338 - lava_callback - INFO - Received callback for node 69e122dd2eed175ae971b518 INFO: 172.21.0.1:52752 - "POST /node/69e122dd2eed175ae971b518 HTTP/1.0" 202 Accepted 2026-04-16 17:57:48,345 - lava_callback - INFO - Starting async job submit for node 69e122dd2eed175ae971b518 2026-04-16 17:57:48,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:57:48,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e122dd2eed175ae971b518 HTTP/1.1" 200 None 2026-04-16 17:57:48,389 - lava_callback - DEBUG - Processing node 69e122dd2eed175ae971b518: baseline-arm64 2026-04-16 17:57:48,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:57:48,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:57:48,876 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e122dd2eed175ae971b518/log.txt.gz 2026-04-16 17:57:49,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:57:49,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:57:49,290 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e122dd2eed175ae971b518/lava-logs.yaml 2026-04-16 17:57:49,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 17:57:49,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 17:57:49,402 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e122dd2eed175ae971b518/lava_callback.json.gz 2026-04-16 17:57:49,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:57:49,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e122dd2eed175ae971b518 HTTP/1.1" 200 None 2026-04-16 17:57:49,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:57:49,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 17:57:49,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:57:49,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e122dd2eed175ae971b518 HTTP/1.1" 200 None 2026-04-16 17:57:49,484 - lava_callback - INFO - Completed processing callback for node 69e122dd2eed175ae971b518 INFO: 172.21.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34272 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:58:12,147 - lava_callback - INFO - Received callback for node 69de801ff6535ffd5b3ee840 INFO: 172.21.0.1:38564 - "POST /node/69de801ff6535ffd5b3ee840 HTTP/1.0" 202 Accepted 2026-04-16 17:58:12,152 - lava_callback - INFO - Starting async job submit for node 69de801ff6535ffd5b3ee840 2026-04-16 17:58:12,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:58:12,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de801ff6535ffd5b3ee840 HTTP/1.1" 200 None 2026-04-16 17:58:12,181 - lava_callback - DEBUG - Processing node 69de801ff6535ffd5b3ee840: baseline-arm64-clabbe 2026-04-16 17:58:12,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de801ff6535ffd5b3ee840 2026-04-16 17:58:12,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:58:12,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de801ff6535ffd5b3ee840 HTTP/1.1" 200 None 2026-04-16 17:58:12,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:58:12,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-16 17:58:12,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:58:12,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de801ff6535ffd5b3ee840 HTTP/1.1" 200 None 2026-04-16 17:58:12,232 - lava_callback - ERROR - Error processing callback for node 69de801ff6535ffd5b3ee840: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38578 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 17:58:15,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:58:16,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38456 - "GET / HTTP/1.0" 200 OK 2026-04-16 17:59:12,128 - lava_callback - INFO - Received callback for node 69de8066f6535ffd5b3ee899 INFO: 172.21.0.1:43928 - "POST /node/69de8066f6535ffd5b3ee899 HTTP/1.0" 202 Accepted 2026-04-16 17:59:12,133 - lava_callback - INFO - Starting async job submit for node 69de8066f6535ffd5b3ee899 2026-04-16 17:59:12,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:59:12,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de8066f6535ffd5b3ee899 HTTP/1.1" 200 None 2026-04-16 17:59:12,150 - lava_callback - DEBUG - Processing node 69de8066f6535ffd5b3ee899: baseline-arm64-clabbe 2026-04-16 17:59:12,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de8066f6535ffd5b3ee899 2026-04-16 17:59:12,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:59:12,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de8066f6535ffd5b3ee899 HTTP/1.1" 200 None 2026-04-16 17:59:12,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:59:12,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-16 17:59:12,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 17:59:12,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de8066f6535ffd5b3ee899 HTTP/1.1" 200 None 2026-04-16 17:59:12,199 - lava_callback - ERROR - Error processing callback for node 69de8066f6535ffd5b3ee899: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:00:32,372 - lava_callback - INFO - Received callback for node 69de80acf6535ffd5b3ee8e0 INFO: 172.21.0.1:52540 - "POST /node/69de80acf6535ffd5b3ee8e0 HTTP/1.0" 202 Accepted 2026-04-16 18:00:32,378 - lava_callback - INFO - Starting async job submit for node 69de80acf6535ffd5b3ee8e0 2026-04-16 18:00:32,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:00:32,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de80acf6535ffd5b3ee8e0 HTTP/1.1" 200 None 2026-04-16 18:00:32,396 - lava_callback - DEBUG - Processing node 69de80acf6535ffd5b3ee8e0: baseline-arm64-clabbe 2026-04-16 18:00:32,396 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de80acf6535ffd5b3ee8e0 2026-04-16 18:00:32,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:00:32,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de80acf6535ffd5b3ee8e0 HTTP/1.1" 200 None 2026-04-16 18:00:32,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:00:32,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-16 18:00:32,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:00:32,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de80acf6535ffd5b3ee8e0 HTTP/1.1" 200 None 2026-04-16 18:00:32,447 - lava_callback - ERROR - Error processing callback for node 69de80acf6535ffd5b3ee8e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58268 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:01:52,290 - lava_callback - INFO - Received callback for node 69de80faf6535ffd5b3ee936 INFO: 172.21.0.1:37632 - "POST /node/69de80faf6535ffd5b3ee936 HTTP/1.0" 202 Accepted 2026-04-16 18:01:52,296 - lava_callback - INFO - Starting async job submit for node 69de80faf6535ffd5b3ee936 2026-04-16 18:01:52,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:01:52,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de80faf6535ffd5b3ee936 HTTP/1.1" 200 None 2026-04-16 18:01:52,312 - lava_callback - DEBUG - Processing node 69de80faf6535ffd5b3ee936: baseline-arm64-clabbe 2026-04-16 18:01:52,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de80faf6535ffd5b3ee936 2026-04-16 18:01:52,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:01:52,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de80faf6535ffd5b3ee936 HTTP/1.1" 200 None 2026-04-16 18:01:52,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:01:52,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-16 18:01:52,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:01:52,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de80faf6535ffd5b3ee936 HTTP/1.1" 200 None 2026-04-16 18:01:52,362 - lava_callback - ERROR - Error processing callback for node 69de80faf6535ffd5b3ee936: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60394 - "GET /node/6991f78801ff1e8e0859d3c5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60402 - "GET /node/69936c44cebe99dd8e0677e4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58504 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:03:01,590 - lava_callback - INFO - Received callback for node 69e120a42eed175ae971b429 INFO: 172.21.0.1:41890 - "POST /node/69e120a42eed175ae971b429 HTTP/1.0" 202 Accepted 2026-04-16 18:03:01,597 - lava_callback - INFO - Starting async job submit for node 69e120a42eed175ae971b429 2026-04-16 18:03:01,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:03:01,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e120a42eed175ae971b429 HTTP/1.1" 200 None 2026-04-16 18:03:01,656 - lava_callback - DEBUG - Processing node 69e120a42eed175ae971b429: baseline-x86 2026-04-16 18:03:02,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:03:02,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:03:02,676 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e120a42eed175ae971b429/log.txt.gz 2026-04-16 18:03:03,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:03:03,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:03:03,385 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e120a42eed175ae971b429/lava-logs.yaml 2026-04-16 18:03:03,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:03:03,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:03:03,538 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e120a42eed175ae971b429/lava_callback.json.gz DEBUG: Setup failed for 69e120a42eed175ae971b429. Transitting job node result: incomplete -> fail 2026-04-16 18:03:03,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:03:03,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e120a42eed175ae971b429 HTTP/1.1" 200 None 2026-04-16 18:03:03,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:03:03,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10be52eed175ae971a5b3 HTTP/1.1" 200 None 2026-04-16 18:03:03,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:03:03,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e120a42eed175ae971b429 HTTP/1.1" 200 None 2026-04-16 18:03:03,759 - lava_callback - INFO - Completed processing callback for node 69e120a42eed175ae971b429 INFO: 172.21.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49388 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 18:03:16,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:03:16,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35448 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:04:32,378 - lava_callback - INFO - Received callback for node 69de819bf6535ffd5b3ee986 INFO: 172.21.0.1:47006 - "POST /node/69de819bf6535ffd5b3ee986 HTTP/1.0" 202 Accepted 2026-04-16 18:04:32,385 - lava_callback - INFO - Starting async job submit for node 69de819bf6535ffd5b3ee986 2026-04-16 18:04:32,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:04:32,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de819bf6535ffd5b3ee986 HTTP/1.1" 200 None 2026-04-16 18:04:32,405 - lava_callback - DEBUG - Processing node 69de819bf6535ffd5b3ee986: baseline-arm64-clabbe 2026-04-16 18:04:32,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de819bf6535ffd5b3ee986 2026-04-16 18:04:32,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:04:32,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de819bf6535ffd5b3ee986 HTTP/1.1" 200 None 2026-04-16 18:04:32,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:04:32,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d680202cda61b443d5b59d HTTP/1.1" 200 None 2026-04-16 18:04:32,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:04:32,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de819bf6535ffd5b3ee986 HTTP/1.1" 200 None 2026-04-16 18:04:32,455 - lava_callback - ERROR - Error processing callback for node 69de819bf6535ffd5b3ee986: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47028 - "GET /node/698a8e2fd9a1cfa777a241eb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51552 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:05:56,136 - lava_callback - INFO - Received callback for node 69e124fb2eed175ae971b62a INFO: 172.21.0.1:50468 - "POST /node/69e124fb2eed175ae971b62a HTTP/1.0" 202 Accepted 2026-04-16 18:05:56,145 - lava_callback - INFO - Starting async job submit for node 69e124fb2eed175ae971b62a 2026-04-16 18:05:56,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:05:56,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e124fb2eed175ae971b62a HTTP/1.1" 200 None 2026-04-16 18:05:56,164 - lava_callback - DEBUG - Processing node 69e124fb2eed175ae971b62a: baseline-arm 2026-04-16 18:05:56,173 - lava_callback - WARNING - Failed to upload log 2026-04-16 18:05:56,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:05:56,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:05:56,266 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fb2eed175ae971b62a/lava-logs.yaml 2026-04-16 18:05:56,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:05:56,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:05:56,374 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fb2eed175ae971b62a/lava_callback.json.gz 2026-04-16 18:05:56,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:05:56,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e124fb2eed175ae971b62a HTTP/1.1" 200 None 2026-04-16 18:05:56,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:05:56,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:05:56,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:05:56,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e124fb2eed175ae971b62a HTTP/1.1" 200 None 2026-04-16 18:05:56,446 - lava_callback - INFO - Completed processing callback for node 69e124fb2eed175ae971b62a INFO: 172.21.0.1:50472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50032 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:06:09,589 - lava_callback - INFO - Received callback for node 69e123c52eed175ae971b58d INFO: 172.21.0.1:50034 - "POST /node/69e123c52eed175ae971b58d HTTP/1.0" 202 Accepted 2026-04-16 18:06:09,596 - lava_callback - INFO - Starting async job submit for node 69e123c52eed175ae971b58d 2026-04-16 18:06:09,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:06:09,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e123c52eed175ae971b58d HTTP/1.1" 200 None 2026-04-16 18:06:09,668 - lava_callback - DEBUG - Processing node 69e123c52eed175ae971b58d: baseline-arm64 2026-04-16 18:06:10,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:06:10,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:06:10,202 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e123c52eed175ae971b58d/log.txt.gz 2026-04-16 18:06:10,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:06:10,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:06:10,658 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e123c52eed175ae971b58d/lava-logs.yaml 2026-04-16 18:06:10,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:06:10,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:06:10,883 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e123c52eed175ae971b58d/lava_callback.json.gz DEBUG: Setup failed for 69e123c52eed175ae971b58d. Transitting job node result: incomplete -> fail 2026-04-16 18:06:11,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:06:11,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e123c52eed175ae971b58d HTTP/1.1" 200 None 2026-04-16 18:06:11,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:06:11,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 18:06:11,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:06:11,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e123c52eed175ae971b58d HTTP/1.1" 200 None 2026-04-16 18:06:11,281 - lava_callback - INFO - Completed processing callback for node 69e123c52eed175ae971b58d INFO: 172.21.0.1:39060 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 18:06:16,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:06:16,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41250 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:06:34,076 - lava_callback - INFO - Received callback for node 69e124fe2eed175ae971b636 INFO: 172.21.0.1:41342 - "POST /node/69e124fe2eed175ae971b636 HTTP/1.0" 202 Accepted 2026-04-16 18:06:34,125 - lava_callback - INFO - Starting async job submit for node 69e124fe2eed175ae971b636 2026-04-16 18:06:34,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:06:34,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e124fe2eed175ae971b636 HTTP/1.1" 200 None 2026-04-16 18:06:34,172 - lava_callback - DEBUG - Processing node 69e124fe2eed175ae971b636: baseline-arm 2026-04-16 18:06:34,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:06:34,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:06:34,400 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fe2eed175ae971b636/log.txt.gz 2026-04-16 18:06:34,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:06:34,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:06:34,630 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fe2eed175ae971b636/lava-logs.yaml 2026-04-16 18:06:34,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:06:34,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:06:34,739 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fe2eed175ae971b636/lava_callback.json.gz 2026-04-16 18:06:34,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:06:34,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e124fe2eed175ae971b636 HTTP/1.1" 200 None 2026-04-16 18:06:34,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:06:34,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:06:34,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:06:34,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e124fe2eed175ae971b636 HTTP/1.1" 200 None 2026-04-16 18:06:34,841 - lava_callback - INFO - Completed processing callback for node 69e124fe2eed175ae971b636 INFO: 172.21.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:06:46,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:06:46,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34562 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:06:51,325 - lava_callback - INFO - Received callback for node 69e124fb2eed175ae971b62d INFO: 172.21.0.1:36450 - "POST /node/69e124fb2eed175ae971b62d HTTP/1.0" 202 Accepted 2026-04-16 18:06:51,373 - lava_callback - INFO - Starting async job submit for node 69e124fb2eed175ae971b62d 2026-04-16 18:06:51,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:06:51,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e124fb2eed175ae971b62d HTTP/1.1" 200 None 2026-04-16 18:06:51,432 - lava_callback - DEBUG - Processing node 69e124fb2eed175ae971b62d: baseline-arm 2026-04-16 18:06:51,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:06:51,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:06:51,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fb2eed175ae971b62d/log.txt.gz 2026-04-16 18:06:51,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:06:51,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:06:51,916 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fb2eed175ae971b62d/lava-logs.yaml 2026-04-16 18:06:51,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:06:52,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:06:52,009 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fb2eed175ae971b62d/lava_callback.json.gz 2026-04-16 18:06:52,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:06:52,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e124fb2eed175ae971b62d HTTP/1.1" 200 None 2026-04-16 18:06:52,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:06:52,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:06:52,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:06:52,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e124fb2eed175ae971b62d HTTP/1.1" 200 None 2026-04-16 18:06:52,241 - lava_callback - INFO - Completed processing callback for node 69e124fb2eed175ae971b62d INFO: 172.21.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55244 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 18:07:16,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:16,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:07:19,455 - lava_callback - INFO - Received callback for node 69e124fd2eed175ae971b633 INFO: 172.21.0.1:55250 - "POST /node/69e124fd2eed175ae971b633 HTTP/1.0" 202 Accepted 2026-04-16 18:07:19,464 - lava_callback - INFO - Starting async job submit for node 69e124fd2eed175ae971b633 2026-04-16 18:07:19,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:19,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e124fd2eed175ae971b633 HTTP/1.1" 200 None 2026-04-16 18:07:19,504 - lava_callback - DEBUG - Processing node 69e124fd2eed175ae971b633: baseline-arm 2026-04-16 18:07:19,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:19,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:19,818 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fd2eed175ae971b633/log.txt.gz 2026-04-16 18:07:19,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:20,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:20,127 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fd2eed175ae971b633/lava-logs.yaml 2026-04-16 18:07:20,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:20,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:20,249 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fd2eed175ae971b633/lava_callback.json.gz 2026-04-16 18:07:20,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:20,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e124fd2eed175ae971b633 HTTP/1.1" 200 None 2026-04-16 18:07:20,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:20,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:07:20,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:20,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e124fd2eed175ae971b633 HTTP/1.1" 200 None 2026-04-16 18:07:20,337 - lava_callback - INFO - Completed processing callback for node 69e124fd2eed175ae971b633 2026-04-16 18:07:21,379 - lava_callback - INFO - Received callback for node 69e124fa2eed175ae971b61f INFO: 172.21.0.1:41562 - "POST /node/69e124fa2eed175ae971b61f HTTP/1.0" 202 Accepted 2026-04-16 18:07:21,389 - lava_callback - INFO - Starting async job submit for node 69e124fa2eed175ae971b61f 2026-04-16 18:07:21,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:21,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e124fa2eed175ae971b61f HTTP/1.1" 200 None 2026-04-16 18:07:21,441 - lava_callback - DEBUG - Processing node 69e124fa2eed175ae971b61f: baseline-arm 2026-04-16 18:07:21,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:21,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:21,768 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fa2eed175ae971b61f/log.txt.gz 2026-04-16 18:07:21,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:22,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:22,018 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fa2eed175ae971b61f/lava-logs.yaml 2026-04-16 18:07:22,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:22,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:22,122 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fa2eed175ae971b61f/lava_callback.json.gz 2026-04-16 18:07:22,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:22,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e124fa2eed175ae971b61f HTTP/1.1" 200 None 2026-04-16 18:07:22,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:22,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:07:22,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:22,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e124fa2eed175ae971b61f HTTP/1.1" 200 None 2026-04-16 18:07:22,203 - lava_callback - INFO - Completed processing callback for node 69e124fa2eed175ae971b61f INFO: 172.21.0.1:41564 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:07:29,322 - lava_callback - INFO - Received callback for node 69e1251f2eed175ae971b6ce INFO: 172.21.0.1:41578 - "POST /node/69e1251f2eed175ae971b6ce HTTP/1.0" 202 Accepted 2026-04-16 18:07:29,369 - lava_callback - INFO - Starting async job submit for node 69e1251f2eed175ae971b6ce 2026-04-16 18:07:29,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:29,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1251f2eed175ae971b6ce HTTP/1.1" 200 None 2026-04-16 18:07:29,405 - lava_callback - DEBUG - Processing node 69e1251f2eed175ae971b6ce: baseline-arm-pengutronix 2026-04-16 18:07:29,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:29,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:29,610 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e1251f2eed175ae971b6ce/log.txt.gz 2026-04-16 18:07:29,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:29,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:29,785 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e1251f2eed175ae971b6ce/lava-logs.yaml 2026-04-16 18:07:29,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:29,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:29,877 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e1251f2eed175ae971b6ce/lava_callback.json.gz 2026-04-16 18:07:29,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:29,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1251f2eed175ae971b6ce HTTP/1.1" 200 None 2026-04-16 18:07:29,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:29,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:07:29,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:29,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1251f2eed175ae971b6ce HTTP/1.1" 200 None 2026-04-16 18:07:29,949 - lava_callback - INFO - Completed processing callback for node 69e1251f2eed175ae971b6ce 2026-04-16 18:07:33,321 - lava_callback - INFO - Received callback for node 69e1251e2eed175ae971b6cb INFO: 172.21.0.1:54380 - "POST /node/69e1251e2eed175ae971b6cb HTTP/1.0" 202 Accepted 2026-04-16 18:07:33,331 - lava_callback - INFO - Starting async job submit for node 69e1251e2eed175ae971b6cb 2026-04-16 18:07:33,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:33,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1251e2eed175ae971b6cb HTTP/1.1" 200 None 2026-04-16 18:07:33,377 - lava_callback - DEBUG - Processing node 69e1251e2eed175ae971b6cb: baseline-arm-pengutronix 2026-04-16 18:07:33,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:33,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:33,688 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e1251e2eed175ae971b6cb/log.txt.gz 2026-04-16 18:07:33,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:33,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:33,936 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e1251e2eed175ae971b6cb/lava-logs.yaml 2026-04-16 18:07:33,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:34,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:34,046 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e1251e2eed175ae971b6cb/lava_callback.json.gz 2026-04-16 18:07:34,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:34,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1251e2eed175ae971b6cb HTTP/1.1" 200 None 2026-04-16 18:07:34,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:34,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:07:34,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:34,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1251e2eed175ae971b6cb HTTP/1.1" 200 None 2026-04-16 18:07:34,132 - lava_callback - INFO - Completed processing callback for node 69e1251e2eed175ae971b6cb INFO: 172.21.0.1:54388 - "GET /node/6985e3a571989fb14149bac0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54402 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:07:38,116 - lava_callback - INFO - Received callback for node 69e1250c2eed175ae971b65b INFO: 172.21.0.1:54418 - "POST /node/69e1250c2eed175ae971b65b HTTP/1.0" 202 Accepted 2026-04-16 18:07:38,123 - lava_callback - INFO - Starting async job submit for node 69e1250c2eed175ae971b65b 2026-04-16 18:07:38,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:38,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1250c2eed175ae971b65b HTTP/1.1" 200 None 2026-04-16 18:07:38,165 - lava_callback - DEBUG - Processing node 69e1250c2eed175ae971b65b: baseline-arm-broonie 2026-04-16 18:07:38,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:38,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:38,533 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e1250c2eed175ae971b65b/log.txt.gz 2026-04-16 18:07:38,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:38,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:38,793 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e1250c2eed175ae971b65b/lava-logs.yaml 2026-04-16 18:07:38,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:38,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:38,893 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e1250c2eed175ae971b65b/lava_callback.json.gz 2026-04-16 18:07:38,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:38,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1250c2eed175ae971b65b HTTP/1.1" 200 None 2026-04-16 18:07:38,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:38,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:07:38,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:38,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1250c2eed175ae971b65b HTTP/1.1" 200 None 2026-04-16 18:07:38,968 - lava_callback - INFO - Completed processing callback for node 69e1250c2eed175ae971b65b INFO: 172.21.0.1:34562 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:07:46,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:46,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:34578 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:07:56,337 - lava_callback - INFO - Received callback for node 69e1250f2eed175ae971b661 INFO: 172.21.0.1:34560 - "POST /node/69e1250f2eed175ae971b661 HTTP/1.0" 202 Accepted 2026-04-16 18:07:56,344 - lava_callback - INFO - Starting async job submit for node 69e1250f2eed175ae971b661 2026-04-16 18:07:56,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:56,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1250f2eed175ae971b661 HTTP/1.1" 200 None 2026-04-16 18:07:56,380 - lava_callback - DEBUG - Processing node 69e1250f2eed175ae971b661: baseline-arm-broonie INFO: 172.21.0.1:34564 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:07:56,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:56,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:56,772 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e1250f2eed175ae971b661/log.txt.gz 2026-04-16 18:07:56,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:07:57,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:57,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e1250f2eed175ae971b661/lava-logs.yaml 2026-04-16 18:07:57,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:34580 - "GET /node/6985bc0271989fb141497506%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-16 18:07:57,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:07:57,193 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e1250f2eed175ae971b661/lava_callback.json.gz 2026-04-16 18:07:57,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:57,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1250f2eed175ae971b661 HTTP/1.1" 200 None 2026-04-16 18:07:57,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:57,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:07:57,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:07:57,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1250f2eed175ae971b661 HTTP/1.1" 200 None 2026-04-16 18:07:57,286 - lava_callback - INFO - Completed processing callback for node 69e1250f2eed175ae971b661 INFO: 172.21.0.1:34586 - "GET /node/693fc674575bc060ce148a1e%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-16 18:08:00,446 - lava_callback - INFO - Received callback for node 69e1250d2eed175ae971b65e INFO: 172.21.0.1:46132 - "POST /node/69e1250d2eed175ae971b65e HTTP/1.0" 202 Accepted 2026-04-16 18:08:00,452 - lava_callback - INFO - Starting async job submit for node 69e1250d2eed175ae971b65e 2026-04-16 18:08:00,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:00,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1250d2eed175ae971b65e HTTP/1.1" 200 None 2026-04-16 18:08:00,495 - lava_callback - DEBUG - Processing node 69e1250d2eed175ae971b65e: baseline-arm-broonie 2026-04-16 18:08:00,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:08:00,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:08:00,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e1250d2eed175ae971b65e/log.txt.gz 2026-04-16 18:08:00,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:08:01,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:08:01,065 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e1250d2eed175ae971b65e/lava-logs.yaml 2026-04-16 18:08:01,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:08:01,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:08:01,174 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e1250d2eed175ae971b65e/lava_callback.json.gz 2026-04-16 18:08:01,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:01,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1250d2eed175ae971b65e HTTP/1.1" 200 None 2026-04-16 18:08:01,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:01,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:08:01,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:01,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1250d2eed175ae971b65e HTTP/1.1" 200 None 2026-04-16 18:08:01,256 - lava_callback - INFO - Completed processing callback for node 69e1250d2eed175ae971b65e 2026-04-16 18:08:04,214 - lava_callback - INFO - Received callback for node 69e1251a2eed175ae971b6bd INFO: 172.21.0.1:46148 - "POST /node/69e1251a2eed175ae971b6bd HTTP/1.0" 202 Accepted 2026-04-16 18:08:04,224 - lava_callback - INFO - Starting async job submit for node 69e1251a2eed175ae971b6bd 2026-04-16 18:08:04,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:04,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1251a2eed175ae971b6bd HTTP/1.1" 200 None 2026-04-16 18:08:04,264 - lava_callback - DEBUG - Processing node 69e1251a2eed175ae971b6bd: baseline-arm-kontron 2026-04-16 18:08:04,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:08:04,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:08:04,555 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e1251a2eed175ae971b6bd/log.txt.gz 2026-04-16 18:08:04,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:08:04,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:08:04,845 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e1251a2eed175ae971b6bd/lava-logs.yaml 2026-04-16 18:08:04,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:08:04,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:08:04,945 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e1251a2eed175ae971b6bd/lava_callback.json.gz 2026-04-16 18:08:04,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:05,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1251a2eed175ae971b6bd HTTP/1.1" 200 None 2026-04-16 18:08:05,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:05,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:08:05,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:05,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1251a2eed175ae971b6bd HTTP/1.1" 200 None 2026-04-16 18:08:05,040 - lava_callback - INFO - Completed processing callback for node 69e1251a2eed175ae971b6bd 2026-04-16 18:08:05,342 - lava_callback - INFO - Received callback for node 69e1251b2eed175ae971b6c0 INFO: 172.21.0.1:46150 - "POST /node/69e1251b2eed175ae971b6c0 HTTP/1.0" 202 Accepted 2026-04-16 18:08:05,348 - lava_callback - INFO - Starting async job submit for node 69e1251b2eed175ae971b6c0 2026-04-16 18:08:05,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:05,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1251b2eed175ae971b6c0 HTTP/1.1" 200 None 2026-04-16 18:08:05,385 - lava_callback - DEBUG - Processing node 69e1251b2eed175ae971b6c0: baseline-arm-kontron 2026-04-16 18:08:05,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:08:05,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:08:05,663 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e1251b2eed175ae971b6c0/log.txt.gz 2026-04-16 18:08:05,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:08:05,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:08:05,903 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e1251b2eed175ae971b6c0/lava-logs.yaml 2026-04-16 18:08:05,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:08:06,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:08:06,005 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e1251b2eed175ae971b6c0/lava_callback.json.gz 2026-04-16 18:08:06,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:06,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1251b2eed175ae971b6c0 HTTP/1.1" 200 None 2026-04-16 18:08:06,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:06,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:08:06,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:06,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1251b2eed175ae971b6c0 HTTP/1.1" 200 None 2026-04-16 18:08:06,091 - lava_callback - INFO - Completed processing callback for node 69e1251b2eed175ae971b6c0 INFO: 172.21.0.1:46152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49706 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 18:08:16,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:16,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:49722 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:08:17,545 - lava_callback - INFO - Received callback for node 69e1250b2eed175ae971b658 INFO: 172.21.0.1:49736 - "POST /node/69e1250b2eed175ae971b658 HTTP/1.0" 202 Accepted 2026-04-16 18:08:17,551 - lava_callback - INFO - Starting async job submit for node 69e1250b2eed175ae971b658 2026-04-16 18:08:17,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:17,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1250b2eed175ae971b658 HTTP/1.1" 200 None 2026-04-16 18:08:17,588 - lava_callback - DEBUG - Processing node 69e1250b2eed175ae971b658: baseline-arm-broonie 2026-04-16 18:08:17,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:08:17,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:08:17,882 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e1250b2eed175ae971b658/log.txt.gz 2026-04-16 18:08:18,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:08:18,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:08:18,184 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e1250b2eed175ae971b658/lava-logs.yaml 2026-04-16 18:08:18,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:08:18,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:08:18,334 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e1250b2eed175ae971b658/lava_callback.json.gz 2026-04-16 18:08:18,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:18,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1250b2eed175ae971b658 HTTP/1.1" 200 None 2026-04-16 18:08:18,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:18,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:08:18,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:18,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1250b2eed175ae971b658 HTTP/1.1" 200 None 2026-04-16 18:08:18,423 - lava_callback - INFO - Completed processing callback for node 69e1250b2eed175ae971b658 INFO: 172.21.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:08:46,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:46,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51140 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:08:58,319 - lava_callback - INFO - Received callback for node 69e121902eed175ae971b497 INFO: 172.21.0.1:51148 - "POST /node/69e121902eed175ae971b497 HTTP/1.0" 202 Accepted 2026-04-16 18:08:58,329 - lava_callback - INFO - Starting async job submit for node 69e121902eed175ae971b497 2026-04-16 18:08:58,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:58,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e121902eed175ae971b497 HTTP/1.1" 200 None 2026-04-16 18:08:58,422 - lava_callback - DEBUG - Processing node 69e121902eed175ae971b497: ltp-smoke 2026-04-16 18:08:58,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:08:59,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:08:59,036 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e121902eed175ae971b497/log.txt.gz 2026-04-16 18:08:59,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:08:59,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:08:59,446 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e121902eed175ae971b497/lava-logs.yaml 2026-04-16 18:08:59,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:08:59,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:08:59,577 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e121902eed175ae971b497/lava_callback.json.gz 2026-04-16 18:08:59,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:59,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e121902eed175ae971b497 HTTP/1.1" 200 None 2026-04-16 18:08:59,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:59,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bbe2eed175ae971a58b HTTP/1.1" 200 None 2026-04-16 18:08:59,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:08:59,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e121902eed175ae971b497 HTTP/1.1" 200 None 2026-04-16 18:08:59,848 - lava_callback - INFO - Completed processing callback for node 69e121902eed175ae971b497 INFO: 172.21.0.1:35374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46798 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 18:09:16,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:09:16,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46808 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:09:24,757 - lava_callback - INFO - Received callback for node 69e125362eed175ae971b6e8 INFO: 172.21.0.1:43658 - "POST /node/69e125362eed175ae971b6e8 HTTP/1.0" 202 Accepted 2026-04-16 18:09:24,768 - lava_callback - INFO - Starting async job submit for node 69e125362eed175ae971b6e8 2026-04-16 18:09:24,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:09:24,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125362eed175ae971b6e8 HTTP/1.1" 200 None 2026-04-16 18:09:24,809 - lava_callback - DEBUG - Processing node 69e125362eed175ae971b6e8: ltp-dio 2026-04-16 18:09:25,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:09:25,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:09:25,351 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69e125362eed175ae971b6e8/log.txt.gz 2026-04-16 18:09:25,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:09:25,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:09:25,806 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69e125362eed175ae971b6e8/lava-logs.yaml 2026-04-16 18:09:25,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:09:25,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:09:25,966 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69e125362eed175ae971b6e8/lava_callback.json.gz 2026-04-16 18:09:25,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:09:26,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125362eed175ae971b6e8 HTTP/1.1" 200 None 2026-04-16 18:09:26,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:09:26,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:09:26,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:09:26,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125362eed175ae971b6e8 HTTP/1.1" 200 None 2026-04-16 18:09:26,046 - lava_callback - INFO - Completed processing callback for node 69e125362eed175ae971b6e8 INFO: 172.21.0.1:43670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34512 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:09:46,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:09:46,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET /node/6988c5b49fc35f969e1eeb9f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46176 - "GET /node/695410799c6929bd9fb7029f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60852 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 18:10:16,226 - lava_callback - INFO - Received callback for node 69e1122a2eed175ae971a6df INFO: 172.21.0.1:60866 - "POST /node/69e1122a2eed175ae971a6df HTTP/1.0" 202 Accepted 2026-04-16 18:10:16,236 - lava_callback - INFO - Starting async job submit for node 69e1122a2eed175ae971a6df 2026-04-16 18:10:16,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:10:16,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1122a2eed175ae971a6df HTTP/1.1" 200 None 2026-04-16 18:10:16,288 - lava_callback - DEBUG - Processing node 69e1122a2eed175ae971a6df: baseline-arm64-broonie INFO: 172.21.0.1:60876 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:10:16,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:10:16,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:10:16,687 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e1122a2eed175ae971a6df/log.txt.gz 2026-04-16 18:10:16,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:10:16,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:10:17,001 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e1122a2eed175ae971a6df/lava-logs.yaml 2026-04-16 18:10:17,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:10:17,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:10:17,117 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e1122a2eed175ae971a6df/lava_callback.json.gz 2026-04-16 18:10:17,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:10:17,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1122a2eed175ae971a6df HTTP/1.1" 200 None 2026-04-16 18:10:17,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:10:17,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 18:10:17,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:10:17,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1122a2eed175ae971a6df HTTP/1.1" 200 None 2026-04-16 18:10:17,199 - lava_callback - INFO - Completed processing callback for node 69e1122a2eed175ae971a6df INFO: 172.21.0.1:53734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55348 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:10:46,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:10:46,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55356 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:10:56,289 - lava_callback - INFO - Received callback for node 69e125322eed175ae971b6df INFO: 172.21.0.1:58254 - "POST /node/69e125322eed175ae971b6df HTTP/1.0" 202 Accepted 2026-04-16 18:10:56,296 - lava_callback - INFO - Starting async job submit for node 69e125322eed175ae971b6df 2026-04-16 18:10:56,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:10:56,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125322eed175ae971b6df HTTP/1.1" 200 None 2026-04-16 18:10:56,350 - lava_callback - DEBUG - Processing node 69e125322eed175ae971b6df: ltp-controllers INFO: 172.21.0.1:58268 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:10:56,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:10:57,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:10:57,019 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69e125322eed175ae971b6df/log.txt.gz 2026-04-16 18:10:57,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:10:57,454 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:10:57,456 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69e125322eed175ae971b6df/lava-logs.yaml 2026-04-16 18:10:57,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:10:57,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:10:57,583 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69e125322eed175ae971b6df/lava_callback.json.gz 2026-04-16 18:10:57,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:10:57,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125322eed175ae971b6df HTTP/1.1" 200 None 2026-04-16 18:10:57,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:10:57,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:10:57,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:10:57,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125322eed175ae971b6df HTTP/1.1" 200 None 2026-04-16 18:10:57,661 - lava_callback - INFO - Completed processing callback for node 69e125322eed175ae971b6df 2026-04-16 18:10:58,213 - lava_callback - INFO - Received callback for node 69e1252f2eed175ae971b6d9 INFO: 172.21.0.1:58272 - "POST /node/69e1252f2eed175ae971b6d9 HTTP/1.0" 202 Accepted 2026-04-16 18:10:58,220 - lava_callback - INFO - Starting async job submit for node 69e1252f2eed175ae971b6d9 2026-04-16 18:10:58,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:10:58,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1252f2eed175ae971b6d9 HTTP/1.1" 200 None 2026-04-16 18:10:58,263 - lava_callback - DEBUG - Processing node 69e1252f2eed175ae971b6d9: ltp-cap_bounds 2026-04-16 18:10:58,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:10:58,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:10:58,786 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e1252f2eed175ae971b6d9/log.txt.gz 2026-04-16 18:10:59,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:10:59,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:10:59,294 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e1252f2eed175ae971b6d9/lava-logs.yaml 2026-04-16 18:10:59,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:10:59,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:10:59,424 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e1252f2eed175ae971b6d9/lava_callback.json.gz 2026-04-16 18:10:59,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:10:59,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1252f2eed175ae971b6d9 HTTP/1.1" 200 None 2026-04-16 18:10:59,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:10:59,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:10:59,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:10:59,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1252f2eed175ae971b6d9 HTTP/1.1" 200 None 2026-04-16 18:10:59,510 - lava_callback - INFO - Completed processing callback for node 69e1252f2eed175ae971b6d9 INFO: 172.21.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37194 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 18:11:16,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:11:16,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:11:16,543 - lava_callback - INFO - Received callback for node 69e125312eed175ae971b6dc INFO: 172.21.0.1:37216 - "POST /node/69e125312eed175ae971b6dc HTTP/1.0" 202 Accepted 2026-04-16 18:11:16,549 - lava_callback - INFO - Starting async job submit for node 69e125312eed175ae971b6dc 2026-04-16 18:11:16,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:11:16,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125312eed175ae971b6dc HTTP/1.1" 200 None 2026-04-16 18:11:16,594 - lava_callback - DEBUG - Processing node 69e125312eed175ae971b6dc: ltp-containers 2026-04-16 18:11:17,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:11:17,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:11:17,164 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69e125312eed175ae971b6dc/log.txt.gz 2026-04-16 18:11:17,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:11:17,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:11:17,628 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69e125312eed175ae971b6dc/lava-logs.yaml 2026-04-16 18:11:17,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:11:17,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:11:17,760 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69e125312eed175ae971b6dc/lava_callback.json.gz 2026-04-16 18:11:17,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:11:17,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125312eed175ae971b6dc HTTP/1.1" 200 None 2026-04-16 18:11:17,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:11:17,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:11:17,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:11:17,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125312eed175ae971b6dc HTTP/1.1" 200 None 2026-04-16 18:11:17,870 - lava_callback - INFO - Completed processing callback for node 69e125312eed175ae971b6dc INFO: 172.21.0.1:57754 - "GET /node/69d373312214054febe38529%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:11:36,934 - lava_callback - INFO - Received callback for node 69e125412eed175ae971b71f INFO: 172.21.0.1:37264 - "POST /node/69e125412eed175ae971b71f HTTP/1.0" 202 Accepted 2026-04-16 18:11:36,941 - lava_callback - INFO - Starting async job submit for node 69e125412eed175ae971b71f 2026-04-16 18:11:36,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:11:36,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125412eed175ae971b71f HTTP/1.1" 200 None 2026-04-16 18:11:36,993 - lava_callback - DEBUG - Processing node 69e125412eed175ae971b71f: ltp-syscalls 2026-04-16 18:11:37,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:11:37,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:11:37,862 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e125412eed175ae971b71f/log.txt.gz 2026-04-16 18:11:38,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:11:38,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:11:38,600 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e125412eed175ae971b71f/lava-logs.yaml 2026-04-16 18:11:38,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:11:38,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:11:38,741 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e125412eed175ae971b71f/lava_callback.json.gz 2026-04-16 18:11:38,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:11:38,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125412eed175ae971b71f HTTP/1.1" 200 None 2026-04-16 18:11:38,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:11:38,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:11:38,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:11:38,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125412eed175ae971b71f HTTP/1.1" 200 None 2026-04-16 18:11:38,841 - lava_callback - INFO - Completed processing callback for node 69e125412eed175ae971b71f INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:11:46,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:11:46,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36784 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 18:12:16,342 - lava_callback - INFO - Received callback for node 69e125342eed175ae971b6e2 INFO: 172.21.0.1:36800 - "POST /node/69e125342eed175ae971b6e2 HTTP/1.0" 202 Accepted 2026-04-16 18:12:16,351 - lava_callback - INFO - Starting async job submit for node 69e125342eed175ae971b6e2 2026-04-16 18:12:16,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:12:16,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125342eed175ae971b6e2 HTTP/1.1" 200 None 2026-04-16 18:12:16,392 - lava_callback - DEBUG - Processing node 69e125342eed175ae971b6e2: ltp-cve INFO: 172.21.0.1:36810 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:12:16,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:12:16,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:12:16,891 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69e125342eed175ae971b6e2/log.txt.gz 2026-04-16 18:12:17,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:12:17,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:12:17,275 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69e125342eed175ae971b6e2/lava-logs.yaml 2026-04-16 18:12:17,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:12:17,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:12:17,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69e125342eed175ae971b6e2/lava_callback.json.gz 2026-04-16 18:12:17,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:12:17,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125342eed175ae971b6e2 HTTP/1.1" 200 None 2026-04-16 18:12:17,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:12:17,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:12:17,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:12:17,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125342eed175ae971b6e2 HTTP/1.1" 200 None 2026-04-16 18:12:17,483 - lava_callback - INFO - Completed processing callback for node 69e125342eed175ae971b6e2 INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37424 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:12:46,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:12:46,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35174 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:14:56,548 - lava_callback - INFO - Received callback for node 69e125392eed175ae971b709 INFO: 172.21.0.1:35176 - "POST /node/69e125392eed175ae971b709 HTTP/1.0" 202 Accepted 2026-04-16 18:14:56,554 - lava_callback - INFO - Starting async job submit for node 69e125392eed175ae971b709 2026-04-16 18:14:56,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:14:56,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125392eed175ae971b709 HTTP/1.1" 200 None 2026-04-16 18:14:56,596 - lava_callback - DEBUG - Processing node 69e125392eed175ae971b709: ltp-fsx 2026-04-16 18:14:57,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:14:57,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:14:57,189 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69e125392eed175ae971b709/log.txt.gz 2026-04-16 18:14:57,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:14:57,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:14:57,643 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69e125392eed175ae971b709/lava-logs.yaml 2026-04-16 18:14:57,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:14:57,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:14:57,761 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69e125392eed175ae971b709/lava_callback.json.gz 2026-04-16 18:14:57,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:14:57,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125392eed175ae971b709 HTTP/1.1" 200 None 2026-04-16 18:14:57,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:14:57,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:14:57,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:14:57,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125392eed175ae971b709 HTTP/1.1" 200 None 2026-04-16 18:14:57,843 - lava_callback - INFO - Completed processing callback for node 69e125392eed175ae971b709 2026-04-16 18:14:58,239 - lava_callback - INFO - Received callback for node 69e125372eed175ae971b706 INFO: 172.21.0.1:35178 - "POST /node/69e125372eed175ae971b706 HTTP/1.0" 202 Accepted 2026-04-16 18:14:58,246 - lava_callback - INFO - Starting async job submit for node 69e125372eed175ae971b706 2026-04-16 18:14:58,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:14:58,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125372eed175ae971b706 HTTP/1.1" 200 None 2026-04-16 18:14:58,290 - lava_callback - DEBUG - Processing node 69e125372eed175ae971b706: ltp-fs_bind 2026-04-16 18:14:58,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:14:58,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:14:58,751 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e125372eed175ae971b706/log.txt.gz 2026-04-16 18:14:59,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:14:59,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:14:59,164 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e125372eed175ae971b706/lava-logs.yaml 2026-04-16 18:14:59,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:14:59,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:14:59,336 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e125372eed175ae971b706/lava_callback.json.gz 2026-04-16 18:14:59,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:14:59,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125372eed175ae971b706 HTTP/1.1" 200 None 2026-04-16 18:14:59,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:14:59,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:14:59,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:14:59,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125372eed175ae971b706 HTTP/1.1" 200 None 2026-04-16 18:14:59,427 - lava_callback - INFO - Completed processing callback for node 69e125372eed175ae971b706 INFO: 172.21.0.1:43462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35904 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 18:15:16,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:15:16,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET /node/694a2ee62060d3d847921738%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:15:37,900 - lava_callback - INFO - Received callback for node 69e1253a2eed175ae971b70c INFO: 172.21.0.1:52106 - "POST /node/69e1253a2eed175ae971b70c HTTP/1.0" 202 Accepted 2026-04-16 18:15:37,907 - lava_callback - INFO - Starting async job submit for node 69e1253a2eed175ae971b70c 2026-04-16 18:15:37,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:15:37,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1253a2eed175ae971b70c HTTP/1.1" 200 None 2026-04-16 18:15:37,955 - lava_callback - DEBUG - Processing node 69e1253a2eed175ae971b70c: ltp-input 2026-04-16 18:15:38,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:15:38,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:15:38,502 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69e1253a2eed175ae971b70c/log.txt.gz 2026-04-16 18:15:38,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:15:38,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:15:38,941 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69e1253a2eed175ae971b70c/lava-logs.yaml 2026-04-16 18:15:38,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:15:39,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:15:39,078 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69e1253a2eed175ae971b70c/lava_callback.json.gz 2026-04-16 18:15:39,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:15:39,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1253a2eed175ae971b70c HTTP/1.1" 200 None 2026-04-16 18:15:39,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:15:39,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:15:39,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:15:39,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1253a2eed175ae971b70c HTTP/1.1" 200 None 2026-04-16 18:15:39,166 - lava_callback - INFO - Completed processing callback for node 69e1253a2eed175ae971b70c INFO: 172.21.0.1:55182 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:15:46,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:15:46,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:16:16,622 - lava_callback - INFO - Received callback for node 69e1253c2eed175ae971b70f INFO: 172.21.0.1:56556 - "POST /node/69e1253c2eed175ae971b70f HTTP/1.0" 202 Accepted 2026-04-16 18:16:16,632 - lava_callback - INFO - Starting async job submit for node 69e1253c2eed175ae971b70f 2026-04-16 18:16:16,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:16:16,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1253c2eed175ae971b70f HTTP/1.1" 200 None 2026-04-16 18:16:16,675 - lava_callback - DEBUG - Processing node 69e1253c2eed175ae971b70f: ltp-ipc 2026-04-16 18:16:17,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:16:17,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:16:17,263 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69e1253c2eed175ae971b70f/log.txt.gz 2026-04-16 18:16:17,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:16:17,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:16:17,621 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69e1253c2eed175ae971b70f/lava-logs.yaml 2026-04-16 18:16:17,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:16:17,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:16:17,757 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69e1253c2eed175ae971b70f/lava_callback.json.gz 2026-04-16 18:16:17,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:16:17,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1253c2eed175ae971b70f HTTP/1.1" 200 None 2026-04-16 18:16:17,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:16:17,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:16:17,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:16:17,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1253c2eed175ae971b70f HTTP/1.1" 200 None 2026-04-16 18:16:17,839 - lava_callback - INFO - Completed processing callback for node 69e1253c2eed175ae971b70f INFO: 172.21.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35392 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:16:46,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:16:46,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41818 - "GET /node/69876ab0e31b58f834f1972b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52564 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:18:56,970 - lava_callback - INFO - Received callback for node 69e1253d2eed175ae971b716 INFO: 172.21.0.1:52572 - "POST /node/69e1253d2eed175ae971b716 HTTP/1.0" 202 Accepted 2026-04-16 18:18:56,980 - lava_callback - INFO - Starting async job submit for node 69e1253d2eed175ae971b716 2026-04-16 18:18:57,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:18:57,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1253d2eed175ae971b716 HTTP/1.1" 200 None 2026-04-16 18:18:57,037 - lava_callback - DEBUG - Processing node 69e1253d2eed175ae971b716: ltp-pty 2026-04-16 18:18:57,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:18:57,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:18:57,691 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69e1253d2eed175ae971b716/log.txt.gz 2026-04-16 18:18:57,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:18:58,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:18:58,122 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69e1253d2eed175ae971b716/lava-logs.yaml 2026-04-16 18:18:58,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:18:58,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:18:58,324 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69e1253d2eed175ae971b716/lava_callback.json.gz 2026-04-16 18:18:58,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:18:58,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1253d2eed175ae971b716 HTTP/1.1" 200 None 2026-04-16 18:18:58,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:18:58,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:18:58,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:18:58,414 - lava_callback - INFO - Received callback for node 69e1253e2eed175ae971b719 2026-04-16 18:18:58,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1253d2eed175ae971b716 HTTP/1.1" 200 None 2026-04-16 18:18:58,431 - lava_callback - INFO - Completed processing callback for node 69e1253d2eed175ae971b716 INFO: 172.21.0.1:52586 - "POST /node/69e1253e2eed175ae971b719 HTTP/1.0" 202 Accepted 2026-04-16 18:18:58,446 - lava_callback - INFO - Starting async job submit for node 69e1253e2eed175ae971b719 2026-04-16 18:18:58,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:18:58,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1253e2eed175ae971b719 HTTP/1.1" 200 None 2026-04-16 18:18:58,524 - lava_callback - DEBUG - Processing node 69e1253e2eed175ae971b719: ltp-sched 2026-04-16 18:18:58,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:18:59,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:18:59,013 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69e1253e2eed175ae971b719/log.txt.gz 2026-04-16 18:18:59,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:18:59,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:18:59,487 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69e1253e2eed175ae971b719/lava-logs.yaml 2026-04-16 18:18:59,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:18:59,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:18:59,619 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69e1253e2eed175ae971b719/lava_callback.json.gz 2026-04-16 18:18:59,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:18:59,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1253e2eed175ae971b719 HTTP/1.1" 200 None 2026-04-16 18:18:59,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:18:59,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:18:59,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:18:59,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1253e2eed175ae971b719 HTTP/1.1" 200 None 2026-04-16 18:18:59,737 - lava_callback - INFO - Completed processing callback for node 69e1253e2eed175ae971b719 INFO: 172.21.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56894 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 18:19:16,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:19:16,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET /node/693f5b640d8ce4018da8c7ca%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38314 - "GET /node/6953783831522df6df79e908%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33286 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:19:56,727 - lava_callback - INFO - Received callback for node 69e125402eed175ae971b71c INFO: 172.21.0.1:33292 - "POST /node/69e125402eed175ae971b71c HTTP/1.0" 202 Accepted 2026-04-16 18:19:56,735 - lava_callback - INFO - Starting async job submit for node 69e125402eed175ae971b71c 2026-04-16 18:19:56,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:19:56,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125402eed175ae971b71c HTTP/1.1" 200 None 2026-04-16 18:19:56,780 - lava_callback - DEBUG - Processing node 69e125402eed175ae971b71c: ltp-smoke 2026-04-16 18:19:57,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:19:57,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:19:57,292 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e125402eed175ae971b71c/log.txt.gz 2026-04-16 18:19:57,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:19:57,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:19:57,705 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e125402eed175ae971b71c/lava-logs.yaml 2026-04-16 18:19:57,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:19:57,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:19:57,845 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e125402eed175ae971b71c/lava_callback.json.gz 2026-04-16 18:19:57,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:19:57,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125402eed175ae971b71c HTTP/1.1" 200 None 2026-04-16 18:19:57,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:19:57,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:19:57,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:19:57,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125402eed175ae971b71c HTTP/1.1" 200 None 2026-04-16 18:19:57,966 - lava_callback - INFO - Completed processing callback for node 69e125402eed175ae971b71c INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 18:20:16,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:20:16,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42852 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:20:16,746 - lava_callback - INFO - Received callback for node 69e125432eed175ae971b722 INFO: 172.21.0.1:42856 - "POST /node/69e125432eed175ae971b722 HTTP/1.0" 202 Accepted 2026-04-16 18:20:16,757 - lava_callback - INFO - Starting async job submit for node 69e125432eed175ae971b722 2026-04-16 18:20:16,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:20:16,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125432eed175ae971b722 HTTP/1.1" 200 None 2026-04-16 18:20:16,813 - lava_callback - DEBUG - Processing node 69e125432eed175ae971b722: ltp-syscalls-ipc 2026-04-16 18:20:17,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:20:17,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:20:17,436 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e125432eed175ae971b722/log.txt.gz 2026-04-16 18:20:17,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:20:17,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:20:17,799 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e125432eed175ae971b722/lava-logs.yaml 2026-04-16 18:20:17,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:20:17,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:20:17,923 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e125432eed175ae971b722/lava_callback.json.gz 2026-04-16 18:20:17,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:20:17,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125432eed175ae971b722 HTTP/1.1" 200 None 2026-04-16 18:20:17,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:20:17,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:20:17,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:20:18,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125432eed175ae971b722 HTTP/1.1" 200 None 2026-04-16 18:20:18,022 - lava_callback - INFO - Completed processing callback for node 69e125432eed175ae971b722 INFO: 172.21.0.1:59964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46930 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:20:46,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:20:46,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41168 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:22:49,829 - lava_callback - INFO - Received callback for node 69e128e02eed175ae971b951 INFO: 172.21.0.1:34834 - "POST /node/69e128e02eed175ae971b951 HTTP/1.0" 202 Accepted 2026-04-16 18:22:49,838 - lava_callback - INFO - Starting async job submit for node 69e128e02eed175ae971b951 2026-04-16 18:22:49,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:22:49,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e128e02eed175ae971b951 HTTP/1.1" 200 None 2026-04-16 18:22:49,869 - lava_callback - DEBUG - Processing node 69e128e02eed175ae971b951: baseline-arm 2026-04-16 18:22:49,875 - lava_callback - WARNING - Failed to upload log 2026-04-16 18:22:49,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:22:50,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:22:50,004 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e128e02eed175ae971b951/lava-logs.yaml 2026-04-16 18:22:50,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:22:50,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:22:50,094 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e128e02eed175ae971b951/lava_callback.json.gz 2026-04-16 18:22:50,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:22:50,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e128e02eed175ae971b951 HTTP/1.1" 200 None 2026-04-16 18:22:50,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:22:50,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:22:50,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:22:50,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e128e02eed175ae971b951 HTTP/1.1" 200 None 2026-04-16 18:22:50,164 - lava_callback - INFO - Completed processing callback for node 69e128e02eed175ae971b951 INFO: 172.21.0.1:34838 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:22:56,831 - lava_callback - INFO - Received callback for node 69e125442eed175ae971b725 INFO: 172.21.0.1:34852 - "POST /node/69e125442eed175ae971b725 HTTP/1.0" 202 Accepted 2026-04-16 18:22:56,839 - lava_callback - INFO - Starting async job submit for node 69e125442eed175ae971b725 2026-04-16 18:22:56,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:22:56,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125442eed175ae971b725 HTTP/1.1" 200 None 2026-04-16 18:22:56,883 - lava_callback - DEBUG - Processing node 69e125442eed175ae971b725: ltp-timers 2026-04-16 18:22:57,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:22:57,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:22:57,421 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69e125442eed175ae971b725/log.txt.gz 2026-04-16 18:22:57,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:22:57,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:22:57,769 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69e125442eed175ae971b725/lava-logs.yaml 2026-04-16 18:22:57,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:22:57,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:22:57,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69e125442eed175ae971b725/lava_callback.json.gz 2026-04-16 18:22:57,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:22:57,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125442eed175ae971b725 HTTP/1.1" 200 None 2026-04-16 18:22:57,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:22:57,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:22:57,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:22:57,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125442eed175ae971b725 HTTP/1.1" 200 None 2026-04-16 18:22:57,971 - lava_callback - INFO - Completed processing callback for node 69e125442eed175ae971b725 INFO: 172.21.0.1:34854 - "GET /node/6986e0012de8e2dea3669169%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34864 - "GET /node/693f0f8a24745582e3999d9c%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-16 18:22:59,351 - lava_callback - INFO - Received callback for node 69e125462eed175ae971b728 INFO: 172.21.0.1:34868 - "POST /node/69e125462eed175ae971b728 HTTP/1.0" 202 Accepted 2026-04-16 18:22:59,360 - lava_callback - INFO - Starting async job submit for node 69e125462eed175ae971b728 2026-04-16 18:22:59,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:22:59,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125462eed175ae971b728 HTTP/1.1" 200 None 2026-04-16 18:22:59,445 - lava_callback - DEBUG - Processing node 69e125462eed175ae971b728: ltp-watchqueue 2026-04-16 18:22:59,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:22:59,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:22:59,892 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e125462eed175ae971b728/log.txt.gz 2026-04-16 18:23:00,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:23:00,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:23:00,229 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e125462eed175ae971b728/lava-logs.yaml 2026-04-16 18:23:00,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:23:00,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:23:00,344 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e125462eed175ae971b728/lava_callback.json.gz 2026-04-16 18:23:00,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:23:00,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125462eed175ae971b728 HTTP/1.1" 200 None 2026-04-16 18:23:00,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:23:00,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:23:00,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:23:00,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125462eed175ae971b728 HTTP/1.1" 200 None 2026-04-16 18:23:00,441 - lava_callback - INFO - Completed processing callback for node 69e125462eed175ae971b728 INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47872 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 18:23:16,096 - lava_callback - INFO - Received callback for node 69e124fc2eed175ae971b630 INFO: 172.21.0.1:47882 - "POST /node/69e124fc2eed175ae971b630 HTTP/1.0" 202 Accepted 2026-04-16 18:23:16,103 - lava_callback - INFO - Starting async job submit for node 69e124fc2eed175ae971b630 2026-04-16 18:23:16,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:23:16,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e124fc2eed175ae971b630 HTTP/1.1" 200 None 2026-04-16 18:23:16,173 - lava_callback - DEBUG - Processing node 69e124fc2eed175ae971b630: baseline-arm 2026-04-16 18:23:16,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47892 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:23:16,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 18:23:16,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:23:16,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:23:16,968 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fc2eed175ae971b630/log.txt.gz 2026-04-16 18:23:17,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:23:17,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:23:17,619 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fc2eed175ae971b630/lava-logs.yaml 2026-04-16 18:23:17,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:23:17,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:23:17,744 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e124fc2eed175ae971b630/lava_callback.json.gz DEBUG: Setup failed for 69e124fc2eed175ae971b630. Transitting job node result: incomplete -> fail 2026-04-16 18:23:17,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:23:17,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e124fc2eed175ae971b630 HTTP/1.1" 200 None 2026-04-16 18:23:17,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:23:17,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:23:17,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:23:17,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e124fc2eed175ae971b630 HTTP/1.1" 200 None 2026-04-16 18:23:18,019 - lava_callback - INFO - Completed processing callback for node 69e124fc2eed175ae971b630 INFO: 172.21.0.1:52836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38702 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:23:46,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:23:46,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:25:18,685 - lava_callback - INFO - Received callback for node 69e112272eed175ae971a6d7 INFO: 172.21.0.1:39516 - "POST /node/69e112272eed175ae971a6d7 HTTP/1.0" 202 Accepted 2026-04-16 18:25:18,692 - lava_callback - INFO - Starting async job submit for node 69e112272eed175ae971a6d7 2026-04-16 18:25:18,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:25:18,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112272eed175ae971a6d7 HTTP/1.1" 200 None 2026-04-16 18:25:18,732 - lava_callback - DEBUG - Processing node 69e112272eed175ae971a6d7: baseline-arm64-broonie 2026-04-16 18:25:19,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:25:19,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:25:19,116 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e112272eed175ae971a6d7/log.txt.gz 2026-04-16 18:25:19,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:25:19,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:25:19,411 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e112272eed175ae971a6d7/lava-logs.yaml 2026-04-16 18:25:19,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:25:19,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:25:19,508 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e112272eed175ae971a6d7/lava_callback.json.gz 2026-04-16 18:25:19,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:25:19,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e112272eed175ae971a6d7 HTTP/1.1" 200 None 2026-04-16 18:25:19,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:25:19,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 18:25:19,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:25:19,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e112272eed175ae971a6d7 HTTP/1.1" 200 None 2026-04-16 18:25:19,589 - lava_callback - INFO - Completed processing callback for node 69e112272eed175ae971a6d7 2026-04-16 18:25:20,174 - lava_callback - INFO - Received callback for node 69e1122e2eed175ae971a6ea INFO: 172.21.0.1:35190 - "POST /node/69e1122e2eed175ae971a6ea HTTP/1.0" 202 Accepted 2026-04-16 18:25:20,180 - lava_callback - INFO - Starting async job submit for node 69e1122e2eed175ae971a6ea 2026-04-16 18:25:20,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:25:20,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1122e2eed175ae971a6ea HTTP/1.1" 200 None 2026-04-16 18:25:20,234 - lava_callback - DEBUG - Processing node 69e1122e2eed175ae971a6ea: baseline-arm64-broonie 2026-04-16 18:25:20,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:25:20,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:25:20,654 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e1122e2eed175ae971a6ea/log.txt.gz 2026-04-16 18:25:20,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:25:21,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:25:21,007 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e1122e2eed175ae971a6ea/lava-logs.yaml 2026-04-16 18:25:21,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:25:21,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:25:21,159 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e1122e2eed175ae971a6ea/lava_callback.json.gz 2026-04-16 18:25:21,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:25:21,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1122e2eed175ae971a6ea HTTP/1.1" 200 None 2026-04-16 18:25:21,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:25:21,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 18:25:21,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:25:21,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1122e2eed175ae971a6ea HTTP/1.1" 200 None 2026-04-16 18:25:21,244 - lava_callback - INFO - Completed processing callback for node 69e1122e2eed175ae971a6ea INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:25:35,845 - lava_callback - INFO - Received callback for node 69e127202eed175ae971b87f INFO: 172.21.0.1:55708 - "POST /node/69e127202eed175ae971b87f HTTP/1.0" 202 Accepted 2026-04-16 18:25:35,851 - lava_callback - INFO - Starting async job submit for node 69e127202eed175ae971b87f 2026-04-16 18:25:35,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:25:35,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e127202eed175ae971b87f HTTP/1.1" 200 None 2026-04-16 18:25:35,894 - lava_callback - DEBUG - Processing node 69e127202eed175ae971b87f: baseline-arm64 2026-04-16 18:25:36,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:25:36,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:25:36,503 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e127202eed175ae971b87f/log.txt.gz INFO: 172.21.0.1:55722 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:25:36,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:25:36,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:25:36,968 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e127202eed175ae971b87f/lava-logs.yaml 2026-04-16 18:25:36,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:25:37,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:25:37,129 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e127202eed175ae971b87f/lava_callback.json.gz 2026-04-16 18:25:37,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:25:37,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e127202eed175ae971b87f HTTP/1.1" 200 None 2026-04-16 18:25:37,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:25:37,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 18:25:37,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:25:37,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e127202eed175ae971b87f HTTP/1.1" 200 None 2026-04-16 18:25:37,287 - lava_callback - INFO - Completed processing callback for node 69e127202eed175ae971b87f INFO: 172.21.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56770 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:25:46,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:25:46,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56164 - "GET /node/6940aa0f1e3c24e95681a386%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-16 18:26:53,953 - lava_callback - INFO - Received callback for node 69e129db2eed175ae971b9dd INFO: 172.21.0.1:36962 - "POST /node/69e129db2eed175ae971b9dd HTTP/1.0" 202 Accepted 2026-04-16 18:26:53,960 - lava_callback - INFO - Starting async job submit for node 69e129db2eed175ae971b9dd 2026-04-16 18:26:53,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:26:53,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e129db2eed175ae971b9dd HTTP/1.1" 200 None 2026-04-16 18:26:53,989 - lava_callback - DEBUG - Processing node 69e129db2eed175ae971b9dd: baseline-arm 2026-04-16 18:26:53,996 - lava_callback - WARNING - Failed to upload log 2026-04-16 18:26:54,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:26:54,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:26:54,088 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e129db2eed175ae971b9dd/lava-logs.yaml 2026-04-16 18:26:54,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:26:54,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:26:54,182 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e129db2eed175ae971b9dd/lava_callback.json.gz 2026-04-16 18:26:54,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:26:54,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e129db2eed175ae971b9dd HTTP/1.1" 200 None 2026-04-16 18:26:54,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:26:54,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:26:54,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:26:54,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e129db2eed175ae971b9dd HTTP/1.1" 200 None 2026-04-16 18:26:54,242 - lava_callback - INFO - Completed processing callback for node 69e129db2eed175ae971b9dd INFO: 172.21.0.1:36964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40770 - "GET /node/69876b21e31b58f834f19797%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45602 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:27:16,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:27:16,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42078 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:29:18,789 - lava_callback - INFO - Received callback for node 69e128112eed175ae971b907 INFO: 172.21.0.1:42086 - "POST /node/69e128112eed175ae971b907 HTTP/1.0" 202 Accepted 2026-04-16 18:29:18,796 - lava_callback - INFO - Starting async job submit for node 69e128112eed175ae971b907 2026-04-16 18:29:18,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:18,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e128112eed175ae971b907 HTTP/1.1" 200 None 2026-04-16 18:29:18,839 - lava_callback - DEBUG - Processing node 69e128112eed175ae971b907: baseline-nfs-arm64 2026-04-16 18:29:19,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:29:19,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:29:19,483 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e128112eed175ae971b907/log.txt.gz 2026-04-16 18:29:19,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:29:19,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:29:19,915 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e128112eed175ae971b907/lava-logs.yaml 2026-04-16 18:29:19,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:29:20,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:29:20,074 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e128112eed175ae971b907/lava_callback.json.gz 2026-04-16 18:29:20,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:20,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e128112eed175ae971b907 HTTP/1.1" 200 None 2026-04-16 18:29:20,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:20,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 18:29:20,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:20,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e128112eed175ae971b907 HTTP/1.1" 200 None 2026-04-16 18:29:20,222 - lava_callback - INFO - Completed processing callback for node 69e128112eed175ae971b907 INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60814 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:29:46,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:46,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 18:29:51,254 - lava_callback - INFO - Received callback for node 69de8796f6535ffd5b3eea05 INFO: 172.21.0.1:37918 - "POST /node/69de8796f6535ffd5b3eea05 HTTP/1.0" 202 Accepted 2026-04-16 18:29:51,260 - lava_callback - INFO - Starting async job submit for node 69de8796f6535ffd5b3eea05 2026-04-16 18:29:51,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:51,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de8796f6535ffd5b3eea05 HTTP/1.1" 200 None 2026-04-16 18:29:51,276 - lava_callback - DEBUG - Processing node 69de8796f6535ffd5b3eea05: baseline-arm-baylibre 2026-04-16 18:29:51,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de8796f6535ffd5b3eea05 2026-04-16 18:29:51,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:51,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de8796f6535ffd5b3eea05 HTTP/1.1" 200 None 2026-04-16 18:29:51,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:51,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-16 18:29:51,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:51,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de8796f6535ffd5b3eea05 HTTP/1.1" 200 None 2026-04-16 18:29:51,343 - lava_callback - ERROR - Error processing callback for node 69de8796f6535ffd5b3eea05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 18:29:51,959 - lava_callback - INFO - Received callback for node 69de8797f6535ffd5b3eea08 INFO: 172.21.0.1:37922 - "POST /node/69de8797f6535ffd5b3eea08 HTTP/1.0" 202 Accepted 2026-04-16 18:29:51,964 - lava_callback - INFO - Starting async job submit for node 69de8797f6535ffd5b3eea08 2026-04-16 18:29:51,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:51,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de8797f6535ffd5b3eea08 HTTP/1.1" 200 None 2026-04-16 18:29:51,980 - lava_callback - DEBUG - Processing node 69de8797f6535ffd5b3eea08: baseline-arm-baylibre 2026-04-16 18:29:51,980 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de8797f6535ffd5b3eea08 2026-04-16 18:29:51,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:51,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de8797f6535ffd5b3eea08 HTTP/1.1" 200 None 2026-04-16 18:29:51,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:52,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-16 18:29:52,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:52,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de8797f6535ffd5b3eea08 HTTP/1.1" 200 None 2026-04-16 18:29:52,035 - lava_callback - ERROR - Error processing callback for node 69de8797f6535ffd5b3eea08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 18:29:52,604 - lava_callback - INFO - Received callback for node 69de8799f6535ffd5b3eea0b INFO: 172.21.0.1:37928 - "POST /node/69de8799f6535ffd5b3eea0b HTTP/1.0" 202 Accepted 2026-04-16 18:29:52,610 - lava_callback - INFO - Starting async job submit for node 69de8799f6535ffd5b3eea0b 2026-04-16 18:29:52,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:52,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de8799f6535ffd5b3eea0b HTTP/1.1" 200 None 2026-04-16 18:29:52,628 - lava_callback - DEBUG - Processing node 69de8799f6535ffd5b3eea0b: baseline-arm-baylibre 2026-04-16 18:29:52,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de8799f6535ffd5b3eea0b 2026-04-16 18:29:52,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:52,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de8799f6535ffd5b3eea0b HTTP/1.1" 200 None 2026-04-16 18:29:52,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:52,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-16 18:29:52,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:52,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de8799f6535ffd5b3eea0b HTTP/1.1" 200 None 2026-04-16 18:29:52,685 - lava_callback - ERROR - Error processing callback for node 69de8799f6535ffd5b3eea0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 18:29:53,293 - lava_callback - INFO - Received callback for node 69de879af6535ffd5b3eea0e INFO: 172.21.0.1:37938 - "POST /node/69de879af6535ffd5b3eea0e HTTP/1.0" 202 Accepted 2026-04-16 18:29:53,299 - lava_callback - INFO - Starting async job submit for node 69de879af6535ffd5b3eea0e 2026-04-16 18:29:53,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:53,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de879af6535ffd5b3eea0e HTTP/1.1" 200 None 2026-04-16 18:29:53,319 - lava_callback - DEBUG - Processing node 69de879af6535ffd5b3eea0e: baseline-arm-baylibre 2026-04-16 18:29:53,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de879af6535ffd5b3eea0e 2026-04-16 18:29:53,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:53,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de879af6535ffd5b3eea0e HTTP/1.1" 200 None 2026-04-16 18:29:53,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:53,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-16 18:29:53,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:53,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de879af6535ffd5b3eea0e HTTP/1.1" 200 None 2026-04-16 18:29:53,376 - lava_callback - ERROR - Error processing callback for node 69de879af6535ffd5b3eea0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 18:29:53,984 - lava_callback - INFO - Received callback for node 69de879df6535ffd5b3eea19 INFO: 172.21.0.1:37940 - "POST /node/69de879df6535ffd5b3eea19 HTTP/1.0" 202 Accepted 2026-04-16 18:29:53,992 - lava_callback - INFO - Starting async job submit for node 69de879df6535ffd5b3eea19 2026-04-16 18:29:53,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:54,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de879df6535ffd5b3eea19 HTTP/1.1" 200 None 2026-04-16 18:29:54,010 - lava_callback - DEBUG - Processing node 69de879df6535ffd5b3eea19: baseline-arm-baylibre 2026-04-16 18:29:54,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de879df6535ffd5b3eea19 2026-04-16 18:29:54,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:54,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de879df6535ffd5b3eea19 HTTP/1.1" 200 None 2026-04-16 18:29:54,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:54,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-16 18:29:54,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:54,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de879df6535ffd5b3eea19 HTTP/1.1" 200 None 2026-04-16 18:29:54,110 - lava_callback - ERROR - Error processing callback for node 69de879df6535ffd5b3eea19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 18:29:54,617 - lava_callback - INFO - Received callback for node 69e125ed2eed175ae971b7ce INFO: 172.21.0.1:37946 - "POST /node/69e125ed2eed175ae971b7ce HTTP/1.0" 202 Accepted 2026-04-16 18:29:54,625 - lava_callback - INFO - Starting async job submit for node 69e125ed2eed175ae971b7ce 2026-04-16 18:29:54,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:54,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125ed2eed175ae971b7ce HTTP/1.1" 200 None 2026-04-16 18:29:54,687 - lava_callback - DEBUG - Processing node 69e125ed2eed175ae971b7ce: baseline-nfs-arm64 2026-04-16 18:29:55,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:29:56,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:29:56,004 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e125ed2eed175ae971b7ce/log.txt.gz INFO: 172.21.0.1:37962 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:29:56,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:29:56,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:29:56,822 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e125ed2eed175ae971b7ce/lava-logs.yaml 2026-04-16 18:29:56,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:29:56,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:29:56,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e125ed2eed175ae971b7ce/lava_callback.json.gz DEBUG: Setup failed for 69e125ed2eed175ae971b7ce. Transitting job node result: incomplete -> fail 2026-04-16 18:29:57,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:57,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e125ed2eed175ae971b7ce HTTP/1.1" 200 None 2026-04-16 18:29:57,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:57,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-16 18:29:57,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:29:57,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e125ed2eed175ae971b7ce HTTP/1.1" 200 None 2026-04-16 18:29:57,266 - lava_callback - INFO - Completed processing callback for node 69e125ed2eed175ae971b7ce INFO: 172.21.0.1:52054 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:30:11,077 - lava_callback - INFO - Received callback for node 69de879ef6535ffd5b3eea1c INFO: 172.21.0.1:36966 - "POST /node/69de879ef6535ffd5b3eea1c HTTP/1.0" 202 Accepted 2026-04-16 18:30:11,083 - lava_callback - INFO - Starting async job submit for node 69de879ef6535ffd5b3eea1c 2026-04-16 18:30:11,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:11,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de879ef6535ffd5b3eea1c HTTP/1.1" 200 None 2026-04-16 18:30:11,098 - lava_callback - DEBUG - Processing node 69de879ef6535ffd5b3eea1c: baseline-arm-baylibre 2026-04-16 18:30:11,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de879ef6535ffd5b3eea1c 2026-04-16 18:30:11,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:11,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de879ef6535ffd5b3eea1c HTTP/1.1" 200 None 2026-04-16 18:30:11,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:11,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-16 18:30:11,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:11,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de879ef6535ffd5b3eea1c HTTP/1.1" 200 None 2026-04-16 18:30:11,146 - lava_callback - ERROR - Error processing callback for node 69de879ef6535ffd5b3eea1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 18:30:13,528 - lava_callback - INFO - Received callback for node 69de87a6f6535ffd5b3eea39 INFO: 172.21.0.1:36980 - "POST /node/69de87a6f6535ffd5b3eea39 HTTP/1.0" 202 Accepted 2026-04-16 18:30:13,534 - lava_callback - INFO - Starting async job submit for node 69de87a6f6535ffd5b3eea39 2026-04-16 18:30:13,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:13,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87a6f6535ffd5b3eea39 HTTP/1.1" 200 None 2026-04-16 18:30:13,553 - lava_callback - DEBUG - Processing node 69de87a6f6535ffd5b3eea39: baseline-arm-clabbe 2026-04-16 18:30:13,553 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de87a6f6535ffd5b3eea39 2026-04-16 18:30:13,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:13,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87a6f6535ffd5b3eea39 HTTP/1.1" 200 None 2026-04-16 18:30:13,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:13,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-16 18:30:13,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:13,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de87a6f6535ffd5b3eea39 HTTP/1.1" 200 None 2026-04-16 18:30:13,603 - lava_callback - ERROR - Error processing callback for node 69de87a6f6535ffd5b3eea39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 18:30:14,194 - lava_callback - INFO - Received callback for node 69de87a8f6535ffd5b3eea65 INFO: 172.21.0.1:36984 - "POST /node/69de87a8f6535ffd5b3eea65 HTTP/1.0" 202 Accepted 2026-04-16 18:30:14,202 - lava_callback - INFO - Starting async job submit for node 69de87a8f6535ffd5b3eea65 2026-04-16 18:30:14,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:14,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87a8f6535ffd5b3eea65 HTTP/1.1" 200 None 2026-04-16 18:30:14,222 - lava_callback - DEBUG - Processing node 69de87a8f6535ffd5b3eea65: baseline-arm-clabbe 2026-04-16 18:30:14,223 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de87a8f6535ffd5b3eea65 2026-04-16 18:30:14,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:14,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87a8f6535ffd5b3eea65 HTTP/1.1" 200 None 2026-04-16 18:30:14,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:14,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-16 18:30:14,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:14,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de87a8f6535ffd5b3eea65 HTTP/1.1" 200 None 2026-04-16 18:30:14,274 - lava_callback - ERROR - Error processing callback for node 69de87a8f6535ffd5b3eea65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 18:30:14,877 - lava_callback - INFO - Received callback for node 69de87a9f6535ffd5b3eea69 INFO: 172.21.0.1:36994 - "POST /node/69de87a9f6535ffd5b3eea69 HTTP/1.0" 202 Accepted 2026-04-16 18:30:14,883 - lava_callback - INFO - Starting async job submit for node 69de87a9f6535ffd5b3eea69 2026-04-16 18:30:14,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:14,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87a9f6535ffd5b3eea69 HTTP/1.1" 200 None 2026-04-16 18:30:14,898 - lava_callback - DEBUG - Processing node 69de87a9f6535ffd5b3eea69: baseline-arm-clabbe 2026-04-16 18:30:14,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de87a9f6535ffd5b3eea69 2026-04-16 18:30:14,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:14,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87a9f6535ffd5b3eea69 HTTP/1.1" 200 None 2026-04-16 18:30:14,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:14,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-16 18:30:14,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:14,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de87a9f6535ffd5b3eea69 HTTP/1.1" 200 None 2026-04-16 18:30:14,949 - lava_callback - ERROR - Error processing callback for node 69de87a9f6535ffd5b3eea69: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37002 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 18:30:15,576 - lava_callback - INFO - Received callback for node 69de87aaf6535ffd5b3eea6c INFO: 172.21.0.1:37016 - "POST /node/69de87aaf6535ffd5b3eea6c HTTP/1.0" 202 Accepted 2026-04-16 18:30:15,582 - lava_callback - INFO - Starting async job submit for node 69de87aaf6535ffd5b3eea6c 2026-04-16 18:30:15,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:15,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87aaf6535ffd5b3eea6c HTTP/1.1" 200 None 2026-04-16 18:30:15,598 - lava_callback - DEBUG - Processing node 69de87aaf6535ffd5b3eea6c: baseline-arm-clabbe 2026-04-16 18:30:15,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de87aaf6535ffd5b3eea6c 2026-04-16 18:30:15,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:15,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87aaf6535ffd5b3eea6c HTTP/1.1" 200 None 2026-04-16 18:30:15,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:15,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-16 18:30:15,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:15,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de87aaf6535ffd5b3eea6c HTTP/1.1" 200 None 2026-04-16 18:30:15,647 - lava_callback - ERROR - Error processing callback for node 69de87aaf6535ffd5b3eea6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 18:30:16,259 - lava_callback - INFO - Received callback for node 69de87abf6535ffd5b3eea6f INFO: 172.21.0.1:37030 - "POST /node/69de87abf6535ffd5b3eea6f HTTP/1.0" 202 Accepted 2026-04-16 18:30:16,266 - lava_callback - INFO - Starting async job submit for node 69de87abf6535ffd5b3eea6f 2026-04-16 18:30:16,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:16,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87abf6535ffd5b3eea6f HTTP/1.1" 200 None 2026-04-16 18:30:16,290 - lava_callback - DEBUG - Processing node 69de87abf6535ffd5b3eea6f: baseline-arm-clabbe 2026-04-16 18:30:16,290 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de87abf6535ffd5b3eea6f 2026-04-16 18:30:16,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:16,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87abf6535ffd5b3eea6f HTTP/1.1" 200 None 2026-04-16 18:30:16,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:16,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-16 18:30:16,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:16,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de87abf6535ffd5b3eea6f HTTP/1.1" 200 None 2026-04-16 18:30:16,348 - lava_callback - ERROR - Error processing callback for node 69de87abf6535ffd5b3eea6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:30:16,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:16,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 18:30:16,931 - lava_callback - INFO - Received callback for node 69de87abf6535ffd5b3eea72 INFO: 172.21.0.1:37044 - "POST /node/69de87abf6535ffd5b3eea72 HTTP/1.0" 202 Accepted 2026-04-16 18:30:16,937 - lava_callback - INFO - Starting async job submit for node 69de87abf6535ffd5b3eea72 2026-04-16 18:30:16,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:16,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87abf6535ffd5b3eea72 HTTP/1.1" 200 None 2026-04-16 18:30:16,954 - lava_callback - DEBUG - Processing node 69de87abf6535ffd5b3eea72: baseline-arm-clabbe 2026-04-16 18:30:16,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de87abf6535ffd5b3eea72 2026-04-16 18:30:16,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:16,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87abf6535ffd5b3eea72 HTTP/1.1" 200 None 2026-04-16 18:30:16,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:16,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-16 18:30:16,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:17,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de87abf6535ffd5b3eea72 HTTP/1.1" 200 None 2026-04-16 18:30:17,002 - lava_callback - ERROR - Error processing callback for node 69de87abf6535ffd5b3eea72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 18:30:17,605 - lava_callback - INFO - Received callback for node 69de87acf6535ffd5b3eea75 INFO: 172.21.0.1:37046 - "POST /node/69de87acf6535ffd5b3eea75 HTTP/1.0" 202 Accepted 2026-04-16 18:30:17,610 - lava_callback - INFO - Starting async job submit for node 69de87acf6535ffd5b3eea75 2026-04-16 18:30:17,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:17,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87acf6535ffd5b3eea75 HTTP/1.1" 200 None 2026-04-16 18:30:17,626 - lava_callback - DEBUG - Processing node 69de87acf6535ffd5b3eea75: baseline-arm-clabbe 2026-04-16 18:30:17,627 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de87acf6535ffd5b3eea75 2026-04-16 18:30:17,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:17,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87acf6535ffd5b3eea75 HTTP/1.1" 200 None 2026-04-16 18:30:17,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:17,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-16 18:30:17,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:17,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de87acf6535ffd5b3eea75 HTTP/1.1" 200 None 2026-04-16 18:30:17,682 - lava_callback - ERROR - Error processing callback for node 69de87acf6535ffd5b3eea75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 18:30:18,283 - lava_callback - INFO - Received callback for node 69de87adf6535ffd5b3eea78 INFO: 172.21.0.1:37048 - "POST /node/69de87adf6535ffd5b3eea78 HTTP/1.0" 202 Accepted 2026-04-16 18:30:18,289 - lava_callback - INFO - Starting async job submit for node 69de87adf6535ffd5b3eea78 2026-04-16 18:30:18,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:18,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87adf6535ffd5b3eea78 HTTP/1.1" 200 None 2026-04-16 18:30:18,306 - lava_callback - DEBUG - Processing node 69de87adf6535ffd5b3eea78: baseline-arm-clabbe 2026-04-16 18:30:18,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de87adf6535ffd5b3eea78 2026-04-16 18:30:18,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:18,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87adf6535ffd5b3eea78 HTTP/1.1" 200 None 2026-04-16 18:30:18,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:18,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-16 18:30:18,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:18,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de87adf6535ffd5b3eea78 HTTP/1.1" 200 None 2026-04-16 18:30:18,364 - lava_callback - ERROR - Error processing callback for node 69de87adf6535ffd5b3eea78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 18:30:18,972 - lava_callback - INFO - Received callback for node 69de87aef6535ffd5b3eea7f INFO: 172.21.0.1:37052 - "POST /node/69de87aef6535ffd5b3eea7f HTTP/1.0" 202 Accepted 2026-04-16 18:30:18,978 - lava_callback - INFO - Starting async job submit for node 69de87aef6535ffd5b3eea7f 2026-04-16 18:30:18,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:19,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87aef6535ffd5b3eea7f HTTP/1.1" 200 None 2026-04-16 18:30:19,006 - lava_callback - DEBUG - Processing node 69de87aef6535ffd5b3eea7f: baseline-arm-clabbe 2026-04-16 18:30:19,006 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69de87aef6535ffd5b3eea7f 2026-04-16 18:30:19,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:19,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de87aef6535ffd5b3eea7f HTTP/1.1" 200 None 2026-04-16 18:30:19,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:19,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-16 18:30:19,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:30:19,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de87aef6535ffd5b3eea7f HTTP/1.1" 200 None 2026-04-16 18:30:19,055 - lava_callback - ERROR - Error processing callback for node 69de87aef6535ffd5b3eea7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43786 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:31:51,783 - lava_callback - INFO - Received callback for node 69e12afe2eed175ae971ba7d INFO: 172.21.0.1:32926 - "POST /node/69e12afe2eed175ae971ba7d HTTP/1.0" 202 Accepted 2026-04-16 18:31:51,789 - lava_callback - INFO - Starting async job submit for node 69e12afe2eed175ae971ba7d 2026-04-16 18:31:51,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:31:51,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12afe2eed175ae971ba7d HTTP/1.1" 200 None 2026-04-16 18:31:51,808 - lava_callback - DEBUG - Processing node 69e12afe2eed175ae971ba7d: baseline-arm 2026-04-16 18:31:51,813 - lava_callback - WARNING - Failed to upload log 2026-04-16 18:31:51,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:31:51,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:31:51,912 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e12afe2eed175ae971ba7d/lava-logs.yaml 2026-04-16 18:31:51,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 18:31:52,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 18:31:52,033 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e12afe2eed175ae971ba7d/lava_callback.json.gz 2026-04-16 18:31:52,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:31:52,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e12afe2eed175ae971ba7d HTTP/1.1" 200 None 2026-04-16 18:31:52,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:31:52,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-16 18:31:52,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:31:52,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e12afe2eed175ae971ba7d HTTP/1.1" 200 None 2026-04-16 18:31:52,098 - lava_callback - INFO - Completed processing callback for node 69e12afe2eed175ae971ba7d INFO: 172.21.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53192 - "GET / HTTP/1.0" 200 OK 2026-04-16 18:32:16,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 18:32:16,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44492 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]